Automatic Data Loader | On-Premises APM

About the Automatic Data Loader Job

The Automatic Data Loader can load .xlsx files created with Microsoft Excel version 2007 and above or .zip files into the system from an on-premises installation of APM Connect.

Note: To be able to load data successfully using Automatic Data Loader, make sure that:

The file name length is not more than 100 characters.
The file path of the scan directory is not more than 150 characters from root.
The file name does not contain any special characters.
Data loader templates are followed for loading the data in excel files.

GE Digital APM provides a method to automatically load data into the system from correctly formatted .xlsx or a .zip file containing correctly formatted .csv files. You must place your data loader workbook in the correct directory for a successful data load.

The job monitors a configured load directory for the presence of a file in a subdirectory and stages the contents of the file into the system. Multiple files moved into the directory are processed in descending order according to the last modified time stamp on each file.

The system logs the staging progress and archives the files in an archive directory. If data fails to stage or upload, a message is written to the log indicating the reason for failure, and the source files are moved to the FAILED FILES directory.

A service then retrieves the staged workbooks, and, using an administrative account, the service invokes the appropriate data loader to load the data contained in the workbooks.

Set up the Automatic Data Loader Job

Before You Begin

APM Connect must be installed.

Procedure

Access the APM Connect Administration Center.
In the Menu pane, in the Conductor section, select Job Conductor.
In the Job Conductor toolbar, select Add.

The Execution task pane is enabled.
In the Execution task pane, in the Label box, enter a label for the job.
In the Description box, enter a description for the job.
Select the Active check box.
In the Job section, select .

The Import generated code window appears.
Select Browse..., and then navigate to the folder containing the updated jobs package.
Select the job dinokeeper.zip, and then select Launch upload.

The job is imported into the Job Conductor.
Configure the context file to identify the location of the load directory, the archive directory, and the log file.
Modify the <Context_File_PATH> value in the job conductor context parameters to point to the context file for the job.
Run the job.

Results

The job conductor indicates that the job ran successfully, and the automatic data loader directories will be created if they do not already exist.

You can now place workbooks in the appropriate data loader directory.

Configure the Context File

Before You Begin

The context file provides the automatic data loader job with the information it needs to locate the directories and log the file it requires.

You should have imported the automatic data loader job.

Procedure

Navigate to the following folder: C:\APMConnect\Config\<system>

Modify the file ContextFile.xml to indicate the values for your system.


Parameter	Description	Default or recommended value
CONFIG_FILE_PATH	The path to the context file used for extraction.	Enter your unique value (for example, C:\APMConnect\Config\ContextFile.xml).
SCAN_DIR	The directory that contains the directories from which the job retrieves workbooks to load data.	Enter your unique value (for example, C:\APMConnect\Dinokeeper). Important: Because this job runs with administrative authority, you must control user access to this directory.
ARCHIVE_DIR	The directory that the facility uses to archive workbooks.	Enter your unique value (for example, C:\APMConnect\Archives).
SAP_CLOUD_ENABLED or MAXIMO_CLOUD_ENABLED	Determines whether the Adapter will be used in a cloud environment.	This is a required parameter. You must enter one of the following values: true: Adapters will be run in the cloud. false: Adapters will be run on premises.
APM_USERID	The GE Digital APM user ID.	Enter your unique value.
APM_PASSWORD	The GE Digital APM password.	Enter your unique value.
APM_DATASOURCE	The name of the GE Digital APM data source to which the data will be exported.	This is a required parameter only for the on-premises implementation. Enter your unique value.
APM_API_APP_SERVER	The name of the GE Digital APM server	This is a required parameter only for the on-premises implementation. Enter your unique value.
APM_APP_SERVER	The name of the GE Digital APM server	This is a required parameter only for the on-premises implementation. Enter your unique value.

Use the Automatic Data Loader

Use the Automatic Data Loader job to manually or programmatically load asset data to GE Digital APM.

About This Task

By default, the Automatic Data Loader job processes the files in the directories based on the alphanumeric directory name and then the time stamp of the files from oldest to most recent.

Procedure

Identify the directory that corresponds to the data loader you are using.
Move the data loader files (either a correctly formatted .xlsx or a .zip file that contains correctly formatted .csv files) into the identified directory.

The Automatic Data Loader Directories

The automatic data loader job uses directories within the directory identified in the SCAN_DIR parameter to identify the data loader to use for a particular workbook.

Data Loaders and Directories

The following table lists the directories that are created when the job starts that correspond to the various data loaders.

Note: For a Custom Data Loader, you now have the option of creating a directory with the same name as the new Loader ID and process the files within.


Data Loader Name	Folder Name
Family Data Loader	FamilyDataLoader
Equipment and Functional Location Loader	EquipmentFunctionalLocationLoader
Taxonomy Data Loader	TaxonomyLoader
Work History Loader	WorkHistoryLoader
Production Loss Analysis (PLA) 1 - Admin	PLAAdminBatchDataLoader
Production Loss Analysis (PLA) 2 - Event	PLAEventBatchDataLoader
Production Loss Analysis (PLA) 3 - Plan	PLAPlanBatchDataLoader
Root Cause Analysis (RCA)	RCABatchDataLoader
System Reliability Data Loader	SystemReliabilityBatchDataLoader
Asset Criticality Analysis (ACA Checklist)	ACACheckListDataLoader
Asset Criticality Analysis (ACA)	ACAMatrixDataLoader
GIS Data Loader	GISDATALOADER
Policy Instance Data Loader	PolicyInstanceBatchDataLoader
Role Data Loader	RolesDataLoader
Rounds Allowable Values	AllowableValuesBatchDataLoader
Rounds Readings	ReadingsBatchDataLoader
Rounds Routes	RouteBatchDataLoader
Rounds Templates and Template Groups	TemplateBatchDataLoader
Inspection Management (IM) Assets	IMBatchAssetDataLoader
Inspection Management (IM) Functional Location	IMBatchFLDataLoader
RBI Components To TML Groups Relationship	RBITMBatchDataLoader
Risk Based Inspection (RBI) 580	RBI580BatchDataLoader
Risk Based Inspection (RBI) 581	RBI581BatchDataLoader
Risk Based Inspection (RBI) Corrosion Loop	RBICorrosionLoopBatchDataLoader
Thickness Monitoring (TM) Equipment	TMBatchAssetDataLoader
Thickness Monitoring (TM) Functional Location	TMBatchFLDataLoader
Thickness Monitoring (TM) Piping Equipment	TMBatchPipingAssetDataLoader
Thickness Monitoring (TM) Piping Functional Location	TMBatchPipingFLDataLoader
Generation Availability Analysis (GAA) GADS Amplification Codes	GAAAmplificationCodeDataLoader
Generation Availability Analysis (GAA) GADS Cause Code	GAACauseCodeDataLoader
Generation Availability Analysis (GAA) Events	GAAEventsDataLoader
Calibration Management	CalibrationBatchDataLoader
Hazard Analysis	HazardAnalysisBatchDataLoader
Asset Strategy Management (ASM)	AsmDataLoader
Asset Strategy Management (ASM) Template	AsmTemplateDataLoader
Failure Modes and Effects Analysis (FMEA)	FMEAAnalysisDataLoader
Failure Modes and Effects Analysis (FMEA) Analysis Templates	FMEAAnalysisTemplateDataLoader
Failure Modes and Effects Analysis (FMEA) Asset Templates	FMEAAssetTemplateDataLoader
Reliability Centered Maintenance (RCM)	RCMAnalysisDataLoader
Reliability Centered Maintenance (RCM) Analysis Template	RCMAnalysisTemplateDataLoader
Risk Matrix	RiskMatrixDataLoader
GAA Wind Asset Hierarchy	GAAWindAssetHierarchyDataLoader
GAA Wind Events	GAAWindEventDataloader
GAA Wind Sub Group Capacity	GAAWindSubgroupCapacityDataLoader
Rounds Pro - Picklist Dataloader	PicklistDataloader
Rounds Pro - Route Master Dataloader	RouteMasterDataloader
Rounds Pro - Step Dataloader	StepDataloader
Rounds Pro - Step Conditions	StepConditionDataloader
Rounds Pro - Step Template	StepTemplateDataloader