Automatic Data Loader | On-Premises APM

About the Automatic Data Loader Job

The Automatic Data Loader can load .xlsx files created with Microsoft Excel version 2007 and above or .zip files into the system from an on-premises installation of APM Connect.

Note: To be able to load data successfully using Automatic Data Loader, make sure that:

The file name length is not more than 100 characters.
The file path of the scan directory is not more than 150 characters from root.
The file name does not contain any special characters.
Data loader templates are followed for loading the data in excel files.

GE Digital APM provides a method to automatically load data into the system from correctly formatted .xlsx or a .zip file containing correctly formatted .csv files. You must place your data loader workbook in the correct directory for a successful data load.

The job monitors a configured load directory for the presence of a file in a subdirectory and stages the contents of the file into the system. Multiple files moved into the directory are processed in descending order according to the last modified time stamp on each file.

The system logs the staging progress and archives the files in an archive directory. If data fails to stage or upload, a message is written to the log indicating the reason for failure, and the source files are moved to the FAILED FILES directory.

A service then retrieves the staged workbooks, and, using an administrative account, the service invokes the appropriate data loader to load the data contained in the workbooks.

Set up the Automatic Data Loader Job

Before You Begin

APM Connect must be installed.

Procedure

Access the APM Connect Administration Center.
In the Menu pane, in the Conductor section, select Job Conductor.
In the Job Conductor toolbar, select Add.

The Execution task pane is enabled.
In the Execution task pane, in the Label box, enter a label for the job.
In the Description box, enter a description for the job.
Select the Active check box.
In the Job section, select .

The Import generated code window appears.
Select Browse..., and then navigate to the folder containing the updated jobs package.
Select the job dinokeeper.zip, and then select Launch upload.

The job is imported into the Job Conductor.
Configure the context file to identify the location of the load directory, the archive directory, and the log file.
Modify the <Context_File_PATH> value in the job conductor context parameters to point to the context file for the job.
Run the job.

Results

The job conductor indicates that the job ran successfully, and the automatic data loader directories will be created if they do not already exist.

You can now place workbooks in the appropriate data loader directory.

Configure the Context File

Before You Begin

The context file provides the automatic data loader job with the information it needs to locate the directories and log the file it requires.

You should have imported the automatic data loader job.

Procedure

Navigate to the following folder: C:\APMConnect\Config\<system>

Modify the file ContextFile.xml to indicate the values for your system.


Parameter	Description	Default or recommended value
CONFIG_FILE_PATH	The path to the context file used for extraction.	Enter your unique value (for example, C:\APMConnect\Config\ContextFile.xml).
SCAN_DIR	The directory that contains the directories from which the job retrieves workbooks to load data.	Enter your unique value (for example, C:\APMConnect\Dinokeeper). Important: Because this job runs with administrative authority, you must control user access to this directory.
ARCHIVE_DIR	The directory that the facility uses to archive workbooks.	Enter your unique value (for example, C:\APMConnect\Archives).
SAP_CLOUD_ENABLED or MAXIMO_CLOUD_ENABLED	Determines whether the Adapter will be used in a cloud environment.	This is a required parameter. You must enter one of the following values: true: Adapters will be run in the cloud. false: Adapters will be run on premises.
APM_USERID	The GE Digital APM user ID.	Enter your unique value.
APM_PASSWORD	The GE Digital APM password.	Enter your unique value.
APM_DATASOURCE	The name of the GE Digital APM data source to which the data will be exported.	This is a required parameter only for the on-premises implementation. Enter your unique value.
APM_API_APP_SERVER	The name of the GE Digital APM server	This is a required parameter only for the on-premises implementation. Enter your unique value.
APM_APP_SERVER	The name of the GE Digital APM server	This is a required parameter only for the on-premises implementation. Enter your unique value.

Use the Automatic Data Loader

Use the Automatic Data Loader job to manually or programmatically load asset data to GE Digital APM.

About This Task

By default, the Automatic Data Loader job processes the files in the directories based on the alphanumeric directory name and then the time stamp of the files from oldest to most recent.

Procedure

Identify the directory that corresponds to the data loader you are using.
Move the data loader files (either a correctly formatted .xlsx or a .zip file that contains correctly formatted .csv files) into the identified directory.

The Automatic Data Loader Directories

The automatic data loader job uses directories within the directory identified in the SCAN_DIR parameter to identify the data loader to use for a particular workbook.

Data Loaders and Directories

The following table lists the directories that are created when the job starts that correspond to the various data loaders.

Note: For a Custom Data Loader, you now have the option of creating a directory with the same name as the new Loader ID and process the files within.


Data Loader Name	Directory Name
APM Family	FamilyDataLoader
Asset Criticality Analysis (ACA)	ACAMatrixDataLoader
Asset Criticality Analysis (ACA Checklist)	ACACheckListDataLoader
Asset Ingestion Loader	AssetIngestionLoader
Asset Strategy Management (ASM)	ASMDataLoader
Asset Strategy Management (ASM) Templates	ASMTemplateDataLoader
Calibration	CalibrationBatchDataLoader
Custom Asset Hierarchy	Custom Asset Hierarchy Loader
Equipment and Functional Location	EquipmentFunctionalLocationLoader
Failure Modes and Effects Analysis (FMEA)	FMEAAnalysisDataLoader
Failure Modes and Effects Analysis (FMEA) Analysis Templates	FMEAAnalysisTemplateDataLoader
Failure Modes and Effects Analysis (FMEA) Asset Templates	FMEAAssetTemplateDataLoader
Generation Availability Analysis (GAA) Amplification Codes	GAA GADS Amplification Code
Generation Availability Analysis (GAA) Cause Code	GAA GADS Cause Code
Generation Availability Analysis (GAA) Events	GAA Events
GAA Wind Asset Hierarchy	GAA Wind Asset Hierarchy
GAA Wind Events	GAA Wind Events
GAA Wind Sub Group Capacity	GAA Wind Sub Group Capacity
Geographic Information System (GIS)	GISDataLoader
Hazards	HazardAnalysisBatchDataLoader
Inspection Management (IM) Assets	ManageInspections
Inspection Management (IM) Functional Location	ManageInspectionsFL
Production Loss Analysis (PLA) Admin	PLA Admin Data
Production Loss Analysis (PLA) Plan	PLA Plan Data
Production Loss Analysis (PLA) Production Event	Production Event Data
Reliability Centered Maintenance (RCM)	RCMAnalysisDataLoader
RCM Analysis Template	RCMAnalysisTemplateDataLoader
Risk Based Inspection (RBI) 580	ManageRBI580
Risk Based Inspection (RBI) 581	ManageRBI581
Risk Based Inspection (RBI) Corrosion Loop	Load RBI Corrosion Loop
Risk Matrix	RiskMatrixDataLoader
Role	RoleDataLoader
Root Cause Analysis (RCA)	Manage RCA
Rounds Allowable Values	AllowableValuesBatchDataLoader
Rounds Readings	ReadingsBatchDataLoader
Rounds Routes	Rounds Route
Rounds Templates	TemplateBatchDataLoader
Tags to Assets Relationship	ManageTagLinks
Taxonomy	TaxonomyLoader
Thickness Monitoring (TM) Equipment	ManageTMLGroup
Thickness Monitoring (TM) Functional Location	ManageTMLGroupFL
Work History	WorkHistoryLoader
Policy Instance Data Loader	PolicyInstanceBatchDataLoader