Data Loader

About the Geographic Information System (GIS) Data Loader

The GIS Data Loader allows geospatial data associated with existing APM entities to be imported into the GIS data model, so that information about the entities can be displayed in the Maps module in APM. You can load geospatial data using the provided Excel workbook.

About the GIS Data Loader Requirements

To use the GIS Data Loader, you must have existing entity records, for example, the Functional Locations or Equipment, that you want to associate with the geospatial data. To use the geospatial data in the Maps module, your organization must have completed the GIS Configuration steps.

Mapping

The GIS Data Loader inserts geospatial data in the MI_ENTY_GEO_DATA table and associates it with existing entities in APM. Entities are identified by mapping from specified cells in the Excel workbook to the ENTITY_KEY field. The data loader evaluates the data provided in the Excel workbook in the following order:

ENTITY_KEY
ENTITY_ID
FAMILY_ID + ID_FIELD + ID

Note: The column positions in the spreadsheet should not be moved and the captions should not be changed.

Note: If data is not provided, the cell should be left empty.

About the GIS Data Loader Data Model

The following data model illustrates the records that the Data Loader supports.

GIS Data Loader Data Model

Note: In the diagram, GIS Location refers to the name of a database table. You can relate each GIS Location to an Entity of any family in APM. Geometry represents the actual data for GIS Location. The Has Entity and Has Geometry are not relationship families defined in APM. They are the relationships in an internal database and the purpose is same as the relationships between entity families.

About the GIS Data Loader General Loading Strategy

The imported data must load in a specific sequence to successfully populate fields, create records, and link data to the predecessor and successor records.

Best Practices

When importing data using the GIS Data Loader, you must use the following Best Practices:

To identify an existing record to associate with the geospatial information, use one of the following options:
- Specify the ENTITY_KEY value.
- Specify the ENTITY_ID value. If ENTITY_KEY is not provided, the data loader will search for the ENTITY_KEY matching the ENTITY_ID.
- Specify the FAMILY_ID, ID_FIELD, and ID values. If ENTITY_KEY and ENTITY_ID are not provided, the data loader will search for an ENTITY_KEY matching the specified values.
If there is no existing record for the referenced Entity Key in the MI_ENTY_GEO_DATA table, and you provide valid geospatial data, a new record will be created in the MI_ENTY_GEO_DATA table.
If there is an existing record for the referenced Entity Key in the MI_ENTY_GEO_DATA table, and you provide new valid geospatial data, the existing record in the MI_ENTY_GEO_DATA table will be updated.
If there is an existing record for the referenced Entity Key in the MI_ENTY_GEO_DATA table, and you provide no geospatial data (i.e. the cell is empty), the record will be deleted from the MI_ENTY_GEO_DATA table.
Geospatial data in the GEOD_DATA column should conform to the geometry spatial data type.
Note: Valid geospatial data format is dependent on your APM database type. Points must specify Longitude first, then Latitude, in degrees. For example, the geospatial data for a point in Roanoke, Virginia, USA is defined as. POINT (-79.9372289704512 37.2698054035023) in SQL Server 2016.
All columns in the worksheets must be formatted as Text or Entity Key. Entity Keys should be formatted as Numbers.

Load Sequence

When importing data using the data loader workbook, you must use the following workflow:

Download the data loader workbook provided by GE Vernova.
Identify the data requirements for exporting the data into the data loader workbook.
Extract data from APM and legacy applications to populate the data loader workbook.
Provide batch numbers in the Batch worksheet and in the first column of the remaining worksheets in the data loader workbook.
Import data into APM.
Monitor the status of the data load, and verify the results in the log.
Conduct tests in APM to ensure that the imported data loaded accurately.

For each row in the data loader workbook, the GIS Data Loader creates a new record in APM. However, if records have already been created and you import the data, the existing records will be updated or deleted.

About the GIS Data Loader Workbook Layout and Use

In order to import data using the GIS Data Loader, APM provides an Excel workbook, Geographic Information System (GIS).xlsx, which supports the Maps tool in APM. This workbook must be used to perform the data load.

The following table lists the worksheets that are included in the GIS Data Loader workbook.


Worksheet	Description
GIS	The only worksheet used by the GIS Data Loader. It is used to load geospatial data for existing entities.

The following table lists the fields in the workbook:

GIS Worksheet


Field Caption	Field ID	Data Type (Length)	Comments
Batch ID	BATCH_ID	Character (50)	This is the Batch ID field.
Entity Key	ENTITY_KEY	Numeric	This is the Entity Key field.
Entity ID	ENTITY_ID	Character (255)	This is the Entity ID field.
Family ID	FAMILY_ID	Character (50)	This is the Family ID field.
Family ID Field	ID_FIELD	Character (50)	This is the ID Field name for the specified Family.
ID	ID	Character (255)	The is the ID field.
Geometry	GEOD_DATA	Character (4000)	This is the Spatial Data Field.

About the GIS Data Loader Load Verification

About This Task

After loading data, you must perform the following steps in APM to ensure the integrity and accuracy of the data imported from the data loader workbook:

Review the details of the import job. These details will indicate if any errors occurred during the data load. The log helps you identify any records that are not loaded.
Run a query to view the geospatial data that was uploaded. You can use the baseline Map Query that is stored in the \\Public\Meridium\Modules\Core\Queries\Map Queries\ folder, as a reference.