EnOS provides various built-in SDKs in its common library to help you access and process data more conveniently. These SDKs lower the development thresholds and improve development efficiency.
SDKs Provided in the Library¶
|SYNC_HDFS_TO_S3||Synchronize data from a specified path in HDFS to a specified path in an S3 database.|
|COLUMNS_TO_ROWS||Converts the row data of your HIVE table, where each row contains values of all data collecting points of a device at a time, into a table where each row contains historical values of a single data collecting point.|
|SYNC_MDM||Synchronizes master data to HDFS.|
|SYNC_REPORT_DB||Performs one-time synchronization of full-load data from the Hive table to your target table.|
|FLATTEN_POINTS||Converts EnOS raw point data (each row contains historical values of a single data collecting point) to sql-like row data (each row contains values of all data collecting points of a device at a time).|
|POWER_DATA_INTERPOLATION||Interpolates power data, especially for the production missing data.|
|HivePartitionDroppedSDK||Deletes the metadata of both the specified Hive partition and the stored data.|
|SYNC_REPORT_STRUCTURE||Transfers table structure from Hive database to MySQL report database.|
|SHORT_TERM_LOAD_FORECAST||Provides 0-6 days load forecast for different time granularity levels (15 min, 30 min, 1 hour, 1 day) based on historical data and optional weather data for different power consumers in the grid.|
|HADOOP_FILE_CRUSHER||Reduces the number of files by combining multiple small files into several larger files.|
How to Use the SDK¶
The major procedure of using the built-in SDK is as per the below.
In Batch Processing > Data Development, browse the Common Library tree and locate the SDK that you want to use.
Double-click the version of the script and review the details about the script.
Click Use the Program.
In the pop-out window, provide the information for the workflow.