Configuring Data Source Connection


When staging the model versions in the MI Hub or configuring the operator parameters in the MI Pipelines, it is necessary to access the data in various data sources or write data to the data source. Before using such products, you can complete the following data source connection configuration according to business needs:

  • Git
  • HIVE
  • MySQL
  • S3
  • Blob
  • HDFS

Prerequisites

  • You should have obtained the access permissions to corresponding data sources (data source URL, user name, password, etc).
  • For Git data source connection, ensure that the EAP Administrator has configured the Git host whitelist through the Resource Configuration > Connection Configuration > config page.

Creating Data Source Connection

The following steps take the configuration of a Git data source connection as an example to describe how to create a new data source connection:

  1. Log in to the EnOS Management Console and select Resource Configuration > Connection Configuration from the left navigation bar to open the Data Source Connection page.

  2. You can view the created data source connection by searching the data source name (EAP Administrator can click config to configure the Git host whitelist).

  3. Click New, and select Git in the pop-up Data Source Type window.

    ../_images/selecting_connection_type.png

  4. In the New Data Source window, provide the configuration of the data source connection.

    • Data Source Name: enter the name of data source
    • Git Type: select GitHub or GitLab
    • Authentication: select the method of user authentication (you can select to authenticate through Git Token or username & password)
    • Git URL: enter the address of the Git data source (the format is http://hostname:port/namespace)
    • Description: enter a brief description of the data source
    • Test Connection: after completing the above configuration, click Test to test whether the data source connection is configured corretly
    ../_images/testing_connection.png

  5. After testing the data source connection, click Confirm. The added data source connection will be displayed in the list.

Using Data Source Connection

After completing the data source connection configuration, you can access the data in the data source through the established connection. For example, you can access the model source file saved in the Git data source when staging the model version in the MI Hub:

../_images/accessing_data_source.png

Managing Data Source Connection

You can manage (edit or delete) the added data source connection according to business needs.

  1. If you need to edit a registered data source connection, you can click the Edit icon of a data source connection in the list of data source connections to modify its configuration information.
  2. If a data source connection is no longer needed by the business, you can click the Delete icon of the target data source connection in the list of data source connections to delete it.