Connecting & Managing Data Sources

With OneTrust Data Discovery, you scan, classify, and review data held in external systems and integrate them with OneTrust as data sources. This allows organizations to leverage the discovered data to further advance their automation tasks, request fulfillment, data mapping and governance objectives. To do this, you will need to set up a data source within the OneTrust application.

This document is intended to demonstrate how one might configure the initial setup of a data source. In this example, we are connecting to an Amazon S3 instance from Data Discovery Gallery. This menu contains all of the seeded connection options supported by OneTrust. Filter the screen by data source type (web app, database, or file) and select a data source tile to learn what connections and wizards available.



Prerequisites

  • Instance credentials

  • Installed worker node

  • External credential vault

Note:

Some menus, sections, and options shown in this article may only be available as a preview feature. To enable access to this feature, please contact OneTrust Support to submit the request.

Essential Best Practices

  1. Build out credential JSONs and extract details. This is necessary so a fully built JSON is sent to the key vault.

  2. Build a credential reference within OneTrust. The data source credential should include the location where it's stored in the key vault so the application can reference.

  3. Leverage default scan profiles for first times/classification profiles

  4. Create data sources using the available Gallery Wizards to discover out-of-the-box guided set up steps.

  5. Previously cataloged schemas are not excluded or deleted from the Data Catalog if the scan profile is updated. You must create, configure, and scan a new data source to remove said schemas from the Data Catalog.

To create data sources

  1. On the Data Discovery menu, select Setup > Data sources. The Data sources screen appears.

  2. Click the Add data source button. The Data Discovery gallery screen appears.

  3. Locate and click your desired system tile. The Create Data Source screen will appear.
    Note:

    For this example, we are selecting Databricks.



  4. In the first section, choose an existing worker node.
    Note:

    For more information on creating and deploying a worker node, see Guided Worker Node Installation Overview.



  5. In the second section, provide, you can create new data source credentials or choose from existing Databricks credentials.
    Tip:

    Credentials can also be changed post setup in the Settings tab on the Data Source Details screen.



  6. If creating new credentials, provide information for the fields:
    Note:

    For more information on credentials, see Creating Data Source Credentials.



  7. Click the Next button.
  8. Provide a unique name for this new data source.


  9. For the Set scan profile, you can either choose the system default profile, choose an existing profile, or create a new one.
    Tip:

    OneTrust recommends when using a new connector system to run the first scan using Quick Scan profiles to check if permissions are accurately granted to identify terms.





  10. In the Select Asset for Data Mapping (Optional) block, choose to auto create, select an existing, or create a new one.
    Note:

    An asset can only be linked to a single data source at a time. You will receive an error alert if one is already mapped.





  11. Click the Save button. The Data Source Details screen appears for the new data source.

  12. Click the Activate button.
    Note:

    For more information on managing data sources after creation, see Managing Data Source Details.

  13. Start a scan for the new data source to begin ingesting data that has been classified by the connector.

To delete data sources

  1. On the Data Discovery menu, select Setup > Data sources. The Data sources screen appears.

  2. Hover over the row of a data source in the list screen to reveal the Context Menu.
  3. Click the icon, then select Delete. The Delete modal will appear.
    Attention:

    Once a data source is deleted, results cannot be retrieved.

  4. Click the Confirm button. The data source will be deleted.
  5. To review deleted data sources, click the View Deleted Records button in the Data Sources screen.

To test data source connections

Note:

You will not be able to test connections if the data source is inactive or the associated worker node is not healthy.

  1. On the Data Discovery menu, select Setup > Data sources. The Data sources screen appears.

  2. Click on the name of a data source. The Data source details screen appears.

  3. In the Connection Status block, click the Test Connection button. The system will validate the connection and return a status and connection date in UTC.


  4. For failure or validation issues, click the View Log(s) link to navigate to the Logs tab in the Data source details screen.


  5. Hover over a Job ID row to reveal and click the copy icon to copy the message log to your clipboard. Use this information for further investigation and troubleshooting.