Automated Data Element Detection Feature Guide

Important:

The Date Element Detection feature is available for customers with solution packaging.

Overview

The Data Element Detection Automation feature from OneTrust allows you to sync with external systems with secure credentials to seamlessly generate records in your data map without extensive, technical setup. Users simply connect their systems and the feature automatically identifies and classifies column and field names and provides data element and data categories. The main benefit is automated, accurate identification and classification of sensitive data across diverse systems, which enables:

  • Faster identification and creation of assets

  • Improved data governance and compliance readiness

  • Enhanced trust and usability of organizational data assets

OneTrust currently supports the following connector types to conduct data element detection. The automation setup is the basically the same for each, only their credentials aspects are unique.

If you do not have an existing asset or wish to create a new one, you can choose our auto-create option during automation setup.

Azure SQL Server Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the Azure SQL Server tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "Azure SQL Server_" with a random, system-generated alphanumeric ID. Example: Azure SQL Server_09IWTxm.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Connection URL

      CODE
      Example: jdbc:sqlserver://<your-db-instance>.database.windows.net:1433;serverName=<your-db-instance>.database.windows.net;databaseName=<your-db-name>;
    • User

    • Password



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

Databricks Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the Databricks tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "Databricks_" with a random, system-generated alphanumeric ID. Example: Databricks_qwo57bs.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Connection URL

      CODE
      Example:<JDBC-URL>;PWD=<Token>


  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

Google BiqQuery Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the Google BigQuery tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "Google BigQuery_" with a random, system-generated alphanumeric ID. Example: Google BigQuery_3gucxFl.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Type

    • Private key ID

    • Private key

    • Client email

    • Client ID

    • Auth URL

    • Token URL

    • Auth provider x509 cert URL

    • Client x509 cert URL

  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

MySQL Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the MySQL tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "MySQL_" with a random, system-generated alphanumeric ID. Example: MySQL_of5wiOF.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Connection URL

      CODE
      Example: jdbc:mysql://1.1.1.1:3306?zeroDateTimeBehavior=convertToNull&useSSL=true&requireSSL=false&serverTimezone=UTC
    • User

    • Password



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

O365 OneDrive Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the O365 OneDrive tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "SharePoint_" with a random, system-generated alphanumeric ID. Example: OneDrive_luhEErE.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Client ID

    • Client Secret

    • Scopes

    • Tenant ID



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

O365 SharePoint Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the O365 SharePoint tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "SharePoint_" with a random, system-generated alphanumeric ID. Example: SharePoint_Eu5sfKF.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Client ID

    • Client Secret

    • Scopes

      CODE
      Default: https://graph.microsoft.com/.default
      
      Additional permissions depend on the given service principle used.
    • Tenant ID



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

Oracle RDBMS Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the Oracle RDBMS tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "Oracle RDBMS_" with a random, system-generated alphanumeric ID. Example: Oracle RDBMS_C1PWD8d.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Connection URL

      CODE
      Example: jdbc:oracle:thin:@1.1.1.1:1521/<db_name>
    • User

    • Password



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

PostgreSQL Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the PostgreSQL tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "PostgreSQL_" with a random, system-generated alphanumeric ID. Example: PostgreSQL_2yaydjB.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Connection URL

      CODE
      Example:jdbc:postgresql://1.1.1.1:5432/<db_name>
    • User

    • Password



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

Salesforce Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the Salesforce tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "SharePoint_" with a random, system-generated alphanumeric ID. Example: SalesForce_BXXzZ48.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Grant Type

    • Client ID

    • Client Secret

    • UserName

    • Password



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

Snowflake Automation

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.



  3. Click the Set up automation button. The Set up automation modal appears.



    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. Select Data Elements for the configuration. The Select asset field appears.



  5. Choose from the available assets in your data map.

    Note:

    Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.



  6. Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.

  7. Select the Snowflake tile.



  8. The modal will update with automatically generated details for this new automation. The automation name defaults to "Snowflake_" with a random, system-generated alphanumeric ID. Example: Snowflake_DGOF8v2.

    Note:

    The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.



  9. Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.



    Creating new credentials requires that you provide the following from your desired source:

    • Connection URL

      CODE
      Example: jdbc:snowflake://1.1.1.1:443
    • User

    • Password



  10. When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.



    Tip:

    If an error message is shown for automation failure, check your credentials.



  11. Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.

To auto-create asset during automation setup

  1. On the Data Mapping Automation menu, select Inventory > Assets. The Assets screen appears.

  2. Click the Manage automation button. The Automations screen appears.


  3. Click the Set up automation button. The Set up automation modal appears.


    If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.



  4. In the Set up automation modal, select the Data Elements automation option.


  5. Begin typing in the field to generate the Auto-create new asset option. This can be any text that does not match any existing asset name.


  6. Select Auto-create new asset to update the Select asset field to Auto-create new asset.
    Note:

    Auto-creation defaults the asset name, managing organization, hosting location, IT owner to your current tenant. You can modify them later in the asset details screen.



  7. Click the Next button. The modal will update with Auto-create new asset as the selected system and for you to chose the desired system for discovery.


  8. Once you click on a system, the modal will generate the automation details and allow you to select/create credentials.


  9. Once credentials are selected, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.