Automated Data Element Detection Feature Guide
The Date Element Detection feature is available for customers with solution packaging.
Overview
The Data Element Detection Automation feature from OneTrust allows you to sync with external systems with secure credentials to seamlessly generate records in your data map without extensive, technical setup. Users simply connect their systems and the feature automatically identifies and classifies column and field names and provides data element and data categories. The main benefit is automated, accurate identification and classification of sensitive data across diverse systems, which enables:
-
Faster identification and creation of assets
-
Improved data governance and compliance readiness
-
Enhanced trust and usability of organizational data assets
OneTrust currently supports the following connector types to conduct data element detection. The automation setup is the basically the same for each, only their credentials aspects are unique.
If you do not have an existing asset or wish to create a new one, you can choose our auto-create option during automation setup.
Prerequisites
-
Installed lightweight worker node through one of the supported cloud service providers: AWS, Azure, or GCP. For more information, see Lightweight Worker Node Deployment & Automation Guide.
Azure SQL Server Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the Azure SQL Server tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "Azure SQL Server_" with a random, system-generated alphanumeric ID. Example: Azure SQL Server_09IWTxm.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Connection URL
CODEExample: jdbc:sqlserver://<your-db-instance>.database.windows.net:1433;serverName=<your-db-instance>.database.windows.net;databaseName=<your-db-name>; -
User
-
Password
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
Databricks Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the Databricks tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "Databricks_" with a random, system-generated alphanumeric ID. Example: Databricks_qwo57bs.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Connection URL
CODEExample:<JDBC-URL>;PWD=<Token>
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
Google BiqQuery Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the Google BigQuery tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "Google BigQuery_" with a random, system-generated alphanumeric ID. Example: Google BigQuery_3gucxFl.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Type
-
Private key ID
-
Private key
-
Client email
-
Client ID
-
Auth URL
-
Token URL
-
Auth provider x509 cert URL
-
Client x509 cert URL
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
MySQL Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the MySQL tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "MySQL_" with a random, system-generated alphanumeric ID. Example: MySQL_of5wiOF.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Connection URL
CODEExample: jdbc:mysql://1.1.1.1:3306?zeroDateTimeBehavior=convertToNull&useSSL=true&requireSSL=false&serverTimezone=UTC -
User
-
Password
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
O365 OneDrive Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the O365 OneDrive tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "SharePoint_" with a random, system-generated alphanumeric ID. Example: OneDrive_luhEErE.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Client ID
-
Client Secret
-
Scopes
-
Tenant ID
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
O365 SharePoint Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the O365 SharePoint tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "SharePoint_" with a random, system-generated alphanumeric ID. Example: SharePoint_Eu5sfKF.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Client ID
-
Client Secret
-
Scopes
CODEDefault: https://graph.microsoft.com/.default Additional permissions depend on the given service principle used. -
Tenant ID
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
Oracle RDBMS Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the Oracle RDBMS tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "Oracle RDBMS_" with a random, system-generated alphanumeric ID. Example: Oracle RDBMS_C1PWD8d.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Connection URL
CODEExample: jdbc:oracle:thin:@1.1.1.1:1521/<db_name> -
User
-
Password
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
PostgreSQL Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the PostgreSQL tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "PostgreSQL_" with a random, system-generated alphanumeric ID. Example: PostgreSQL_2yaydjB.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Connection URL
CODEExample:jdbc:postgresql://1.1.1.1:5432/<db_name> -
User
-
Password
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
Salesforce Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the Salesforce tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "SharePoint_" with a random, system-generated alphanumeric ID. Example: SalesForce_BXXzZ48.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Grant Type
-
Client ID
-
Client Secret
-
UserName
-
Password
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.
Snowflake Automation
-
On the Data Mapping Automation menu, select . The Assets screen appears.
-
Click the Manage automation button. The Automations screen appears.
-
Click the Set up automation button. The Set up automation modal appears.
If you have already set up prior automations or are returning to add more, the Set up automation button will be located next to the search bar instead of the screen.
-
Select Data Elements for the configuration. The Select asset field appears.
-
Choose from the available assets in your data map.
Note:Chosen assets with no linked system will be flagged in the modal. You can link a system in the following steps.
-
Click the Next button. If the asset is not currently linked to any system, you will need to choose one from the Gallery.
-
Select the Snowflake tile.
-
The modal will update with automatically generated details for this new automation. The automation name defaults to "Snowflake_" with a random, system-generated alphanumeric ID. Example: Snowflake_DGOF8v2.
Note:The automation details are set to default and you can modify them later in the automation page. These can be modified post-setup. The automation will run upon creation.
-
Select existing credentials from prior automations, which are stored in our Integrations module, or create new credentials.
Creating new credentials requires that you provide the following from your desired source:
-
Connection URL
CODEExample: jdbc:snowflake://1.1.1.1:443 -
User
-
Password
-
-
When finished, click the Create automation button. The automation will be executed and you will be navigated back to the Automations list screen.
Tip:If an error message is shown for automation failure, check your credentials.
-
Your automation is now running and ready to populate your data map. The next sync will occur one month from the creation date. For additional information on how to manage automation details post setup, see Data Mapping Discovery Automation Overview.