Databricks Connector

Overview

User for Data Discovery scanning, the Databricks Connector enables you to scan, discover, and manage Databricks assets with support for Unity Catalog.

Important:

The Databricks Connector is under Public Preview for customers with solution packaging only. Please contact your account representative or OneTrust Support to request early access.

Pod Residency

rdbms-scanner

Connection Method

JDBC Connection URL

Unity Catalog Support

  • If Unity Catalog is enabled: discover and scan all catalogs > schema > tables

  • If Unity Catalog is disabled: discover and scan all databases > schema > table for a given workspace

Supported Scan Actions

Scan Type

Description

Catalog

This scan type will only retrieve the metadata in the database like details of schema, table, or column.

Catalog & Scan

OneTrust scans both metadata and data under the tables and returns the appropriate labels.

Credential and System Permissions

OneTrust recommends to adhere to your organization's security and infrastructure policy and include system engineer resources or other qualified subject matter experts to set up credentials on data sources. For specific instructions for how to enable these credentials, refer to your data source's implementation documentation, knowledge base and/or support resources.

Sample JSON

JSON 
{
    "connectionUrl": "your_connection_url",
    "user": "your_user",
    "password": "your_password"
}

Feature

Non-Unity Catalog

Unity Catalog

Authentication Type

Personal Access Token (PAT)

Personal Access Token (PAT), OAuth tokens (Azure/AWS)

Granular Permissions

Limited to workspace-level permissions

Fine-grained permissions (catalog, schema, table level)

JDBC Connection

jdbc:spark://<databricks-host>:443/default

jdbc:spark://<databricks-host>:443/<catalog>.<schema>

Scan Profile Support

Note:

For additional details on scan profile configuration and management, see Setting Up Scan Profiles.

Limits

  • Maximum Number of Databases

  • Maximum Number of Schemas per Database

  • Maximum Number of Tables per Schema

  • Limitation method for scanning rows per table (Catalog & Scan type only)

    • First with Limit

    • Random Percentage

    • Random Percentage with Limit

Scan Options

  • Tables

  • Views

Include/Exclude Paths

Supports inclusion or exclusion by Database name, Schema name, Table name, or Column name (exclusion only).