Google Cloud Storage Connector

Overview

Pod Residency

storage-scanner

Category

Data Lake

Connection Method

Service Account

Kafka Partition Names

  • datadiscovery-scanner-gcs-job

  • datadiscovery-scanner-gcs-job-extractor

  • datadiscovery-scanner-gcs-job-tasks

Supported Scan Actions

Scan Type

Description

Catalog

This will retrieve the list of folders and files on the server

Catalog & Scan

This catalogs a list of all files and streams them to the worker node for classification.

Credential & System Permissions

Important:

OneTrust recommends to adhere to your organization's security and infrastructure policy and include system engineer resources or other qualified subject matter experts to set up credentials on data sources. For specific instructions for how to enable these credentials, refer to your data source's implementation documentation, knowledge base and/or support resources.

OneTrust supports scanning across projects granted access in service credential scope. A service account should have a role with the specified permissions:

  • resourcemanager.folders.get

  • resourcemanager.folders.list

  • resourcemanager.organizations.get

  • resourcemanager.projects.get

  • resourcemanger.projects.list

  • storage.buckets.getIamPolicy

  • storage.buckets.list

  • storage.objects.get

  • storage.objects.getIamPolicy

  • storage.objects.list

Collected Objects and Fields

For folder and file:

  • Name

  • Modified Date

  • Size on Disk (Files only)

  • Content Type

  • Parent Object

  • Path

  • Shared Access

Scan Profile Support

Note:

For additional details on scan profile configuration and management, see Setting Up Scan Profiles.

Limits

  • Maximum number of projects

  • Maximum number of buckets

  • Maximum files per bucket

  • Maximum files per scan