Observability Usage of AI Governance Agents & Models

As organizations scale AI use cases, governance teams need a “single pane of glass” to monitor risk, performance, and compliance across AI assets. OneTrust allows customers to bring in information on model-evaluation metrics, guardrails, usage, and other decision-critical data.

AI Usage can be tracked at an AI Agent or Model level. A single AI-agent invocation can result in multiple models being invoked, and these metrics help to understand trends and establish a baseline over a period. 

These metrics can also help provide a high-level overview of token consumption to help understand usage versus spend trends. Calculation of absolute cost (in $ or other currencies) incurred through AI systems is not available or intended.

Three critical data signals that are available to take advantage of are:

1. Invocation count (usage): Tracks the number of times a specific model or agent was invoked. 

2. Input token count: Tracks the number of tokens sent to a model.

3. Output token count: Tracks the number of output tokens generated by the foundation model(s).

Prerequisites

• You have access to OneTrust AI Governance with permissions to configure AI Automation. To deploy a lightweight worker node, follow the steps here. 

• Ensure the inventory of agents and models is imported through the AI automations.

• To collect observability metrics from Amazon Bedrock & AgentCore agents, each agent's IAM execution role must have the cloudwatch:PutMetricData permission.

Supported Platforms

Observability metric support varies by platform and by AI entity type.

Platform	AI entity	Metrics available
Amazon Bedrock & AgentCore	Agents and models	Invocation count, input token count, output token count
Azure Foundry	Agents and models	Invocation count, input token count, output token count
Databricks	Agents and models	Invocation count, input token count, output token count
Google Vertex (now Gemini Enterprise Agent Platform)	Agents	Invocation count

To verify agent or model usage metrics, deploy the lightweight worker node through AI automations and ensure the inventory of agents and models is being imported through the AI automations. There are no additional configurations required. 

Once the feature is working in OneTrust AI Governance, observability metrics are surfaced directly on the agent or model record on the Details tab under Observability > Usage summary, allowing users to:

• Review the usage summary aggregated for the last 24 hours. 

• Correlate usage summary to evaluate the successful adoption of specific AI projects.

Known Limitations

• Usage data is aggregated to 24-hour windows since the last sync, and larger time windows are not currently supported.  

• The absolute cost incurred in monetary value (in $) is not provided or collected.

Note:

For model evaluation metrics, refer to AI Governance Model Evaluation Metrics.

To monitor and enforce thresholds for metrics reported, it is highly encouraged to set up custom policies and track individual metrics or a group of metrics against an organizationally defined threshold. A breach in these thresholds results in policy violations and allows deviations in a large agent inventory to surface.

For more information on creating custom policies, see AI Policies Feature Guide.