Managing Models in AI Governance

A model inventory contains the learning frameworks used to build and manage an AI/ML application. It helps organizations identify whether a model is developed internally or sourced from a third party, understand its intended use and risk level, and maintain visibility into how many models are in production.

If you use the GenAI Component Intelligence for AI Models feature, see Creating and Managing AI Models for the library-based model creation flow.

About Responsible use metrics

There is no single, universally accepted metric for summarizing fairness as one overall score. Today, OneTrust collects Responsible use metrics and will continue to expand them over time to produce a Model Fairness report.



Field Metric
Description
Demographic parity difference

This measures the difference in outcomes between groups.

  • A score of 0 indicates perfect demographic parity, while higher scores indicate more disparity between groups.

  • A score of 0.15 suggests moderate disparity.

Demographic parity ratio

This is the ratio of outcomes between groups.

  • A ratio of 1 indicates perfect parity, while lower ratios indicate more disparity.

  • A ratio of 0.8 suggests moderate disparity.

Equalized odds difference

This measures the difference in false-positive and false-negative rates between groups.

  • A score of 0 is perfect, while higher scores indicate more unequal odds.

  • A score of 0.1 suggests a small level of unequal odds.

Equalized odds ratio

This is the ratio of false-positive and false-negative rates between groups.

  • A ratio of 1 is perfect, while lower ratios indicate more unequal odds.

  • A ratio of 0.7 indicates moderately unequal odds.

To create a model

  1. On the AI Governance menu, select Inventory > Models.

    The Models screen appears.

  2. Click the Add model button.

    The Add new model modal appears.

  3. Provide a unique name and choose the appropriate organization level. The Organization field defaults to the current level.

    Add new model - add details
  4. Select Add and review additional details to enter additional details and context for the model using the provided system attributes.
    Note:

    To learn how to add custom attributes so they appear in this modal as available fields, see Managing Attributes for AI Governance.

    The following are available system attributes

    Field
    Description
    Autonomy level

    Choose the degree to which the model can perform tasks without human intervention.

    Biases

    Enter any potential biases that may impact the model.

    Description

    Enter a short-hand description of the model's intended use.

    Framework

    Choose from the available framework options.

    Generative AI

    Choose whether the model is generative or not.

    Hosting provider

    Choose the cloud provider hosting the model from the available options.

    Internal or 3rd party

    Specify whether this model originates from either Self-Managed OSS, Third-Party Managed OSS, Self-Managed Proprietary, or Third-Party Managed Proprietary.

    Limitations

    Specify any limitations that might impact the model's operation.

    Model ID

    Enter the model ID.

    Model version

    Specify which operating version the model is running.

    Owner

    Choose from the available users at the organization level.

    Programming language

    Choose from the available programming options.

    Reference link

    Enter the link to the source of model metadata or external documentation.

    Task type

    Choose which task this model is intended to complete in your governance program.

    Type of learning

    Choose from the following: Supervised, Unsupervised, or Reinforcement.

  5. Click the Save button. The new model has been added to the Models list screen.
  6. The model record will be created using the assigned default workflow. To change the default option, see Creating & Managing AI Governance Workflows.

To manage model details

  1. On the AI Governance menu, select Inventory > Models. The Models screen appears.

    The Models screen appears.

  2. Select a model.

    The Inventory details screen appears with the Details tab open by default.

  3. In the Details tab, update the model's details as necessary.

    Inventory details screen - Details tab
  4. Click the Save button.

To manage a model workflow

  1. On the AI Governance menu, select Inventory > Models.

    The Models screen appears.

  2. Select a model.

    The Inventory details screen appears.

  3. Click the Next stage button to move the model to the next workflow stage.

    Inventory details - Next stage
  4. To revert workflow stage, click the desired stage.

    The Revert stage modal appears.

  5. Click the Continue button to revert the workflow. Optional: run rules and actions associated with this stage transition.

    Revert stage modal

To delete a model

  1. On the AI Governance menu, select Inventory > Models.

    The Models screen appears.

  2. In the model row, click the Context Menu icon.
  3. Select Delete.

    The Delete record modal appears.

  4. Click the Confirm button. The model will be removed.

    Delete record confirmation modal