Skip to main content
Add an AWS Bedrock integration to use Bedrock-compatible models in Arize.
By adding this integration, your data may be sent to AWS or hosted model providers for certain actions within Arize (e.g., prompt playground) and your account may be billed for usage.

Add the Integration Using the Arize Skills

Add an AWS Bedrock integration from your coding agent using the Arize Skills:

Create an AWS Bedrock integration named 'my-aws-bedrock' with my base URL https://bedrock-runtime.us-east-1.amazonaws.com and Bearer Token bedrock-api-key-YmVkcm9jay...

Add the Integration from Arize AX

Select AWS Bedrock from the Providers List

The AI Provider integrations tab

Fill Out Your Integration Details

The AI integration details tab
Give your integration a name. Then set your base URL. You then need to define the available model deployments. If you have all the default AWS models available then you can enable AWS default models. Otherwise add your model name as a custom model name.

Authentication Settings

Next you will need to select the authentication settings, either assume role, bearer token (API key), or custom headers.
Arize will assume the role you create to run InvokeModel commands against Bedrock models in your account. The following will create a least privilege role in your AWS account. It will also configure that role so that Arize can assume it.
  1. Copy the permissions policy in Arize:
    Copy the necessary permissions policy
  2. Create a permission policy in your AWS account:
    Create a new permissions policy
  3. Add the JSON from the Bedrock Integration form to your policy:
    Add permissions JSON
  4. Create a role with the Permissions policy you just created:
    Create a new IAM role
  5. Choose AWS account as the trusted entity type. If you set an external ID be sure to copy it and add it to the Bedrock integrations settings in Arize.
    Select AWS account as the trusted entity type
  6. Add the permissions policy you created above:
    Add the permissions policy you created above
  7. Create your role then go in to edit the trusted entities JSON:
    Edit the role you just created
  8. Navigate to the trust relationships tab for your new role. From there, copy the new role’s ARN and add it to the Bedrock integration settings in Arize:
    Navigate to the Trust Relationships tab and edit the policy
  9. Copy the trusted entities policy from the Bedrock integration settings in Arize:
    Copy the trusted entities policy from Arize
  10. Paste the trusted entities policy into the JSON editor:
    Add the trusted entities policy to your role

AWS Region

Set the appropriate AWS region in the prompt playground. This is stored locally in the browser after being set.

Advanced Settings

The AI integration details tab
Expand the Advanced Settings section to configure the following:
  • Supports Function Calling - Turn this on to allow the integration to use function calling features. This is on by default.
  • Authorized Orgs - Configure which organizations have access to this integration.
  • Authorized Spaces - Configure which spaces have access to this integration.

Add the Integration

Finally check the box to agree to the terms and conditions, then select the Add Integration button to create the integration.