- Create a dataset of adversarial prompts.
- Run an experiment that sends each prompt to your AI agent.
- Score each response with an evaluator.
- Send failing responses to a labeling queue for review.
Advanced Workflows
LLM Red Teaming
Test an AI agent with adversarial prompts using datasets, experiments, evaluators, and labeling queues.
Red teaming sends adversarial prompts, such as jailbreak attempts and prompt injections, to your AI agent so you find the responses that go along with them before a user does. In Arize AX you run it with the same datasets, experiments, evaluators, and labeling queues you use for any other test, so the prompt set stays versioned and you can rerun it after every change to the agent.
Was this page helpful?