Skip to main content

​
Evaluate experiment via UI

To run your first evaluation on experiments:
  1. Navigate to Evaluators on your experiment page and find Add Evaluator
  2. Define your Evaluator
  3. Choose the experiments you want to evaluate from the dropdown menu.
  4. View Experiments results
Need help writing a custom evaluator template? Use ✨Alyx to write one for you ✨

​
Evaluate experiment via Code

The full guide to experiment evaluators in code — inputs and outputs, EvaluationResult, LLM-as-a-judge and code evaluators, and running client.experiments.run() — lives on Run offline evals on experiments. Open the By Code tab there. For class-based evaluators and additional SDK patterns, see Advanced options for running evals on experiments via code.