Create a dataset

curl --request POST \
  --url https://api.arize.com/v2/datasets \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "name": "Math Questions Dataset",
  "space_id": "space_12345",
  "examples": [
    {
      "question": "What is 2 + 2?",
      "answer": "4",
      "topic": "arithmetic"
    },
    {
      "question": "What is the square root of 16?",
      "answer": "4",
      "topic": "geometry"
    },
    {
      "question": "If 3x = 12, what is x?",
      "answer": "4",
      "topic": "algebra"
    }
  ]
}
'

{
  "id": "RGF0YXNldDoxOmFCY0Q=",
  "created_at": "2024-01-01T12:00:00Z",
  "updated_at": "2024-01-02T12:00:00Z",
  "name": "Sample Dataset",
  "space_id": "U3BhY2U6MTphQmNE",
  "versions": [
    {
      "id": "RGF0YXNldFZlcnNpb246MTphQmNE",
      "name": "v1.0",
      "dataset_id": "RGF0YXNldDoxOmFCY0Q=",
      "created_at": "2024-01-01T12:00:00Z",
      "updated_at": "2024-01-02T12:00:00Z"
    },
    {
      "id": "RGF0YXNldFZlcnNpb246MjphQmNE",
      "name": "v1.1",
      "dataset_id": "RGF0YXNldDoxOmFCY0Q=",
      "created_at": "2024-02-01T12:00:00Z",
      "updated_at": "2024-02-02T12:00:00Z"
    }
  ]
}

Datasets

Create a dataset

Create a new dataset with JSON examples. Empty datasets are not allowed.

Payload Requirements

The dataset name must be unique within the given space.
Each item in examples[] may contain any user-defined fields.
Do not include system-managed fields on input: id, created_at, updated_at. Requests that contain these fields in any example will be rejected.
Each example must contain at least one property (i.e., {} is invalid).

Valid example (create)

{
  "name": "my-dataset",
  "space_id": "spc_123",
  "examples": [
    {
      "question": "What is 2+2?",
      "answer": "4",
      "topic": "math"
    },
    {
      "question": "What is the capital of Spain?",
      "answer": "Madrid",
      "topic": "geography"
    },
  ]
}

Invalid example (‘id’ not allowed on create)

{
  "name": "my-dataset",
  "space_id": "spc_123",
  "examples": [
    {
      "id": "ex_1",
      "input": "Hello"
    }
  ]
}

This endpoint is in beta, read more here.

POST

datasets

Create a dataset

curl --request POST \
  --url https://api.arize.com/v2/datasets \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "name": "Math Questions Dataset",
  "space_id": "space_12345",
  "examples": [
    {
      "question": "What is 2 + 2?",
      "answer": "4",
      "topic": "arithmetic"
    },
    {
      "question": "What is the square root of 16?",
      "answer": "4",
      "topic": "geometry"
    },
    {
      "question": "If 3x = 12, what is x?",
      "answer": "4",
      "topic": "algebra"
    }
  ]
}
'

{
  "id": "RGF0YXNldDoxOmFCY0Q=",
  "created_at": "2024-01-01T12:00:00Z",
  "updated_at": "2024-01-02T12:00:00Z",
  "name": "Sample Dataset",
  "space_id": "U3BhY2U6MTphQmNE",
  "versions": [
    {
      "id": "RGF0YXNldFZlcnNpb246MTphQmNE",
      "name": "v1.0",
      "dataset_id": "RGF0YXNldDoxOmFCY0Q=",
      "created_at": "2024-01-01T12:00:00Z",
      "updated_at": "2024-01-02T12:00:00Z"
    },
    {
      "id": "RGF0YXNldFZlcnNpb246MjphQmNE",
      "name": "v1.1",
      "dataset_id": "RGF0YXNldDoxOmFCY0Q=",
      "created_at": "2024-02-01T12:00:00Z",
      "updated_at": "2024-02-02T12:00:00Z"
    }
  ]
}

Authorizations

Authorization

string

header

required

Most Arize AI endpoints require authentication. For those endpoints that require authentication, include your API key in the request header using the format

Body

application/json

Body containing dataset creation parameters

name

string

required

Name of the new dataset

space_id

string

required

ID of the space the dataset will belong to

examples

object[]

required

Array of examples for the new dataset

Required array length: 1 - 1000 elements

Response

A dataset object

A dataset is a structured collection of examples used to test and evaluate LLM applications. Datasets allow you to test models consistently across any real-world scenarios and edge cases, quickly identify regressions, and track measurable improvements.

string

required

Unique identifier for the dataset

name

string

required

Name of the dataset

space_id

string

required

Unique identifier for the space this dataset belongs to

created_at

string<date-time>

required

Timestamp for when the dataset was created

updated_at

string<date-time>

required

Timestamp for the last update of the dataset

versions

object[]

List of versions associated with this dataset

Show child attributes

List datasets Get a dataset

⌘I