curl --request POST \
  --url https://api-prod.extend.app/evaluation_set_items/bulk \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "evaluationSetId": "<string>",
  "items": [
    {}
  ]
}'
{
  "success": true,
  "evaluationSetItems": [
    {
      "object": "evaluation_set_item",
      "id": "eval_item_1234",
      "evaluationSetId": "eval_set_1234",
      "fileId": "file_1234",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    },
    {
      "object": "evaluation_set_item",
      "id": "eval_item_5678",
      "evaluationSetId": "eval_set_5678",
      "fileId": "file_5678",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    }
  ]
}

If you have a large number of files that you need to add to an evaluation set, you can use this endpoint to create multiple evaluation set items at once. This can be useful if you have a large dataset that you need to evaluate the performance of a processor against.

Note: you still need to create each File first using the file API.

Body

evaluationSetId
string
required

The ID of the evaluation set to add the items to.

items
array
required

An array of objects representing the evaluation set items to create. Each object should have the following fields:

Response

{
  "success": true,
  "evaluationSetItems": [
    {
      "object": "evaluation_set_item",
      "id": "eval_item_1234",
      "evaluationSetId": "eval_set_1234",
      "fileId": "file_1234",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    },
    {
      "object": "evaluation_set_item",
      "id": "eval_item_5678",
      "evaluationSetId": "eval_set_5678",
      "fileId": "file_5678",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    }
  ]
}