The EvaluationSetItem object

{
  "object": "evaluation_set_item",
  "id": "eval_item_1234",
  "evaluationSetId": "eval_set_1234",
  "fileId": "file_1234",
  "expectedOutput": {
    // Output object - see “Processor output types” for details
  },
  "createdAt": "2024-01-01T00:00:00Z",
  "updatedAt": "2024-01-01T00:00:00Z"
}

The EvaluationSetItem object represents an item in an evaluation set in Extend. Items are the individual files and expected outputs that are used to evaluate the performance of a given processor in Extend.

object

string

The type of the object, in this case it will always be “evaluation_set_item”.

string

The evaluation set item ID.

evaluationSetId

string

The ID of the evaluation set that this item belongs to.

fileId

string

The ID of the file associated with this item.

expectedOutput

object

The expected output of the processor when run against the file.

This should be a JSON object conforming to the output type schema of the processor.

createdAt

string

The date and time the evaluation set item was created.

updatedAt

string

The date and time the evaluation set item was last updated.

{
  "object": "evaluation_set_item",
  "id": "eval_item_1234",
  "evaluationSetId": "eval_set_1234",
  "fileId": "file_1234",
  "expectedOutput": {
    // Output object - see “Processor output types” for details
  },
  "createdAt": "2024-01-01T00:00:00Z",
  "updatedAt": "2024-01-01T00:00:00Z"
}

The EvaluationSet object The File object

{
  "object": "evaluation_set_item",
  "id": "eval_item_1234",
  "evaluationSetId": "eval_set_1234",
  "fileId": "file_1234",
  "expectedOutput": {
    // Output object - see “Processor output types” for details
  },
  "createdAt": "2024-01-01T00:00:00Z",
  "updatedAt": "2024-01-01T00:00:00Z"
}

API Documentation

Workflow Endpoints

Processor Endpoints

Parse Endpoints

File Endpoints

Evaluation Set Endpoints

Objects

Guides

Webhooks

The EvaluationSetItem object