curl --request POST \
  --url https://api-prod.extend.app/v1/evaluation_sets \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "name": "<string>",
  "description": "<string>",
  "processorId": "<string>"
}'
{
  "success": true,
  "evaluationSet": {}
}

Evaluation sets are a collection of files and expected outputs that are used to evaluate the performance of a given processor in Extend. This endpoint will create a new evaluation set in Extend, which items can be added to using the Create Evaluation Set item endpoint.

Note: it is not necessary to create an evaluation set via API. You can also create an evaluation set via the Extend dashboard and take the ID from there:

Body

name
string
required

The name of the evaluation set.

description
string

A description of the evaluation set.

processorId
string
required

The ID of the processor to associate with this evaluation set. Evaluation sets can in theory be run against any processor, but it is required to associate the evaluation set with a primay processor.

Response

success
boolean

A true or false value for whether the evaluation set was created successfully or not.

evaluationSet
EvaluationSet

An EvaluationSet object representing the newly created evaluation set. See the EvaluationSet object for more details.