Create Evaluation Set Item
Create a new evaluation set item for a given evaluation set.
Evaluation set items are the individual files and expected outputs that are used to evaluate the performance of a given processor in Extend. This endpoint will create a new evaluation set item in Extend, which will be used during an evaluation run.
Best Practices for Outputs in Evaluation Sets
- Configure First, Output Later
- Always create and finalize your processor configuration before creating evaluation sets
- Field IDs in outputs must match those defined in your processor configuration
- Type Consistency
- Ensure output types exactly match your processor configuration
- For example, if a field is configured as “currency”, don’t submit a simple number value
- Field IDs
- Use the exact field IDs from your processor configuration
- Create your own semantic IDs instead in the configs for each field/type instead of using the generated ones
- Value
- Remember that all results are inside the
valuekey of a result object, except the values within nested structures.
Body
The ID of the evaluation set to add the item to.
The ID of the file to add to the evaluation set.
The expected output of the processor when run against the file.
This should be a JSON object conforming to the output type schema of the processor.
Response
A true or false value for whether the evaluation set item was created successfully or not.
An EvaluationSetItem object representing the newly created evaluation set item. See the EvaluationSetItem object for more details.