Header menu logo Nao

EvalSuiteDef Type

Parsed eval suite definition grouping test cases with an evaluator

Record fields

Record Field Description

Agent

Full Usage: Agent

Field type: string

Agent name to evaluate (resolved from workspace)

Field type: string

Cases

Full Usage: Cases

Field type: EvalCase list

Test cases to run against the agent

Field type: EvalCase list

Description

Full Usage: Description

Field type: string

Description of what this suite evaluates

Field type: string

Evaluator

Full Usage: Evaluator

Field type: EvaluatorRef

Evaluator configuration for scoring results

Field type: EvaluatorRef

Name

Full Usage: Name

Field type: string

Unique name for this evaluation suite

Field type: string

Type something to start searching.