Header menu logo Nao

EvalCase Type

A single evaluation test case

Record fields

Record Field Description

Description

Full Usage: Description

Field type: string

Human-readable description

Field type: string

Expected

Full Usage: Expected

Field type: string option

Expected output or reference answer (used by some evaluators)

Field type: string option

Id

Full Usage: Id

Field type: string

Unique identifier for this case

Field type: string

Input

Full Usage: Input

Field type: string

The input to send to the agent

Field type: string

Metadata

Full Usage: Metadata

Field type: Map<string, string>

Additional metadata for evaluators

Field type: Map<string, string>

Tags

Full Usage: Tags

Field type: string list

Tags for categorization and filtering

Field type: string list

Type something to start searching.