Header menu logo Nao

EvaluatorRef Type

Reference to an evaluator used in an eval suite

Record fields

Record Field Description

Criteria

Full Usage: Criteria

Field type: string

Evaluation criteria description (for LLM judge)

Field type: string

Keywords

Full Usage: Keywords

Field type: string list

Required keywords for keyword-based evaluation

Field type: string list

Pattern

Full Usage: Pattern

Field type: string

Regex pattern for pattern-based evaluation

Field type: string

Scale

Full Usage: Scale

Field type: string

Score scale (e.g. "1-5", "pass/fail")

Field type: string

Type

Full Usage: Type

Field type: string

Evaluator type (e.g. "llm-judge", "pattern", "keyword")

Field type: string

Type something to start searching.