EvaluatorRef Type
Reference to an evaluator used in an eval suite
Record fields
| Record Field |
Description
|
Full Usage:
Criteria
Field type: string
|
Evaluation criteria description (for LLM judge)
|
Full Usage:
Keywords
Field type: string list
|
Required keywords for keyword-based evaluation
|
Full Usage:
Pattern
Field type: string
|
Regex pattern for pattern-based evaluation
|
Full Usage:
Scale
Field type: string
|
Score scale (e.g. "1-5", "pass/fail")
|
Full Usage:
Type
Field type: string
|
Evaluator type (e.g. "llm-judge", "pattern", "keyword")
|
Nao