Nao.Eval.Evaluators Namespace
| Type/Module | Description |
|
|
|
|
|
|
|
Evaluator that combines multiple evaluators with configurable logic |
|
|
|
|
|
Evaluator that checks if the output contains ALL of the specified keywords |
|
|
Evaluator that checks if the output contains ANY of the specified keywords |
|
|
Evaluator that checks if the output contains expected substrings |
|
|
|
|
|
Evaluator that checks for exact string match (case-insensitive by default) |
|
|
|
|
|
Configuration for the LLM-as-judge evaluator |
|
|
Evaluator that uses an LLM to judge agent output quality |
|
|
|
|
|
Evaluator that checks if the output matches a regular expression pattern |
|
|
Module for creating VerificationJudge evaluators |
|
|
Adapter: Wraps an IJudge (Verification layer) as an IEvaluator (Eval layer). This bridges the richer judgement system (criteria scores, suggestions) into the evaluation framework for dataset-level analysis and regression detection. |
Nao