Overview

Evaluations is Configuration → Evaluations. Clicking Evaluations opens /evaluations, which redirects to /evaluations/settings (page title: Evaluation Engine). Evaluator types live at /evaluations/types.

You must configure a judge Provider, Model, and Vault API key before Auto Evaluation or Run Evaluation on a trace will work.

Evaluation Engine

Provider, model, Vault key, and Auto Evaluation schedule (`/evaluations/settings`)

→

Evaluators

Built-in and custom types (`/evaluations/types`)

→

LLM-as-a-Judge

Run scoring from a trace

→

Programmatic evals

SDK / CI offline evaluation

→

Manual Feedback

Good / Bad / Neutral ratings

→

/settings/evaluation also redirects to /evaluations/settings. There is no /evaluations?tab= UI and no Evaluations Analytics dashboard. Results appear on the trace Evaluations panel and in type detail.

evaluate_rule exists on the SDK for rule matching. It is not a Platform sidebar item.