Skip to main content
GET
Get an eval run

Authorizations

Authorization
string
header
required

Your workspace API key, e.g. sk_sovereign_..., sent as Authorization: Bearer <key>.

Path Parameters

id
string
required

Response

The run.

id
string
name
string
rubric
string

What "good" means, in plain English. The judge scores against this.

rubric_type
enum<string>
Available options:
direct,
adherence
eval_kind
enum<string>

comparison: pairwise judging against the baseline. criterion: a saved judge grades each model pass/fail.

Available options:
comparison,
criterion
criterion_snapshot
object | null

Criterion runs only: the judge frozen at creation (name, prompt, and its TPR/TNR/kappa at that moment), so the run's corrected rates stay reproducible after the judge changes.

baseline_model
string
candidate_models
string[]
judge_model
string
sample_count
integer
gen_max_output_tokens
integer

Per-answer generation cap the run was created with (see max_output_tokens on create).

sample_filters
object

Where the prompts came from: tag, model, segment, dataset_id, trace_replay, and screening (set on screening runs). Echoes what the run was created with.

status
enum<string>
Available options:
PENDING,
RUNNING,
DONE,
ERROR,
CANCELLED
error
string | null
assertions
array | null

The deterministic assertion configs the run was created with, when any.

progress_ratio
number

0–1. Completed inference calls over total.

results
object | null

Present when status is DONE. Comparison runs: sample_count, clipped_samples, baseline {model, stored_answers, truncated, avg_latency_ms, eval_cost_micros}, per_candidate [{model, win_rate, wins, ties, losses, ci95, failed, attempted, unreportable, truncated, avg_latency_ms, eval_cost_micros, savings_pct, replay?}], judge_cost_micros, and screening (screening runs only: incumbent, token_shape, per_candidate similarity + estimated cost placement, recommendation). Criterion runs: per_model [{model, observed_pass_rate, observed_ci, corrected_pass_rate, corrected_ci, ...}] using the frozen judge's measured error rates. Assertion runs add assertion_results.

created_at
string<date-time>