support-bot) that points at a real model
(Qwen/Qwen3-32B). Your code calls the alias. When you want a different model
behind it, you repoint the alias, and your next request already routes
there. No deploy, no config change, nothing to ship.
This is what makes an eval result actionable. An eval can
prove a cheaper model holds up on your traffic; without an alias, acting on that
means redeploying your application.
Create an alias
The Models page in the dashboard has an aliases manager (owner/admin): create, repoint, and delete aliases, and configure the quality gate in the same dialog. Or from the API:support-bot is yours alone. A name that
isn’t an alias is treated as a normal model id, so aliases never shadow the
catalog.
Repoint an alias
PUT is an upsert by name, so
CI can repoint idempotently without looking anything up first.
Cut over gradually with a canary
Send a share of traffic to a candidate while the rest stays on the incumbent:canary_percent: 0 to roll straight back. At 100 the cutover is complete and
you can make it the target.
The split is per request, not per user: a given caller may hit either model
on consecutive requests. Sticky routing would require a user identifier we
deliberately don’t collect.
See which model served
Every response tells you:Billing
You are always billed for the model that ran, at its normal rate. An alias is a routing decision, never a pricing one: it doesn’t add a fee, and it can’t disguise what a request cost.End-to-end example
Quality-gated canaries
A canary split can supervise itself: pick a calibrated judge (gate_criterion_id, a
criterion in the API) and the online scorer judges both arms of the live
split, promoting or rolling back on confidence-interval bounds. recommend
mode surfaces verdicts for you to act on; auto mode acts by itself, always
audited, and requires a judge at the calibrated tier (both TPR and TNR
≥ 90%): a weaker judge may recommend, but it cannot repoint traffic itself.
The whole gate is configurable in the alias dialog on the Models page,
judge, mode, minimum samples per arm, rollback threshold, and scoring window
not only via the API’s gate_* fields. Every active gate and its latest
verdict is on the Evals page’s Live switches tab. See
Online monitoring.
Rules and limits
- Owner/admin only to create, repoint, or delete: repointing silently redirects live production traffic, so it’s audited with the before/after.
- Every model in an alias is validated against the live catalog on save; a broken alias would fail every request that uses it.
- Deleting an alias makes requests using that name fail with “model not found”. It’s a real cutover step, not a cleanup.
- Aliases can’t point at dedicated endpoints; a routing key already is a specific deployment.