router.hiebel.ai
nvidia nemo switchyard · live routing demo

One endpoint, three models. Every request goes to a judge model that estimates whether a cheap model can handle it — easy work stays on a 3B local model, harder work runs on a 35B local model, and only genuinely hard requests escalate to Claude Opus. Below is a real recorded run: each card shows the question, the router's decision, and which model actually answered.

The pipeline

Client
Any OpenAI-compatible app
talks to one endpoint, one "model"
Judge
qwen3:8b · local
reads the prompt, scores "can the small model solve this?"
Answer tier
llama3.2:3b · local qwen3.5:35b · local claude-opus-4.8 · api

Recorded run — 9 questions

Where the work landed