Skip to main content
Not every request needs your most expensive model. The Auto Router automatically routes each request to the optimal model based on your chosen profile, so you can reduce costs without sacrificing the quality that matters. You configure a Strong Model and an Economical Model, then choose how aggressively to route between them. The Auto Router evaluates each incoming request and sends it to whichever model best matches the task complexity and your optimization goal. Two directions are supported:
  • Optimize for cost: set a high-quality model as your baseline. The Auto Router routes simpler requests to the cheaper model and escalates only when complexity warrants it. You save on the requests that don’t need your most powerful model.
  • Optimize for quality: start with a cost-efficient model and let the Auto Router escalate to the more capable model only when the task demands it. Get the best output for every request without overspending.

​
Use Cases

​
How It Works

The Auto Router sits between your application and two models you configure: a Strong Model for complex requests and an Economical Model for simpler ones. When a request comes in, it analyzes the task complexity and routes it to the appropriate model based on your profile.

​
Set Up the Auto Router

  1. Navigate to the AI Gateway section in AI Studio and open the Models page.
  2. Click Add Model.
  3. Select Auto Router from the dropdown.
  4. Fill in the configuration:
    • Model ID: a unique identifier for this router (lowercase letters, numbers, and hyphens only).
    • Strong Model: the more capable model, used for complex requests.
    • Economical Model: the cheaper model, used for simpler requests.
    • Profile: choose how aggressively to route between the two models.
  5. Click Add model.
Auto Router configuration

Auto Router configuration form.

​
Profiles

These pairs combine high routing accuracy with significant cost ratios (over 10x), making them effective starting points.
Models from the same family or tier work well together (e.g. Claude Sonnet and Gemini Flash). Very large capability gaps reduce the effectiveness of routing.
You can combine models from different providers in a single Auto Router configuration.

​
Use the Auto Router

Once created, the Auto Router appears in your AI Gateway and can be selected anywhere a model is accepted: Deployments, Agents, Playground, and Experiments.

​
Reference in code

When using an Auto Router through the SDKs, API, or Supported Libraries, reference it by the string <workspacename>@orq/<model-id>.
Example: acme@orq/my-auto-router