> ## Documentation Index
> Fetch the complete documentation index at: https://docs.orq.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Models | AI Gateway

> Browse available LLM models and enable them in your AI Gateway workspace. Filter by provider, capability, and pricing to find the right model.

## Enabling new Models

To see available Models and enable them for use, head to the **AI Gateway** section in **AI Studio** and open the **Models** page.

<Frame caption="The Models page showing available models with pricing, features, and metadata columns.">
  <img src="https://mintcdn.com/orqai/5MZJQ0bWgWcedZzS/images/models-410.png?fit=max&auto=format&n=5MZJQ0bWgWcedZzS&q=85&s=e802133ed2760ebab7a1cf8355a6fd3b" alt="Models page listing available LLM models with columns for name, input and output pricing, feature badges, release date, max output tokens, context length, and location." width="1745" height="1203" data-path="images/models-410.png" />
</Frame>

Each model displays its full name alongside a set of sortable columns:

* **Name**: full model name and provider
* **Input / Output pricing**: per-token cost for input and output
* **Features**: capability badges indicating support for ZDR, BYOK, and other model-specific features
* **Released**: the model's release date
* **Max Output Tokens**: maximum tokens the model can generate per response
* **Context Length**: total token window (input + output)
* **Location**: the region where the model is served

Use <kbd><Icon icon="arrow-up-arrow-down" /> Sort: Newest</kbd> to reorder by **Newest**, **Pricing** (low to high or high to low), **Context** (low to high or high to low), or **Max Output Tokens**. Use <kbd><Icon icon="table-columns" /> Columns</kbd> to show or hide individual columns.

<Check>
  Use the **Status Toggle** to **Enable** a model for use with the **AI Gateway**.
</Check>

### Filters

Use the modality tabs at the top of the list to scope models by type:

<kbd><Icon icon="table" /> All</kbd> <kbd><Icon icon="font" /> Text</kbd> <kbd><Icon icon="image" /> Image</kbd> <kbd><Icon icon="microphone" /> Audio</kbd> <kbd><Icon icon="wave-square" /> Speech</kbd> <kbd><Icon icon="hashtag" /> Embedding</kbd> <kbd><Icon icon="eye" /> Moderation</kbd> <kbd><Icon icon="arrow-up-arrow-down" /> Rerank</kbd>

The sidebar provides additional filters:

| Filter             | Description                                                                                                                                                                                                                |
| ------------------ | -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| **Location**       | Filter by region: Europe, United States, Global, APAC, Australia, Singapore                                                                                                                                                |
| **Access**         | Toggle [**Zero data retention**](/docs/enterprise/sovereign-ai#zero-data-retention) for ZDR-compliant providers, or [**BYOK**](/docs/ai-studio/ai-gateway/connect-providers) for providers where an API key has been added |
| **Providers**      | Filter by LLM provider. See [Providers](/docs/ai-studio/ai-gateway/connect-providers) to configure API keys                                                                                                                |
| **Status**         | Show Enabled or Disabled models                                                                                                                                                                                            |
| **Features**       | Filter by capability: Base64, Code Execution, Image Edit, JSON Mode, PDF, Reasoning, Streaming, Tool Calling, URL, Vision, Web Search                                                                                      |
| **Context length** | Drag the range slider to filter by context window size (512 to 2M tokens)                                                                                                                                                  |
| **Owner**          | Filter between Public (**Orq.ai**-provided) and Private (onboarded) models                                                                                                                                                 |

To enable a model, toggle it on. It will immediately be available to call with the **AI Gateway**.

## Onboarding Private Models

Onboard private models by choosing <kbd className="key"><Icon icon="circle-plus" color="#fff" /> Model</kbd> at the top-right of the screen. This is useful when hosting a fine-tuned model or any model deployed on a private provider such as **Azure AI Foundry** or **Vertex AI**.

### Private Models Providers

<Expandable title="Azure AI Foundry">
  From the [**Azure AI Foundry**](https://ai.azure.com/) project homepage, copy the **API key** and one of the two endpoints shown at the top. **Orq.ai** accepts the following endpoints:

  | Endpoint type         | Format                                                            | What it imports                                                             |
  | --------------------- | ----------------------------------------------------------------- | --------------------------------------------------------------------------- |
  | Azure OpenAI endpoint | `https://<resource>.openai.azure.com/openai/v1`                   | OpenAI-compatible deployments                                               |
  | Project endpoint      | `https://<resource>.services.ai.azure.com/api/projects/<project>` | All deployments from publishers in the project (Anthropic, Cohere, and xAI) |

  Paste the endpoint URL exactly as shown in **Azure AI Foundry**. **Orq.ai** does not append any path suffix.
  <Note>To learn more about the Azure AI Foundry deployment, see our [Provider Documentation](/docs/ai-studio/integrations/providers/azure).</Note>

  <Steps>
    <Step title="Open Add Model">
      In the **AI Gateway** sidebar, go to **Models**, then click <kbd className="key"><Icon icon="circle-plus" color="#fff" /> Model</kbd> at the top-right and select **Azure**.
    </Step>

    <Step title="Enter credentials">
      Enter the **Base URL** and **API Key**.

      <img src="https://mintcdn.com/orqai/HHjqh-MIdaNoL6vT/images/azure-foundry.png?fit=max&auto=format&n=HHjqh-MIdaNoL6vT&q=85&s=bbf504783c350cfae387383255b8ea45" alt="Azure AI Foundry credentials panel showing the API key, Project endpoint, and Azure OpenAI endpoint at the top of the project homepage." width="5018" height="2490" data-path="images/azure-foundry.png" />

      <img src="https://mintcdn.com/orqai/4YNqGRNpuZNyo0_T/images/azure-foundry-410.png?fit=max&auto=format&n=4YNqGRNpuZNyo0_T&q=85&s=33d255754e482b449b349772cb7386e2" alt="Azure private model configuration form showing endpoint URL and API Key fields." width="628" height="445" data-path="images/azure-foundry-410.png" />
    </Step>

    <Step title="Fetch deployments">
      Click **Fetch deployments** to automatically import all available deployments. The imported models appear in the **Models** list. Toggle each model **Enabled** before use. Enabled models are available in [Deployments](/docs/deployments/overview), [Agents](/docs/ai-studio/ai-engineering/build-agents), [Playground](/docs/playground/overview), and [Experiments](/docs/experiments/overview).
    </Step>
  </Steps>

  Reference imported models in code using `<workspacename>@azure/<modelname>` (see [Referencing Private Models in Code](#referencing-private-models-in-code)).
</Expandable>

<Expandable title="Vertex AI">
  In the **AI Gateway** sidebar, go to **Models**, then click <kbd className="key"><Icon icon="circle-plus" color="#fff" /> Model</kbd> at the top-right and select **Vertex AI**. Enter the JSON configuration from your Google Cloud project to make the model available on the platform.

  <img src="https://mintcdn.com/orqai/E8L3R46ivX7g9-QI/images/docs/c76d3d8163d2c08158ee0993dbb0c4f0b9c9bb5c6e7d8f3e376454242da9a198-Screenshot_2025-06-30_at_10.03.24.png?fit=max&auto=format&n=E8L3R46ivX7g9-QI&q=85&s=246e104299278460165221db715ac135" alt="Google Vertex AI model configuration form showing the JSON configuration input to add a private model." width="1518" height="1446" data-path="images/docs/c76d3d8163d2c08158ee0993dbb0c4f0b9c9bb5c6e7d8f3e376454242da9a198-Screenshot_2025-06-30_at_10.03.24.png" />

  For full Vertex AI setup instructions, see [Google Vertex AI](/docs/ai-studio/integrations/providers/vertex-ai).
</Expandable>

### Referencing Private Models in Code

When referencing private models through the SDKs, API, or [Supported Libraries](/docs/ai-studio/integrations/frameworks/overview), the model is referenced by the following string: `<workspacename>@<provider>/<modelname>`.

> Example: `corp@azure/gpt-4o-2024-05-13`

## Bring Your Own Key (BYOK)

To start using models, connect your provider API keys via [**BYOK**](/docs/ai-studio/ai-gateway/connect-providers) in the **AI Gateway** sidebar.
