> ## Documentation Index
> Fetch the complete documentation index at: https://docs.orq.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# OpenAI-compatible models

> Connect any OpenAI-compatible endpoint to Orq.ai's AI Router. Configure custom base URLs for self-hosted or private LLM providers with observability.

## **Configuring Private OpenAI-Compatible Models**

Private OpenAI-compatible models allow you to connect and manage your own OpenAI-like endpoints directly from the **AI Router**.\
This enables full flexibility to integrate models from providers such as **Groq**, **Together AI**, **Mistral**, or any custom OpenAI-compatible deployment, all with workspace-level isolation and ownership.

Once configured, these models are available throughout Orq.ai and can be used seamlessly within **Deployments**, **Experiments**, and the **AI Router**.

### **Supported Capabilities**

Private OpenAI-compatible models fully support the same capabilities as standard OpenAI models, including:

* **Chat completion** with function calling and structured outputs.
* **Embedding** generation for vector search and semantic retrieval.
* **Image** generation endpoints (DALL-E compatible).
* **Completion** (legacy models and instruction tuning).
* **Vision** capabilities when supported by the provider.

## **Adding a Private OpenAI-Compatible Model**

To create a private model, head to the **AI Router** in the [orq.ai](http://orq.ai) Studio and select \*\*Add Model → OpenAI \*\*.

<Frame caption="Choose OpenAI Compatible">
  <img src="https://mintcdn.com/orqai/CtRyA8Jn1D8yn0E5/images/add-model-openai-compatible.png?fit=max&auto=format&n=CtRyA8Jn1D8yn0E5&q=85&s=612a63854e6d0876ed922666d67c0d8d" alt="Add Model Openai Compatible" width="412" height="325" data-path="images/add-model-openai-compatible.png" />
</Frame>

\
You'll see a configuration form where you can define all connection details for your model.

<Frame caption="OpenAI Compatible Models configuration screen">
  <img src="https://mintcdn.com/orqai/y-oiaAggvg-y1TdJ/images/openai-compatible-configuration.png?fit=max&auto=format&n=y-oiaAggvg-y1TdJ&q=85&s=ef5397bbf705066d602260a586be9a90" alt="OpenAI Compatible Configuration Modal" width="694" height="1246" data-path="images/openai-compatible-configuration.png" />
</Frame>

### **Connection Settings**

| Field        | Description                                                                                                                              |
| :----------- | :--------------------------------------------------------------------------------------------------------------------------------------- |
| **Type**     | Select the type of model to connect: **Chat Completion**, **Completion**, **Embedding**, or **Image**.                                   |
| **Base URL** | Enter the base API URL of your OpenAI-compatible endpoint. For example: `https://api.groq.com/openai/v1` or `https://api.openai.com/v1`. |
| **API Key**  | Your authentication key for the service. This will be stored securely and used for all subsequent requests.                              |

### **General Settings**

| Field           | Description                                                                                                          |
| :-------------- | :------------------------------------------------------------------------------------------------------------------- |
| **Model Name**  | The name that will appear in the **AI Router** and across [orq.ai](http://orq.ai). Example: `Custom Groq Llama 3.3`. |
| **Model ID**    | The model identifier as defined by your provider. Example: `llama-3.3-70b-versatile` or `gpt-4o-mini`.               |
| **Region**      | Select the deployment region for your model, such as *United States* or *Europe*.                                    |
| **Description** | (Optional) Add a short note about what this model is used for.                                                       |

### **Advanced Configuration**

| Field                            | Description                                                         |
| :------------------------------- | :------------------------------------------------------------------ |
| **Max Tokens**                   | Maximum token limit for model outputs.                              |
| **Temperature**                  | Controls randomness in the model output.                            |
| **Input Price (per 1M tokens)**  | Define the cost per million input tokens for billing and analytics. |
| **Output Price (per 1M tokens)** | Define the cost per million output tokens.                          |

## **Saving and Validating Your Configuration**

After filling in the configuration form, click **Add Model**.\
[orq.ai](http://orq.ai) automatically validates your setup by:

* Checking endpoint connectivity.
* Verifying your API key and authentication.
* Testing supported model capabilities.

Once validated, your model will appear in the **AI Router** under the "Private Models" section and can be used immediately in:

* [**Deployments**](/docs/deployments/overview)
* [**Experiments**](/docs/experiments/overview)
* [**AI Router**](/docs/router/using-the-router) calls