Skip to main content

​
Configuring Private OpenAI-Compatible Models

Private OpenAI-compatible models allow you to connect and manage your own OpenAI-like endpoints directly from the AI Gateway.
This enables full flexibility to integrate models from providers such as Groq, Together AI, Mistral, or any custom OpenAI-compatible deployment, all with workspace-level isolation and ownership. Once configured, these models are available throughout Orq.ai and can be used seamlessly within Deployments, Experiments, and the AI Gateway.

​
Supported Capabilities

Private OpenAI-compatible models fully support the same capabilities as standard OpenAI models, including:
  • Chat completion with function calling and structured outputs.
  • Embedding generation for vector search and semantic retrieval.
  • Image generation endpoints (DALL-E compatible).
  • Completion (legacy models and instruction tuning).
  • Vision capabilities when supported by the provider.

​
Adding a Private OpenAI-Compatible Model

To create a private model, head to the AI Gateway in the orq.ai Studio and select **Add Model → OpenAI **.
Add Model Openai Compatible

Choose OpenAI Compatible


You’ll see a configuration form where you can define all connection details for your model.
OpenAI Compatible Configuration Modal

OpenAI Compatible Models configuration screen

​
Connection Settings

​
General Settings

​
Advanced Configuration

​
Saving and Validating Your Configuration

After filling in the configuration form, click Add Model.
orq.ai automatically validates your setup by:
  • Checking endpoint connectivity.
  • Verifying your API key and authentication.
  • Testing supported model capabilities.
Once validated, your model will appear in the AI Gateway under the “Private Models” section and can be used immediately in: