Skip to main content

Welcome to orq.ai

This page covers the fastest way to create an initial deployment and make a first LLM call through the platform.

Prerequisite

An account within the orq.ai Studio is required.
Sign Up Here to create an orq.ai Account.

Step 1: Setup an API Key with the available providers

To start using models, first add an API key with the chosen provider. To do so, open the Model Garden > Providers tab, select a provider, and choose Setup own API Key.
Screenshot2025 11 03at14 44 14 Pn

Choose from all our available providers and setup your API Key.

Screenshot 2025-11-03 at 14.11.53.png

Enter your API key details to setup your provider integration (here OpenAI)

To learn more about setting up Integrations, see API keys & Endpoints.

Step 2: Enable models in the Model Garden

Browse the Model Garden by going to the Model Garden tab. Here, find all models available to use within orq.ai, including their capabilities and a short description. To make any model available, toggle the button next to its name, it will then be usable in a first Deployment. To use custom API keys, head to the Integration tab.

Orq.ai offers a wide variety of models to use, you can also bring your own keys to setup connection with our supported providers

To learn more about all the models available, see Model Garden.

Step 3: Set up a first Deployment

To create a first deployment, head to the Deployment tab, then select Create Deployment.

Here, name the deployment and select the model previously activated in the model garden.

The Variant configuration screen will then appear. Here, select which parameters to use with the model and include the prompt(s) that will be sent to the language model.

Many features are available when configuring a Deployment. To learn more see the Model Parameters documentation.

Once ready, press the Deploy button at the top-right to save the latest configuration and make it available through the API.
There are many more features available to configure a Deployment. Including setting up multiple models, fallbacks, function calling, etc. To learn more, see Creating a Deployment.

Step 4: Install the orq.ai SDK

Within the Deployment page, open the code snippet panel to find instructions to install and run the SDK for the current deployment.

Select the code snippet button at the top-right. Instructions will open on the right side of the screen.

Then, proceed to install the chosen SDK. Execute the following in a terminal to download the latest version of the SDK on the machine.
npm install @orq-ai/node --save

Step 5: Get an API Token

An API key is needed to set up the client. This can be found within the Workspace Settings > API Keys menu.

Find your API keys in the Workspace Settings.

To learn more about API Authentication, see Authentication.

Step 6: Use the SDK to invoke a Deployment

Once the API Token has been saved for use, refer back to the code snippet accessed before the Deployment to fetch the code to initialize and invoke a deployment:
Don’t forget to replace <API_KEY> with the API key fetched previously.
import { Orq } from "@orq-ai/node";

const client = new Orq({
  apiKey: '<API_KEY>',
  environment: 'production',
});

const deployment = await client.deployments.invoke({
   key: "quickstart-deployment",
   context: {
      environments: []
   },
   metadata: {
      "custom-field-name": "custom-metadata-value"
   }
});
Congratulations, the first deployment invocation with orq.ai was successfully run. To learn more about deployments and all the possibilities they offer, see Creating a Deployment.

Step 7: Track projects and costs

Orq.ai displays metrics about active deployments

orq.ai allows tracking costs and projects grouped in Contacts. Use a Contact within any SDK before invoking a generation to log all usage within that contact.
Contacts can also be created using the SDK. See how with the Node SDK and Python SDK.
import { Orq } from "@orq-ai/node";

const client = new Orq({
  apiKey: '<API_KEY>',
  environment: 'production',
  contactId: '<contact-id>'
});

const deployment = await client.deployments.invoke({
   key: "quickstart-deployment",
   context: {
      environments: []
   },
   metadata: {
      "custom-field-name": "custom-metadata-value"
   }
});
To learn more about Contacts and the resulting Analytics, see Using Contact Metrics.