OpenAI - Deployments
In this guide, we will show you how key management works in orq.ai and how you can integrate your OpenAI API keys from your LLM providers once you go into production with the use case.
For Dev and Test purposes, you can use orq.ai keys, and the cost will be charged back to you. But for Production workloads, we highly recommend using your own API keys. Using your API key gives you full control over your rate limits, and orq.ai can orchestrate it for you.
How to retrieve your API keys
To retrieve your API keys from OpenAI, there are a few steps to follow:
- Sign up for an OpenAI account.
- Log in to your OpenAI account and access the OpenAI dashboard.
- Navigate to the API keys section, create or select an API key.
Integrate API key into orq.ai
Navigate to the Integrations page, and on the OpenAI card, click on the view integration button.
Set up your API key by adding:
- Name.
- Your OpenAI API key.
- Organization ID (optional); you can find it here.
Once you are done, click on the save changes button, and your API keys will be saved. You can edit or delete an old API key and also add a new API key.
From the OpenAI overview environment, you will be able to see your rate limits and the billing that will be reported in your OpenAI invoice.
Use your own OpenAI API keys throughout orq.ai
From now on, orq.ai will use your API key in Playgrounds, Experiments, and Deployments when doing calls to OpenAI.
Using orq.ai as Configuration Manager
If you want to use all the superpowers orq.ai gives you but stay in full control of your actual LLM call, you can use orq.ai as a Configuration Manager. Continue reading: OpenAI - Prompt Management
Updated 2 days ago