Knowledge Bases & RAG
Start building even more reliable AI applications by equipping LLMs with accurate and relevant knowledge. This will greatly improve their knowledge and thus reduce the likelihood of hallucinations.
Webhooks
A much-requested feature, webhooks, is now added to the Orq.ai platform.
Contact analytics
To gain more insights and control over your LLM consumption, we added contact analytics.
Onboard private models on Azure
You can now add your own private and/or finetuned models to the Orq.ai model garden.
Debug more effectively
The Debug tab is back. Did your request fail, and do you want to look into the payload? Navigate towards the debug tab and find out what has been happening.
Provider_response added in the SDK
We did add the raw provider_response
to our Python and Node SDK. This will give you the flexibility of retrieving model-specific output that we don't provide through our unified API.
GPT-4o mini
OpenAI has introduced GPT-4o mini, a smaller, more efficient, and cheaper model replacing GPT-3.5 Turbo. This follows similar moves by Anthropic (Claude 3 Haiku) and Google (Gemini 1.5 Flash).
Human in the Loop
With the improved Human-in-the-loop feature, you have more control over your AI. You can collect feedback from your end users and have your domain experts annotate feedback and corrections on each log for future improvements.
Claude 3.5 Sonnet
Two hours after Claude 3.5 Sonnet was released, it became available on Orq.ai. Toggle it on in the model garden and try it out yourself!
Prompt library
The new Prompt library lets you create prompt templates that you can reuse throughout the whole platform.