added

Knowledge Bases & RAG

Start building even more reliable AI applications by equipping LLMs with accurate and relevant knowledge. This will greatly improve their knowledge and thus reduce the likelihood of hallucinations.

added

Webhooks

A much-requested feature, webhooks, is now added to the Orq.ai platform.

added

Contact analytics

To gain more insights and control over your LLM consumption, we added contact analytics.

added

Onboard private models on Azure

You can now add your own private and/or finetuned models to the Orq.ai model garden.

added

Debug more effectively

The Debug tab is back. Did your request fail, and do you want to look into the payload? Navigate towards the debug tab and find out what has been happening.

added

Provider_response added in the SDK

We did add the raw provider_response to our Python and Node SDK. This will give you the flexibility of retrieving model-specific output that we don't provide through our unified API.

added

GPT-4o mini

OpenAI has introduced GPT-4o mini, a smaller, more efficient, and cheaper model replacing GPT-3.5 Turbo. This follows similar moves by Anthropic (Claude 3 Haiku) and Google (Gemini 1.5 Flash).

improved

Human in the Loop

With the improved Human-in-the-loop feature, you have more control over your AI. You can collect feedback from your end users and have your domain experts annotate feedback and corrections on each log for future improvements.

added

Claude 3.5 Sonnet

Two hours after Claude 3.5 Sonnet was released, it became available on Orq.ai. Toggle it on in the model garden and try it out yourself!

added

Prompt library

The new Prompt library lets you create prompt templates that you can reuse throughout the whole platform.