Integration modes
AI Router
Route your LLM calls through Orq.ai with a single base URL change. Get access to 300+ models from 20+ providers, automatic fallbacks, load balancing, caching, and cost tracking, without changing your existing code.AI Router
Observability
Instrument your code with OpenTelemetry to get full visibility into your AI operations. Capture traces, logs, and metrics for every LLM call, agent step, and tool use across your entire application.OpenTelemetry
Frameworks
Agno
Python framework for building production-ready AI agents with structured workflows, tool integration, and multi-agent orchestration.AI Router OpenTelemetry
AWS Strands
AWS framework for building AI agents with structured reasoning and tool use, enhanced with complete observability and multi-provider access.
AI RouterOpenTelemetry
Azure AI Agents
Microsoft’s managed agent service built on the OpenAI Assistants API, with support for threads, tools, and multi-step reasoning.
AI RouterOpenTelemetry
BeeAI
IBM’s open-source framework for building production-ready multi-agent systems in Python with built-in observability.OpenTelemetry
AutoGen
Microsoft’s multi-agent conversational framework enabling collaborative problem-solving through automated agent interactions and customizable conversation patterns.
AI RouterOpenTelemetry
CrewAI
Framework for orchestrating multi-agent teams with role-based agents, hierarchical task management, and collaborative AI workflows.
AI RouterOpenTelemetry
DSPy
Framework for programmatic prompt optimization and modular language model workflows with systematic prompt engineering and automated optimization.
AI RouterOpenTelemetry
Google AI
Official Google AI framework providing access to Gemini models and other Google AI services with comprehensive Python SDK integration.
OpenTelemetry
Haystack
End-to-end open-source framework for building RAG and search applications with document retrieval, indexing, and LLM integration.
OpenTelemetry
Instructor
Library for structured outputs from language models using Pydantic models with type-safe validation and automatic parsing.
AI RouterOpenTelemetry
LangChain
Comprehensive framework for building LLM applications through composable chains, agents, and integrations with external data sources.
AI RouterOpenTelemetry
LiveKit
Real-time voice and multimodal AI agent framework built on WebRTC for production voice assistants and conversational AI.AI Router OpenTelemetry
LangGraph
Framework for building stateful, multi-actor AI applications with graph-based agent orchestration, cycles, and controllability.
AI RouterControl Tower
LiteLLM
LLM proxy with a unified interface for multiple providers, enabling easy model switching and provider abstraction. Route through Orq.ai to access 300+ models with full observability.
OpenTelemetry
LlamaIndex
Data framework for building context-augmented LLM applications with advanced indexing, retrieval, and orchestration capabilities.
AI RouterOpenTelemetry
LlamaIndex Agents
Agentic framework built on LlamaIndex for building LLM-powered agents with tool use, multi-step reasoning, and workflow orchestration.
AI Router
Mastra
TypeScript-first framework for building AI agents and workflows with structured tool integration and multi-step task automation.
AI RouterOpenTelemetry
OpenAI
Official OpenAI SDK providing direct access to GPT models, embeddings, and other OpenAI services with comprehensive API integration.
AI RouterOpenTelemetry
OpenAI Agents
Framework for building agents using OpenAI’s agent architecture with structured tools, code execution, and advanced reasoning capabilities.
AI RouterOpenTelemetryControl Tower
OpenClaw
Open-source personal AI assistant that runs locally, connecting LLMs to messaging platforms and system tools with OpenTelemetry support.
OpenTelemetry
Pydantic AI
Pydantic library for building with LLMs using structured validation and type-safe agent patterns with built-in observability.
AI RouterOpenTelemetry
Semantic Kernel
Microsoft’s SDK for integrating LLMs with conventional programming languages, featuring plugin architecture and enterprise-grade orchestration.
AI Router
SmolAgents
Hugging Face’s lightweight Python agent framework with AI Router support via OpenAIServerModel and native OpenTelemetry tracing via OpenInference instrumentation.AI Router OpenTelemetry
Vercel AI
JavaScript/TypeScript SDK for building AI-powered applications with streaming, tokens, and multi-model support.
AI RouterOpenTelemetryControl Tower