Integration modes
AI Gateway
Route your LLM calls through Orq.ai with a single base URL change. Get access to 300+ models from 20+ providers, automatic fallbacks, load balancing, caching, and cost tracking, without changing your existing code.AI Gateway
Observability
Instrument your code with OpenTelemetry to get full visibility into your AI operations. Capture traces, logs, and metrics for every LLM call, agent step, and tool use across your entire application.OpenTelemetry
Frameworks
Agno
Python framework for building production-ready AI agents with structured workflows, tool integration, and multi-agent orchestration.AI Gateway OpenTelemetry
AutoGen
Microsoft’s multi-agent conversational framework enabling collaborative problem-solving through automated agent interactions and customizable conversation patterns.
AI GatewayOpenTelemetry
AWS Strands
AWS framework for building AI agents with structured reasoning and tool use, enhanced with complete observability and multi-provider access.
AI GatewayOpenTelemetry
AWS Bedrock AgentCore
AWS managed agent runtime for deploying any agent framework at scale. Route calls through the AI Gateway or invoke Orq Agents by key.
AI GatewayOpenTelemetry
Azure AI Agents
Microsoft’s managed agent service built on the OpenAI Assistants API, with support for threads, tools, and multi-step reasoning.
AI GatewayOpenTelemetry
BeeAI
IBM’s open-source framework for building production-ready multi-agent systems in Python with built-in observability.OpenTelemetry
Anthropic
Anthropic’s native SDK for the Claude Messages API, with text generation, streaming, and tool use.
AI Gateway
Claude Agent SDK
Anthropic’s SDK for building programmable Claude agents with multi-turn conversations, tool use, and MCP servers.
AI GatewayOpenTelemetry
CrewAI
Framework for orchestrating multi-agent teams with role-based agents, hierarchical task management, and collaborative AI workflows.
AI GatewayOpenTelemetry
DSPy
Framework for programmatic prompt optimization and modular language model workflows with systematic prompt engineering and automated optimization.
AI GatewayOpenTelemetry
Google AI
Official Google AI framework providing access to Gemini models and other Google AI services with comprehensive Python SDK integration.
OpenTelemetry
Haystack
End-to-end open-source framework for building RAG and search applications with document retrieval, indexing, and LLM integration.
OpenTelemetry
Instructor
Library for structured outputs from language models using Pydantic models with type-safe validation and automatic parsing.
AI GatewayOpenTelemetry
LangChain
Comprehensive framework for building LLM applications through composable chains, agents, and integrations with external data sources.
AI GatewayOpenTelemetry
LangGraph
Framework for building stateful, multi-actor AI applications with graph-based agent orchestration, cycles, and controllability.
AI GatewayControl Tower
LiteLLM
LLM proxy with a unified interface for multiple providers, enabling easy model switching and provider abstraction. Route through Orq.ai to access 300+ models with full observability.
OpenTelemetry
LiveKit
Real-time voice and multimodal AI agent framework built on WebRTC for production voice assistants and conversational AI.AI Gateway OpenTelemetry
LlamaIndex
Data framework for building context-augmented LLM applications with advanced indexing, retrieval, and orchestration capabilities.
AI GatewayOpenTelemetry
LlamaIndex Agents
Agentic framework built on LlamaIndex for building LLM-powered agents with tool use, multi-step reasoning, and workflow orchestration.
AI Gateway
Mastra
TypeScript-first framework for building AI agents and workflows with structured tool integration and multi-step task automation.
AI GatewayOpenTelemetry
OpenAI
Official OpenAI SDK providing direct access to GPT models, embeddings, and other OpenAI services with comprehensive API integration.
AI GatewayOpenTelemetry
OpenAI Agents
Framework for building agents using OpenAI’s agent architecture with structured tools, code execution, and advanced reasoning capabilities.
AI GatewayOpenTelemetryControl Tower
OpenClaw
Open-source personal AI assistant that runs locally, connecting LLMs to messaging platforms and system tools with OpenTelemetry support.
OpenTelemetry
Pydantic AI
Pydantic library for building with LLMs using structured validation and type-safe agent patterns with built-in observability.
AI GatewayOpenTelemetry
Semantic Kernel
Microsoft’s SDK for integrating LLMs with conventional programming languages, featuring plugin architecture and enterprise-grade orchestration.
AI Gateway
SmolAgents
Hugging Face’s lightweight Python agent framework with AI Gateway support via OpenAIServerModel and native OpenTelemetry tracing via OpenInference instrumentation.AI Gateway OpenTelemetry
Vercel AI
JavaScript/TypeScript SDK for building AI-powered applications with streaming, tokens, and multi-model support.
AI GatewayOpenTelemetryControl Tower