> ## Documentation Index
> Fetch the complete documentation index at: https://docs.orq.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Framework integrations

> Integrate the AI Router with popular LLM frameworks. Connect Langchain, Vercel AI, DSPy, Instructor, and more for enhanced AI application development.

Integrate Orq.ai with your favorite LLM frameworks. Each framework supports one or more integration modes depending on its architecture.

## Integration modes

<CardGroup cols={2}>
  <Card title="AI Router" icon="arrow-right-arrow-left">
    Route your LLM calls through Orq.ai with a single base URL change. Get access to 300+ models from 20+ providers, automatic fallbacks, load balancing, caching, and cost tracking, without changing your existing code.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge>
  </Card>

  <Card title="Observability" icon="chart-line">
    Instrument your code with OpenTelemetry to get full visibility into your AI operations. Capture traces, logs, and metrics for every LLM call, agent step, and tool use across your entire application.

    <Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge>
  </Card>
</CardGroup>

## Frameworks

<CardGroup cols={3}>
  <Card title="Agno" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/agno.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=9dcc92464361356859188daa3ff632d8" href="/docs/proxy/frameworks/agno" width="16" height="16" data-path="images/logos/agno.svg">
    Python framework for building production-ready AI agents with structured workflows, tool integration, and multi-agent orchestration.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge>   <Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge>
  </Card>

  <Card title="AutoGen" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/autogen.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=5e069079c158a069018b897a560c503d" href="/docs/proxy/frameworks/autogen" width="96" height="85" data-path="images/logos/autogen.svg">
    Microsoft's multi-agent conversational framework enabling collaborative problem-solving through automated agent interactions and customizable conversation patterns.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="AWS Strands" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/aws-strands.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=71f0a05886178ded9cc684c8b984f9a2" href="/docs/proxy/frameworks/aws-strands" width="267" height="267" data-path="images/logos/aws-strands.svg">
    AWS framework for building AI agents with structured reasoning and tool use, enhanced with complete observability and multi-provider access.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="AWS Bedrock AgentCore" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/aws-bedrock.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=337148b1683d0d220bc53399fbbe3045" href="/docs/proxy/frameworks/bedrock-agentcore" width="1067" height="637" data-path="images/logos/aws-bedrock.svg">
    AWS managed agent runtime for deploying any agent framework at scale. Route calls through the AI Router or invoke Orq Agents by key.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="Azure AI Agents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/azure.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=aceb7fab6763d5b7ad595606503fe0a2" href="/docs/proxy/frameworks/azure-ai-agents" width="256" height="256" data-path="images/logos/azure.svg">
    Microsoft's managed agent service built on the OpenAI Assistants API, with support for threads, tools, and multi-step reasoning.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="BeeAI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/beeai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=308ae70195ad01a79ac7d0dbb954cb83" href="/docs/proxy/frameworks/beeai" width="16" height="16" data-path="images/logos/beeai.svg">
    IBM's open-source framework for building production-ready multi-agent systems in Python with built-in observability.

    <Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge>
  </Card>

  <Card title="Claude Agent SDK" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/anthropic.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b097662b141ad6f89f0c8d039ae241dc" href="/docs/proxy/frameworks/claude-agent-sdk" width="61" height="43" data-path="images/logos/anthropic.svg">
    Anthropic's SDK for building programmable Claude agents with multi-turn conversations, tool use, and MCP servers.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="Claude Agent SDK" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/anthropic.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b097662b141ad6f89f0c8d039ae241dc" href="/docs/proxy/frameworks/claude-agent-sdk" width="61" height="43" data-path="images/logos/anthropic.svg">
    Anthropic's SDK for building programmable Claude agents with multi-turn conversations, tool use, and MCP servers.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="CrewAI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/crewai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=f280c4bfff5236d05c508dafa38e5511" href="/docs/proxy/frameworks/crewai" width="24" height="24" data-path="images/logos/crewai.svg">
    Framework for orchestrating multi-agent teams with role-based agents, hierarchical task management, and collaborative AI workflows.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="DSPy" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/dspy.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=0750063495356ce07b666f260332b7bf" href="/docs/proxy/frameworks/dspy" width="16" height="16" data-path="images/logos/dspy.svg">
    Framework for programmatic prompt optimization and modular language model workflows with systematic prompt engineering and automated optimization.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="Google AI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/google.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=364f3b0b8bf8b8e5c57d1e57f5010324" href="/docs/proxy/frameworks/google-ai" width="48" height="48" data-path="images/logos/google.svg">
    Official Google AI framework providing access to Gemini models and other Google AI services with comprehensive Python SDK integration.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="Haystack" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/haystack.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=2f903000e60627aa5a29393a275f398a" href="/docs/proxy/frameworks/haystack" width="24" height="24" data-path="images/logos/haystack.svg">
    End-to-end open-source framework for building RAG and search applications with document retrieval, indexing, and LLM integration.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="Instructor" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/instructor.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=d3cab851f8cbf4f8ca439b51ef38535c" href="/docs/proxy/frameworks/instructor" width="267" height="267" data-path="images/logos/instructor.svg">
    Library for structured outputs from language models using Pydantic models with type-safe validation and automatic parsing.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="LangChain" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/langchain.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=42d74a1ebd9d2c20d42e21e02b4cb574" href="/docs/proxy/frameworks/langchain" width="24" height="24" data-path="images/logos/langchain.svg">
    Comprehensive framework for building LLM applications through composable chains, agents, and integrations with external data sources.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="LangGraph" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/langgraph.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=9af4b74f681cd7cc525c49260d572d24" href="/docs/proxy/frameworks/langgraph" width="24" height="24" data-path="images/logos/langgraph.svg">
    Framework for building stateful, multi-actor AI applications with graph-based agent orchestration, cycles, and controllability.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="green" shape="pill" size="sm" icon="tower-control" style={{backgroundColor: '#15803d', color: '#fff'}}>Control Tower</Badge></div>
  </Card>

  <Card title="LiteLLM" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/litellm.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b4a69d5743e3be791762dc3ad8e67a9e" href="/docs/proxy/frameworks/litellm" width="683" height="683" data-path="images/logos/litellm.svg">
    LLM proxy with a unified interface for multiple providers, enabling easy model switching and provider abstraction. Route through Orq.ai to access 300+ models with full observability.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="LiveKit" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/livekit.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b115d47ecdedd35b1c266359da589cf5" href="/docs/proxy/frameworks/livekit" width="24" height="24" data-path="images/logos/livekit.svg">
    Real-time voice and multimodal AI agent framework built on WebRTC for production voice assistants and conversational AI.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge>   <Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge>
  </Card>

  <Card title="LlamaIndex" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/llamaindex.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=3636c3ece510f40b84f9e77175964e15" href="/docs/proxy/frameworks/llamaindex" width="16" height="16" data-path="images/logos/llamaindex.svg">
    Data framework for building context-augmented LLM applications with advanced indexing, retrieval, and orchestration capabilities.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="LlamaIndex Agents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/llamaindex-agents.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=0bd960784645a2a3c0f4750363c1b1b8" href="/docs/proxy/frameworks/llama-agents" width="16" height="16" data-path="images/logos/llamaindex-agents.svg">
    Agentic framework built on LlamaIndex for building LLM-powered agents with tool use, multi-step reasoning, and workflow orchestration.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge></div>
  </Card>

  <Card title="Mastra" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/mastra.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=ed836981c75640a97be5170c2f041268" href="/docs/proxy/frameworks/mastra" width="683" height="683" data-path="images/logos/mastra.svg">
    TypeScript-first framework for building AI agents and workflows with structured tool integration and multi-step task automation.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="OpenAI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/openai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=41cb629a8b2739dc90fac2ddea651c17" href="/docs/proxy/frameworks/openai" width="395" height="400" data-path="images/logos/openai.svg">
    Official OpenAI SDK providing direct access to GPT models, embeddings, and other OpenAI services with comprehensive API integration.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="OpenAI Agents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/openai-agents.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b341e846f3ca07a1abf060fc9cb811fe" href="/docs/proxy/frameworks/openai-agents" width="256" height="260" data-path="images/logos/openai-agents.svg">
    Framework for building agents using OpenAI's agent architecture with structured tools, code execution, and advanced reasoning capabilities.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge><Badge color="green" shape="pill" size="sm" icon="tower-control" style={{backgroundColor: '#15803d', color: '#fff'}}>Control Tower</Badge></div>
  </Card>

  <Card title="OpenClaw" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/openclaw.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=4c526060f3484993b6c485695535b3c7" href="/docs/proxy/frameworks/openclaw" width="2359" height="484" data-path="images/logos/openclaw.svg">
    Open-source personal AI assistant that runs locally, connecting LLMs to messaging platforms and system tools with OpenTelemetry support.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="Pydantic AI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/pydantic-ai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b6e0adaff02da4c40e781386a5bd1a08" href="/docs/proxy/frameworks/pydantic-ai" width="16" height="16" data-path="images/logos/pydantic-ai.svg">
    Pydantic library for building with LLMs using structured validation and type-safe agent patterns with built-in observability.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge></div>
  </Card>

  <Card title="Semantic Kernel" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/semantic-kernel.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=64b369c0610b4f004eb99076718eb5a9" href="/docs/proxy/frameworks/semantic-kernel" width="683" height="683" data-path="images/logos/semantic-kernel.svg">
    Microsoft's SDK for integrating LLMs with conventional programming languages, featuring plugin architecture and enterprise-grade orchestration.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge></div>
  </Card>

  <Card title="SmolAgents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/smolagents.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=77b383d1fe8c173dc97d21cff472e6e3" href="/docs/proxy/frameworks/smolagents" width="200" height="200" data-path="images/logos/smolagents.svg">
    Hugging Face's lightweight Python agent framework with AI Router support via OpenAIServerModel and native OpenTelemetry tracing via OpenInference instrumentation.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge>   <Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge>
  </Card>

  <Card title="Vercel AI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/vercel-ai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=4b94aeb9c1e97041e63afb68f9a5655b" href="/docs/proxy/frameworks/vercel-ai" width="256" height="222" data-path="images/logos/vercel-ai.svg">
    JavaScript/TypeScript SDK for building AI-powered applications with streaming, tokens, and multi-model support.

    <div style={{marginTop: '12px', display: 'flex', flexWrap: 'wrap', gap: '8px'}}><Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Router</Badge><Badge color="purple" shape="pill" size="sm" icon="chart-line">OpenTelemetry</Badge><Badge color="green" shape="pill" size="sm" icon="tower-control" style={{backgroundColor: '#15803d', color: '#fff'}}>Control Tower</Badge></div>
  </Card>
</CardGroup>
