> ## Documentation Index
> Fetch the complete documentation index at: https://docs.orq.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Framework integrations

> Integrate the AI Gateway with popular LLM frameworks. Connect Langchain, Vercel AI, DSPy, Instructor, and more for enhanced AI application development.

Integrate Orq.ai with your favorite LLM frameworks. Route your LLM calls through the AI Gateway with a single base URL change to get access to 300+ models from 20+ providers, automatic fallbacks, load balancing, caching, and cost tracking.

## Frameworks

<CardGroup cols={3}>
  <Card title="Agno" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/agno.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=9dcc92464361356859188daa3ff632d8" href="/docs/ai-gateway/integrations/frameworks/agno" width="16" height="16" data-path="images/logos/agno.svg">
    Python framework for building production-ready AI agents with structured workflows, tool integration, and multi-agent orchestration.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="AutoGen" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/autogen.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=5e069079c158a069018b897a560c503d" href="/docs/ai-gateway/integrations/frameworks/autogen" width="96" height="85" data-path="images/logos/autogen.svg">
    Microsoft's multi-agent conversational framework enabling collaborative problem-solving through automated agent interactions and customizable conversation patterns.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="AWS Strands" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/aws-strands.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=71f0a05886178ded9cc684c8b984f9a2" href="/docs/ai-gateway/integrations/frameworks/aws-strands" width="267" height="267" data-path="images/logos/aws-strands.svg">
    AWS framework for building AI agents with structured reasoning and tool use, enhanced with multi-provider access.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="AWS Bedrock AgentCore" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/aws-bedrock.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=337148b1683d0d220bc53399fbbe3045" href="/docs/ai-gateway/integrations/frameworks/bedrock-agentcore" width="1067" height="637" data-path="images/logos/aws-bedrock.svg">
    AWS managed agent runtime for deploying any agent framework at scale. Route calls through the AI Gateway or invoke Orq Agents by key.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Azure AI Agents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/azure.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=aceb7fab6763d5b7ad595606503fe0a2" href="/docs/ai-gateway/integrations/frameworks/azure-ai-agents" width="256" height="256" data-path="images/logos/azure.svg">
    Microsoft's managed agent service built on the OpenAI Assistants API, with support for threads, tools, and multi-step reasoning.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Anthropic" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/anthropic.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b097662b141ad6f89f0c8d039ae241dc" href="/docs/ai-gateway/integrations/frameworks/anthropic" width="61" height="43" data-path="images/logos/anthropic.svg">
    Anthropic's native SDK for the Claude Messages API, with text generation, streaming, and tool use.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Claude Agent SDK" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/anthropic.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b097662b141ad6f89f0c8d039ae241dc" href="/docs/ai-gateway/integrations/frameworks/claude-agent-sdk" width="61" height="43" data-path="images/logos/anthropic.svg">
    Anthropic's SDK for building programmable Claude agents with multi-turn conversations, tool use, and MCP servers.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="CrewAI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/crewai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=f280c4bfff5236d05c508dafa38e5511" href="/docs/ai-gateway/integrations/frameworks/crewai" width="24" height="24" data-path="images/logos/crewai.svg">
    Framework for orchestrating multi-agent teams with role-based agents, hierarchical task management, and collaborative AI workflows.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="DSPy" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/dspy.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=0750063495356ce07b666f260332b7bf" href="/docs/ai-gateway/integrations/frameworks/dspy" width="16" height="16" data-path="images/logos/dspy.svg">
    Framework for programmatic prompt optimization and modular language model workflows with systematic prompt engineering and automated optimization.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Instructor" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/instructor.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=d3cab851f8cbf4f8ca439b51ef38535c" href="/docs/ai-gateway/integrations/frameworks/instructor" width="267" height="267" data-path="images/logos/instructor.svg">
    Library for structured outputs from language models using Pydantic models with type-safe validation and automatic parsing.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="LangChain" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/langchain.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=42d74a1ebd9d2c20d42e21e02b4cb574" href="/docs/ai-gateway/integrations/frameworks/langchain" width="24" height="24" data-path="images/logos/langchain.svg">
    Comprehensive framework for building LLM applications through composable chains, agents, and integrations with external data sources.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="LangGraph" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/langgraph.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=9af4b74f681cd7cc525c49260d572d24" href="/docs/ai-gateway/integrations/frameworks/langgraph" width="24" height="24" data-path="images/logos/langgraph.svg">
    Framework for building stateful, multi-actor AI applications with graph-based agent orchestration, cycles, and controllability.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="LiveKit" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/livekit.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b115d47ecdedd35b1c266359da589cf5" href="/docs/ai-gateway/integrations/frameworks/livekit" width="24" height="24" data-path="images/logos/livekit.svg">
    Real-time voice and multimodal AI agent framework built on WebRTC for production voice assistants and conversational AI.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="LlamaIndex" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/llamaindex.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=3636c3ece510f40b84f9e77175964e15" href="/docs/ai-gateway/integrations/frameworks/llamaindex" width="16" height="16" data-path="images/logos/llamaindex.svg">
    Data framework for building context-augmented LLM applications with advanced indexing, retrieval, and orchestration capabilities.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="LlamaIndex Agents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/llamaindex-agents.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=0bd960784645a2a3c0f4750363c1b1b8" href="/docs/ai-gateway/integrations/frameworks/llama-agents" width="16" height="16" data-path="images/logos/llamaindex-agents.svg">
    Agentic framework built on LlamaIndex for building LLM-powered agents with tool use, multi-step reasoning, and workflow orchestration.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Mastra" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/mastra.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=ed836981c75640a97be5170c2f041268" href="/docs/ai-gateway/integrations/frameworks/mastra" width="683" height="683" data-path="images/logos/mastra.svg">
    TypeScript-first framework for building AI agents and workflows with structured tool integration and multi-step task automation.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="OpenAI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/openai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=41cb629a8b2739dc90fac2ddea651c17" href="/docs/ai-gateway/integrations/frameworks/openai" width="395" height="400" data-path="images/logos/openai.svg">
    Official OpenAI SDK providing direct access to GPT models, embeddings, and other OpenAI services with comprehensive API integration.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="OpenAI Agents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/openai-agents.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b341e846f3ca07a1abf060fc9cb811fe" href="/docs/ai-gateway/integrations/frameworks/openai-agents" width="256" height="260" data-path="images/logos/openai-agents.svg">
    Framework for building agents using OpenAI's agent architecture with structured tools, code execution, and advanced reasoning capabilities.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Pydantic AI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/pydantic-ai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=b6e0adaff02da4c40e781386a5bd1a08" href="/docs/ai-gateway/integrations/frameworks/pydantic-ai" width="16" height="16" data-path="images/logos/pydantic-ai.svg">
    Pydantic library for building with LLMs using structured validation and type-safe agent patterns.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Semantic Kernel" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/semantic-kernel.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=64b369c0610b4f004eb99076718eb5a9" href="/docs/ai-gateway/integrations/frameworks/semantic-kernel" width="683" height="683" data-path="images/logos/semantic-kernel.svg">
    Microsoft's SDK for integrating LLMs with conventional programming languages, featuring plugin architecture and enterprise-grade orchestration.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="SmolAgents" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/smolagents.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=77b383d1fe8c173dc97d21cff472e6e3" href="/docs/ai-gateway/integrations/frameworks/smolagents" width="200" height="200" data-path="images/logos/smolagents.svg">
    Hugging Face's lightweight Python agent framework with AI Gateway support via OpenAIServerModel.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>

  <Card title="Vercel AI" icon="https://mintcdn.com/orqai/d-t0Z04KwFlGVsS1/images/logos/vercel-ai.svg?fit=max&auto=format&n=d-t0Z04KwFlGVsS1&q=85&s=4b94aeb9c1e97041e63afb68f9a5655b" href="/docs/ai-gateway/integrations/frameworks/vercel-ai" width="256" height="222" data-path="images/logos/vercel-ai.svg">
    JavaScript/TypeScript SDK for building AI-powered applications with streaming, tokens, and multi-model support.

    <Badge color="blue" shape="pill" size="sm" icon="arrow-right-arrow-left">AI Gateway</Badge>
  </Card>
</CardGroup>