Frameworks
Agno
Python framework for building production-ready AI agents with structured workflows, tool integration, and multi-agent orchestration.AI Gateway
AutoGen
Microsoft’s multi-agent conversational framework enabling collaborative problem-solving through automated agent interactions and customizable conversation patterns.AI Gateway
AWS Strands
AWS framework for building AI agents with structured reasoning and tool use, enhanced with multi-provider access.AI Gateway
AWS Bedrock AgentCore
AWS managed agent runtime for deploying any agent framework at scale. Route calls through the AI Gateway or invoke Orq Agents by key.AI Gateway
Azure AI Agents
Microsoft’s managed agent service built on the OpenAI Assistants API, with support for threads, tools, and multi-step reasoning.AI Gateway
Anthropic
Anthropic’s native SDK for the Claude Messages API, with text generation, streaming, and tool use.AI Gateway
Claude Agent SDK
Anthropic’s SDK for building programmable Claude agents with multi-turn conversations, tool use, and MCP servers.AI Gateway
CrewAI
Framework for orchestrating multi-agent teams with role-based agents, hierarchical task management, and collaborative AI workflows.AI Gateway
DSPy
Framework for programmatic prompt optimization and modular language model workflows with systematic prompt engineering and automated optimization.AI Gateway
Instructor
Library for structured outputs from language models using Pydantic models with type-safe validation and automatic parsing.AI Gateway
LangChain
Comprehensive framework for building LLM applications through composable chains, agents, and integrations with external data sources.AI Gateway
LangGraph
Framework for building stateful, multi-actor AI applications with graph-based agent orchestration, cycles, and controllability.AI Gateway
LiveKit
Real-time voice and multimodal AI agent framework built on WebRTC for production voice assistants and conversational AI.AI Gateway
LlamaIndex
Data framework for building context-augmented LLM applications with advanced indexing, retrieval, and orchestration capabilities.AI Gateway
LlamaIndex Agents
Agentic framework built on LlamaIndex for building LLM-powered agents with tool use, multi-step reasoning, and workflow orchestration.AI Gateway
Mastra
TypeScript-first framework for building AI agents and workflows with structured tool integration and multi-step task automation.AI Gateway
OpenAI
Official OpenAI SDK providing direct access to GPT models, embeddings, and other OpenAI services with comprehensive API integration.AI Gateway
OpenAI Agents
Framework for building agents using OpenAI’s agent architecture with structured tools, code execution, and advanced reasoning capabilities.AI Gateway
Pydantic AI
Pydantic library for building with LLMs using structured validation and type-safe agent patterns.AI Gateway
Semantic Kernel
Microsoft’s SDK for integrating LLMs with conventional programming languages, featuring plugin architecture and enterprise-grade orchestration.AI Gateway
SmolAgents
Hugging Face’s lightweight Python agent framework with AI Gateway support via OpenAIServerModel.AI Gateway
Vercel AI
JavaScript/TypeScript SDK for building AI-powered applications with streaming, tokens, and multi-model support.AI Gateway