Agno
Python framework for building production-ready AI agents with structured workflows, tool integration, and multi-agent orchestration.AI Router
AWS Strands
AWS framework for building AI agents with structured reasoning and tool use, enhanced with complete observability and multi-provider access.AI Router
AutoGen
Microsoft’s multi-agent conversational framework enabling collaborative problem-solving through automated agent interactions and customizable conversation patterns.AI Router OpenTelemetry
CrewAI
Framework for orchestrating multi-agent teams with role-based agents, hierarchical task management, and collaborative AI workflows.AI Router OpenTelemetry
DSPy
Framework for programmatic prompt optimization and modular language model workflows with systematic prompt engineering and automated optimization.AI Router OpenTelemetry
Google AI
Official Google AI framework providing access to Gemini models and other Google AI services with comprehensive Python SDK integration.OpenTelemetry
Haystack
End-to-end open-source framework for building RAG and search applications with document retrieval, indexing, and LLM integration.OpenTelemetry
Instructor
Library for structured outputs from language models using Pydantic models with type-safe validation and automatic parsing.AI Router OpenTelemetry
LangChain
Comprehensive framework for building LLM applications through composable chains, agents, and integrations with external data sources.AI Router OpenTelemetry
LiveKit
Real-time voice and multimodal AI agent framework built on WebRTC for production voice assistants and conversational AI.AI Router
LangGraph
Framework for building stateful, multi-actor AI applications with graph-based agent orchestration, cycles, and controllability.AI Router
LiteLLM
LLM proxy with unified interface for 100+ models from multiple providers, enabling easy model switching and provider abstraction.OpenTelemetry
LlamaIndex
Data framework for building context-augmented LLM applications with advanced indexing, retrieval, and orchestration capabilities.AI Router OpenTelemetry
LlamaIndex Agents
Agentic framework built on LlamaIndex for building LLM-powered agents with tool use, multi-step reasoning, and workflow orchestration.AI Router
Mastra
TypeScript-first framework for building AI agents and workflows with structured tool integration and multi-step task automation.AI Router OpenTelemetry
OpenAI
Official OpenAI SDK providing direct access to GPT models, embeddings, and other OpenAI services with comprehensive API integration.AI Router
OpenAI Agents
Framework for building agents using OpenAI’s agent architecture with structured tools, code execution, and advanced reasoning capabilities.AI Router OpenTelemetry
Pydantic AI
Pydantic library for building with LLMs using structured validation and type-safe agent patterns with built-in observability.AI Router OpenTelemetry
Semantic Kernel
Microsoft’s SDK for integrating LLMs with conventional programming languages, featuring plugin architecture and enterprise-grade orchestration.AI Router
Vercel AI
JavaScript/TypeScript SDK for building AI-powered applications with streaming, tokens, and multi-model support.AI Router OpenTelemetry