Skip to main content

AI Gateway

Overview

Agno is a Python framework for building production-ready AI agents with structured workflows, tool integration, and multi-agent orchestration. Connecting Agno to Orq.ai’s AI Gateway provides access to 300+ models with a single configuration change.

Key Benefits

Orq.ai’s AI Gateway enhances Agno applications with:

Complete Observability

Track every agent interaction, tool use, and model call with detailed traces

Built-in Reliability

Automatic fallbacks, retries, and load balancing for production resilience

Cost Optimization

Real-time cost tracking and spend management across all AI operations

Multi-Provider Access

Access 300+ LLMs and 20+ providers through a single, unified integration

Prerequisites

Before integrating Agno with Orq.ai, ensure the following are in place:
  • An Orq.ai account and API Key
  • Python 3.10 or higher
To set up an API key, see API keys & Endpoints.

Installation

Configuration

Configure Agno to use Orq.ai’s AI Gateway via OpenAIChat with a custom base_url:
Python
base_url: https://api.orq.ai/v3/router

Basic Agent Example

Python

Agent with Tools

Add tools to the agent for real-world tasks:
Python

Agent with Custom Tools

Define custom Python functions as tools:
Python

Multi-Agent Team

Orchestrate multiple specialized agents:
Python

Model Selection

With Orq.ai, any supported model from 20+ providers can be used:
Python