Skip to main content

AI Gateway

Overview

AWS Strands is a framework for building AI agents with structured reasoning and tool use. Connecting AWS Strands to Orq.ai’s AI Gateway transforms experimental agents into production-ready systems with enterprise-grade capabilities.

Key Benefits

Orq.ai’s AI Gateway enhances AWS Strands Agents with:

Complete Observability

Track every agent step, tool use, and interaction with detailed traces and analytics

Built-in Reliability

Automatic fallbacks, retries, and load balancing for production resilience

Cost Optimization

Real-time cost tracking and spend management across all AI operations

Multi-Provider Access

Access 300+ LLMs and 20+ providers through a single, unified integration

Prerequisites

Before integrating AWS Strands with Orq.ai, ensure the following are in place:
  • An Orq.ai account and API Key
  • Python 3.10 or higher
  • AWS Strands SDK installed
To set up an API key, see API keys & Endpoints.

Installation

Install the Strands Agents SDK (requires Python 3.10+):

Configuration

Configure Strands Agents to use Orq.ai’s AI Gateway by passing custom client arguments with the base URL:
base_url: https://api.orq.ai/v3/router

Basic Agent Example

Here’s a complete example of creating and running a Strands agent through Orq.ai:

Agent with Tools

Strands agents can use tools while routing through Orq.ai:

Fallback Configuration

Configure automatic fallbacks for reliability: