Skip to main content
AWS Bedrock AgentCore Runtime is a serverless hosting environment for deploying agents built with any framework (Strands, LangGraph, CrewAI) at production scale, without managing infrastructure. Connect the AI Gateway from inside AgentCore to access 300+ models across 20+ providers with automatic fallbacks, cost tracking, and full observability.

AI Gateway

Route LLM calls through the AI Gateway inside AgentCore with a single base URL change.

Orq Agents

Invoke any Orq.ai Agent by key from inside AgentCore using the OpenAI Responses API.

AI Gateway

Connect the AI Gateway to an AgentCore entrypoint to access 300+ LLMs across 20+ providers, with automatic fallbacks, cost tracking, and observability.

OpenAI Agents SDK

Install:
Configure an AsyncOpenAI client with the AI Gateway base URL, then wrap the agent in a BedrockAgentCoreApp entrypoint:

Strands Agents

Install:
Use OpenAIModel with the AI Gateway base URL inside a Strands agent:

Orq Agents

Invoke any Orq.ai Agent by key using model="agent/YOUR_AGENT_KEY" with the OpenAI Responses API. The AI Gateway executes the configured agent including its system prompt, tools, evaluators, and model settings.
Find the agent key on the Agents page in Orq.ai.

Observability

Capture traces from AgentCore runs and send them to Orq.ai using OpenTelemetry.

Installation

Configuration

Set up the OTLP exporter and instrument the OpenAI client before starting the app:
View traces in AI Studio under the Traces tab.

Evaluations & Experiments

Once agents are running, use Evaluatorq to score outputs across a dataset and Experiments to compare configurations side-by-side.

Run Evaluations with Evaluatorq

Run parallel evaluations across agents and compare results.

Run Experiments via the API

Compare agent configurations and view results in the AI Studio.