Skip to main content

AI Gateway

Route your LLM calls through the AI Gateway with a single base URL change. Zero vendor lock-in: always run on the best model at the lowest cost for your use case.

Observability

Instrument your code with OpenTelemetry to capture traces, logs, and metrics for every LLM call, agent step, and tool use.

AI Gateway

Overview

Mastra is a TypeScript framework for building AI-powered applications with pipelines, agents, and workflows. By connecting Mastra to Orq.ai’s AI Gateway, you transform experimental AI applications into production-ready systems with enterprise-grade capabilities.

Key Benefits

Orq.ai’s AI Gateway enhances your Mastra applications with:

Complete Observability

Track every agent step, tool use, and interaction with detailed traces and analytics

Built-in Reliability

Automatic fallbacks, retries, and load balancing for production resilience

Cost Optimization

Real-time cost tracking and spend management across all your AI operations

Multi-Provider Access

Access 300+ LLMs and 20+ providers through a single, unified integration

Prerequisites

Before integrating Mastra with Orq.ai, ensure you have:
  • An Orq.ai account and API Key
  • Node.js 18 or higher
  • TypeScript support
  • Mastra installed in your project
To setup your API key, see API keys & Endpoints.

Installation

Install Mastra:

Configuration

Configure Mastra to use Orq.ai’s AI Gateway with an OpenAI-compatible model configuration:
TypeScript
url: https://api.orq.ai/v3/router

Basic Agent Example

Here’s a complete example of creating and running a Mastra agent through Orq.ai:
TypeScript

Model Selection

With Orq.ai, you can use any supported model from 20+ providers:
TypeScript

Agent with tools

Define tools with createTool and attach them to an agent through the tools field:
TypeScript

Observability

Getting Started

Integrate Mastra with Orq.ai’s observability to gain complete insights into pipeline execution, agent performance, workflow orchestration, and system reliability using OpenTelemetry.

Prerequisites

Before you begin, ensure you have:
  • An Orq.ai account and API Key
  • Node.js 16+ and TypeScript support
  • Mastra installed in your project
  • API keys for your LLM providers and external services

Install Dependencies

Configure Orq.ai

Set up your environment variables to connect to Orq.ai’s OpenTelemetry collector: Unix/Linux/macOS:
Windows (PowerShell):
Using .env file:

Custom Instrumentation

Mastra supports native OpenTelemetry integration for comprehensive observability. Create an instrumentation.mjs file in your Mastra project:
TypeScript
Enable Telemetry in your Mastra initialization:
TypeScript
Register every agent in the agents field of the Mastra constructor. Unregistered agents do not emit traces, because OtelBridge only sees agents passed in at construction time.
All Mastra pipelines and agent calls will be instrumented and exported to Orq.ai through the OTLP exporter.

View Traces

View your traces in the AI Studio in the Traces tab.
Visit your AI Studio to view real-time analytics and traces.

Evaluations & Experiments

Once your agents are running, use Evaluatorq to score outputs across a dataset and Experiments to compare configurations side-by-side.

Run Evaluations with Evaluatorq

Run parallel evaluations across your agents and compare results.

Run Experiments via the API

Compare agent configurations and view results in the AI Studio.