Skip to main content

AI Gateway

Overview

SmolAgents is a lightweight Python agent framework by Hugging Face. Using OpenAIServerModel with a custom api_base, you can route all LLM calls through Orq.ai’s AI Gateway for access to 300+ models, cost tracking, and reliability features.

Prerequisites

  • An Orq.ai account and API Key
  • Python 3.9 or higher
To setup your API key, see API keys & Endpoints.

Installation

Configuration

Python
api_base: https://api.orq.ai/v3/router

Basic Agent Example

Python

Model Selection

With Orq.ai, you can use any supported model from 20+ providers:
Python