Orq.ai Documentation - AI Gateway & LLM Collaboration Platform

curl --request PATCH \ --url https://api.orq.ai/v2/evaluators/{id} \ --header 'Authorization: Bearer <token>' \ --header 'Content-Type: application/json' \ --data ' { "type": "<string>", "path": "Default", "key": "<string>", "description": "<string>", "prompt": "<string>", "output_type": "<string>", "categories": [ "<string>" ], "categorical_labels": [ { "value": "<string>", "description": "<string>" } ], "repetitions": 123, "model": "<string>", "schema": "<string>", "url": "<string>", "method": "<string>", "headers": {}, "payload": {}, "code": "<string>", "guardrail_config": { "type": "boolean", "value": true, "enabled": true, "alert_on_failure": false }, "versionDescription": "<string>" } '

{ "_id": "<string>", "description": "<string>", "type": "llm_eval", "prompt": "<string>", "key": "<string>", "mode": "single", "model": "<string>", "created": "2026-06-10T10:08:15.342Z", "updated": "2026-06-10T10:08:15.342Z", "updated_by_id": "<string>", "guardrail_config": { "type": "boolean", "value": true, "enabled": true, "alert_on_failure": false }, "repetitions": 2, "categories": [ "<string>" ], "categorical_labels": [ { "value": "<string>", "description": "<string>" } ], "dataset_id": "<string>" }

Authorizations

Authorization

string

header

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

string

required

Body

application/json

type

string

Evaluator type. Optional on update — inferred from existing evaluator.

path

string

Project path. Optional on update — uses existing project if omitted.

Example:

"Default"

key

string

Minimum string length: 1

Pattern: ^[a-zA-Z0-9]([a-zA-Z0-9_-]*[a-zA-Z0-9])?$

description

string

prompt

string

output_type

string

Response

Successfully updated an eval

_id

string

required

description

string

required

type

enum<string>

required

Available options:

llm_eval

prompt

string

required

key

string

required

Minimum string length: 1

Pattern: ^[a-zA-Z0-9]([a-zA-Z0-9_-]*[a-zA-Z0-9])?$

mode

enum<string>

required

Available options:

single

model

string

required

created

string

default:2026-06-10T10:08:15.342Z

updated

string

default:2026-06-10T10:08:15.342Z

updated_by_id

string | null

guardrail_config

Boolean · object

Boolean
Categorical
Number

Show child attributes

repetitions

integer | null

Required range: 1 <= x <= 3