Skip to main content
PATCH
/
v2
/
evaluators
/
{id}
Update an Evaluator
curl --request PATCH \
  --url https://api.orq.ai/v2/evaluators/{id} \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "guardrail_config": {
    "enabled": true,
    "type": "boolean",
    "value": true
  },
  "output_type": "boolean",
  "type": "llm_eval",
  "prompt": "<string>",
  "path": "Default",
  "description": "<string>",
  "model": "<string>",
  "key": "<string>"
}'
{
  "_id": "<string>",
  "description": "<string>",
  "created": "2025-10-30T20:19:21.493Z",
  "updated": "2025-10-30T20:19:21.493Z",
  "guardrail_config": {
    "enabled": true,
    "type": "boolean",
    "value": true
  },
  "type": "llm_eval",
  "prompt": "<string>",
  "key": "<string>",
  "model": "<string>"
}

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

id
string
required

Body

application/json
  • LLM
  • JSON
  • HTTP
  • Python
type
enum<string>
required
Available options:
llm_eval
path
string
required

Entity storage path in the format: project/folder/subfolder/...

The first element identifies the project, followed by nested folders (auto-created as needed).

With project-based API keys, the first element is treated as a folder name, as the project is predetermined by the API key.

Example:

"Default"

guardrail_config
object
  • Boolean
  • Number
output_type
enum<string>

The type of output expected from the evaluator

Available options:
boolean,
number,
string
prompt
string
description
string
model
string
key
string
Minimum length: 1

Response

Successfully updated an eval

  • LLM
  • JSON
  • HTTP
  • Python
  • Function
  • Ragas
  • Typescript
_id
string
required
description
string
required
type
enum<string>
required
Available options:
llm_eval
prompt
string
required
key
string
required
Minimum length: 1
model
string
required
created
string
default:2025-10-30T20:19:21.493Z
updated
string
default:2025-10-30T20:19:21.493Z
guardrail_config
object
  • Boolean
  • Number