curl --request POST \
--url https://api.orq.ai/v2/evaluators/{id}/invoke \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"query": "<string>",
"output": "<string>",
"reference": "<string>",
"retrievals": [
"<string>"
],
"messages": [
{
"role": "system",
"content": "<string>",
"tool_calls": [
{
"type": "function",
"function": {
"name": "<string>",
"arguments": "<string>"
},
"id": "<string>",
"index": 123
}
],
"tool_call_id": "<string>"
}
]
}
'{
"type": "string",
"original_value": "<string>",
"value": "<string>"
}curl --request POST \
--url https://api.orq.ai/v2/evaluators/{id}/invoke \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"query": "<string>",
"output": "<string>",
"reference": "<string>",
"retrievals": [
"<string>"
],
"messages": [
{
"role": "system",
"content": "<string>",
"tool_calls": [
{
"type": "function",
"function": {
"name": "<string>",
"arguments": "<string>"
},
"id": "<string>",
"index": 123
}
],
"tool_call_id": "<string>"
}
]
}
'{
"type": "string",
"original_value": "<string>",
"value": "<string>"
}Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Evaluator ID Evaluator ID
Latest user message
The generated response from the model
The reference used to compare the output
Knowledge base retrievals
The messages used to generate the output, without the last user message
Show child attributes
The role of the prompt message
system, assistant, user, exception, tool, prompt, correction, expected_output The contents of the user message. Either the text content of the message or an array of content parts with a defined type, each can be of type text or image_url when passing in images. You can pass multiple images by adding multiple image_url content parts. Can be null for tool messages in certain scenarios.
Show child attributes
function Was this page helpful?