Feedback types

All available feedbacks types and values available to you to qualify and review model generations.

There are three different types of feedback available to you in the Feedback Panel, either through the Orq Panel or via API.

Rating

Rating lets you generally qualify the quality of the response sent, here are the available values:

RatingDescription
goodThe response was helpful and accurate.
badThe response was unhelpful or inaccurate.

Defects

Defects let you further define what was wrong within the selected generated, here are the available values:

DefectDescription
grammaticalFlag for responses that contain grammatical errors.
spellingFlag for responses that contain spelling errors.
hallucinationFlag for responses that contain hallucinations or factual inaccuracies.
repetitionFlag for responses that contain unnecessary repetition.
inappropriateFlag for responses that are deemed inappropriate or offensive.
off_topicFlag for responses that do not address the user's query.
incompletenessFlag for responses that are incomplete or partially address the query.
ambiguityFlag for responses that are vague or unclear.

💡

You can select multiple defects for one response

Interactions

Interactions let you qualify how the user interacted with the response, here are the available values:

InteractionDescription
savedIndicates if the user saved the response
selectedIndicates if the user selected this response from multiple options
deletedIndicates if the user deleted or discarded the response
sharedIndicates if the user shared the response with others
copiedIndicates if the user copied the response for use elsewhere
reportedIndicates if the user reported this response for review

💡

You can select multiple interactions for one response