curl --request POST \
--url https://api.orq.ai/v2/gateway/moderations \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"input": "<string>",
"model": "<string>"
}
'{
"id": "<string>",
"model": "<string>",
"results": [
{
"flagged": true,
"categories": {
"hate": true,
"hate/threatening": true,
"harassment": true,
"harassment/threatening": true,
"illicit": true,
"illicit/violent": true,
"self-harm": true,
"self-harm/intent": true,
"self-harm/instructions": true,
"sexual": true,
"sexual/minors": true,
"violence": true,
"violence/graphic": true
},
"category_scores": {
"hate": 123,
"hate/threatening": 123,
"harassment": 123,
"harassment/threatening": 123,
"illicit": 123,
"illicit/violent": 123,
"self-harm": 123,
"self-harm/intent": 123,
"self-harm/instructions": 123,
"sexual": 123,
"sexual/minors": 123,
"violence": 123,
"violence/graphic": 123
},
"category_applied_input_types": {
"hate": [
"<string>"
],
"hate/threatening": [
"<string>"
],
"harassment": [
"<string>"
],
"harassment/threatening": [
"<string>"
],
"illicit": [
"<string>"
],
"illicit/violent": [
"<string>"
],
"self-harm": [
"<string>"
],
"self-harm/intent": [
"<string>"
],
"self-harm/instructions": [
"<string>"
],
"sexual": [
"<string>"
],
"sexual/minors": [
"<string>"
],
"violence": [
"<string>"
],
"violence/graphic": [
"<string>"
]
}
}
]
}Create moderation
curl --request POST \
--url https://api.orq.ai/v2/gateway/moderations \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"input": "<string>",
"model": "<string>"
}
'{
"id": "<string>",
"model": "<string>",
"results": [
{
"flagged": true,
"categories": {
"hate": true,
"hate/threatening": true,
"harassment": true,
"harassment/threatening": true,
"illicit": true,
"illicit/violent": true,
"self-harm": true,
"self-harm/intent": true,
"self-harm/instructions": true,
"sexual": true,
"sexual/minors": true,
"violence": true,
"violence/graphic": true
},
"category_scores": {
"hate": 123,
"hate/threatening": 123,
"harassment": 123,
"harassment/threatening": 123,
"illicit": 123,
"illicit/violent": 123,
"self-harm": 123,
"self-harm/intent": 123,
"self-harm/instructions": 123,
"sexual": 123,
"sexual/minors": 123,
"violence": 123,
"violence/graphic": 123
},
"category_applied_input_types": {
"hate": [
"<string>"
],
"hate/threatening": [
"<string>"
],
"harassment": [
"<string>"
],
"harassment/threatening": [
"<string>"
],
"illicit": [
"<string>"
],
"illicit/violent": [
"<string>"
],
"self-harm": [
"<string>"
],
"self-harm/intent": [
"<string>"
],
"self-harm/instructions": [
"<string>"
],
"sexual": [
"<string>"
],
"sexual/minors": [
"<string>"
],
"violence": [
"<string>"
],
"violence/graphic": [
"<string>"
]
}
}
]
}Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
Classifies if text violates content policy
Response
Returns moderation classification results
The unique identifier for the moderation request
The model used to generate the moderation results
A list of moderation objects
Show child attributes
Show child attributes
Whether any of the categories are flagged
A list of the categories, and whether they are flagged or not
Show child attributes
Show child attributes
Content that expresses, incites, or promotes hate based on race, gender, ethnicity, religion, nationality, sexual orientation, disability status, or caste.
Hateful content that also includes violence or serious harm towards the targeted group.
Content that expresses, incites, or promotes harassing language towards any target.
Harassment content that also includes violence or serious harm towards any target.
Content that includes instructions or advice that facilitate the planning or execution of wrongdoing.
Content that includes instructions or advice that facilitate the planning or execution of wrongdoing that also includes violence.
Content that promotes, encourages, or depicts acts of self-harm, such as suicide, cutting, and eating disorders.
Content where the speaker expresses that they are engaging or intend to engage in acts of self-harm.
Content that encourages performing acts of self-harm, or that gives instructions or advice on how to commit such acts.
Content meant to arouse sexual excitement, such as the description of sexual activity, or that promotes sexual services.
Sexual content that includes an individual who is under 18 years old.
Content that depicts death, violence, or physical injury.
Content that depicts death, violence, or physical injury in graphic detail.
A list of the categories along with their scores as predicted by model
Show child attributes
Show child attributes
The score for the category hate
The score for the category hate/threatening
The score for the category harassment
The score for the category harassment/threatening
The score for the category illicit
The score for the category illicit/violent
The score for the category self-harm
The score for the category self-harm/intent
The score for the category self-harm/instructions
The score for the category sexual
The score for the category sexual/minors
The score for the category violence
The score for the category violence/graphic
A list of the categories along with the input type(s) that the score applies to
Show child attributes
Show child attributes
The applied input type(s) for the category hate
The applied input type(s) for the category hate/threatening
The applied input type(s) for the category harassment
The applied input type(s) for the category harassment/threatening
The applied input type(s) for the category illicit
The applied input type(s) for the category illicit/violent
The applied input type(s) for the category self-harm
The applied input type(s) for the category self-harm/intent
The applied input type(s) for the category self-harm/instructions
The applied input type(s) for the category sexual
The applied input type(s) for the category sexual/minors
The applied input type(s) for the category violence
The applied input type(s) for the category violence/graphic
Was this page helpful?