Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Path Parameters
Deployment ID
Body
application/json
The deployment request payload
Your own custom key-value pairs can be attached to the logs. This is useful for storing additional information related to your interactions with the LLM providers or specifics within your application.
Usage statistics to add to the deployment
messages
(Developer message · object | System message · object | User message · object | Assistant message · object | Tool message · object)[]
A list of messages sent to the model.
- Developer message
- System message
- User message
- Assistant message
- Tool message
choices
(Developer message · object | System message · object | User message · object | Assistant message · object | Tool message · object)[]
A list of completion choices. If you are using a completion model then you must provide the completion content with the chat completion format
- Developer message
- System message
- User message
- Assistant message
- Tool message
Feedback from the user on the completion
Response
Successful operation
Whether the request was successful