Add metrics to a deployment
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Deployment ID
The deployment request payload
Your own custom key-value pairs can be attached to the logs. This is useful for storing additional information related to your interactions with the LLM providers or specifics within your application.
Usage statistics to add to the deployment
A list of messages sent to the model.
Developer-provided instructions that the model should follow, regardless of messages sent by the user.
A list of completion choices. If you are using a completion model then you must provide the completion content with the chat completion format
Developer-provided instructions that the model should follow, regardless of messages sent by the user.
Feedback from the user on the completion
Successful operation
Whether the request was successful