added
Online Guardrails in Live Deployments
5 days ago by Kyra Dresen
You can now configure Guardrails after you have added them to your Library directly in Deployments > Settings for both input and output, giving you full control over live deployments.
- Guardrails: Block unacceptable inputs or outputs based on predefined criteria. If a guardrail is triggered, it can either retry the request or activate a fallback model, if configured.
What Are Guardrails?
Guardrails enforce boundaries by setting thresholds to block inputs or outputs that fail to meet predefined criteria. When triggered, guardrails can stop processing or activate fallback mechanisms like retries or alternative models.
- Threshold Configuration: Set customizable thresholds based on your specific use case to block inputs or outputs that fail to meet predefined criteria.
- Input and Output Guardrails: Apply rules to both incoming data and generated outputs, ensuring comprehensive quality control at every stage.
- Synchronous Operation: Guardrails run synchronously and do not introduce additional latency to your workflows.
- Fallback Mechanisms: When triggered, guardrails can stop processing or activate fallback options such as retries or alternative models to maintain continuity.