Prerequisites
- Cursor IDE installed
- Active Orq.ai account
- Orq.ai API key
Installation
Add MCP Server
- Open Cursor Settings by clicking Cursor → Settings in the top-left menu
- Click Tools & MCP in the sidebar
- Click New MCP Server to open an empty mcp.json editor
- Paste the following configuration:
- Replace
YOUR_ORQ_API_KEYwith your actual API key from Workspace Settings → API Keys - Save the configuration
Verification
Open Cursor’s chat panel and ask:
Available Commands
Use natural language to ask Cursor to perform these operations:Agents
Agents
Create an agent with custom instructions and toolsGet agent configuration for [agent-key]Update agent [agent-key] with new instructions or modelConfigure agent with evaluators and guardrailsInvoke agent [agent-key] with input [message]Retrieve agent response [response-id]
Deployments
Deployments
Create a deployment called [deployment-key]Get deployment configuration for [deployment-key]
Skills
Skills
Create a skill called [skill-key]List all skills in my workspaceGet skill [skill-key]Update skill [skill-key]Delete skill [skill-key]
Analytics
Analytics
Get analytics overview for my workspaceShow me workspace metrics for the last 7 daysQuery analytics filtered by deployment ID
Datasets
Datasets
Create a dataset called "customer-queries"List all datapoints in dataset [dataset-key]Add datapoints to dataset [dataset-key]Update datapoint [datapoint-id]Delete specific datapoints in dataset [dataset-key]Delete dataset [dataset-key]
Experiments
Experiments
Create an experiment from dataset [dataset-key]List all experiment runsExport experiment run [run-id] as CSVRun experiment and auto-evaluate results
Evaluators
Evaluators
Get evaluator configuration for [evaluator-key]Create an LLM-as-a-Judge evaluator for toneCreate a Python evaluator to check response lengthAdd evaluator to experiment [experiment-key]Update evaluator [evaluator-key] with a new promptUpdate Python evaluator [evaluator-key] with revised code
Traces
Traces
List traces from the last 24 hoursShow me traces with errorsGet span details for trace [trace-id]Find the slowest traces from todayShow all traces for thread [thread-id]
Models
Models
List all available chat modelsList all available embedding modelsInvoke model [model-id] with prompt [message]
Search
Search
Search for datasets named "customer"Find experiments in project [project-id]List directories in project [project-id]
Documentation
Documentation
Search the Orq.ai docs for [topic]
Managing Entities
Managing Entities
Delete agent [agent-key]Delete experiment [experiment-key]Delete evaluator [evaluator-key]Delete prompt [prompt-key]Delete knowledge base [knowledge-base-key]
delete_dataset to delete a dataset along with all its datapoints.Troubleshooting
Orq MCP Not Responding
Orq MCP Not Responding
- Check Cursor’s Orq MCP status in Settings
- Verify the API key is correct
- Restart Cursor
- Check the Developer Console (Help > Toggle Developer Tools)
Authentication Errors
Authentication Errors
- Confirm the API key is valid
- Ensure the API key has the necessary permissions
- Try regenerating the API key
Tools Not Available
Tools Not Available
- Verify the Orq MCP server is running in Settings
- Check network connectivity
- Review any error messages in the Developer Console
Skills
Skills add pre-built agentic workflows to Cursor for the full Build, Evaluate, Optimize lifecycle. See the Skills page for the full reference.Installation
Available Skills
Triggered by describing what you need. Cursor picks the right skill automatically.| Skill | Description |
|---|---|
| build-agent | Design, create, and configure an Orq.ai agent |
| build-evaluator | Create validated LLM-as-a-Judge evaluators |
| analyze-trace-failures | Read production traces and categorize failures |
| run-experiment | Create and run experiments with evaluation |
| generate-synthetic-dataset | Generate and curate evaluation datasets |
| optimize-prompt | Analyze and optimize system prompts |
| setup-observability | Instrument LLM applications with orq.ai tracing: AI Gateway for zero-code traces, or OpenTelemetry for framework-level spans |
| compare-agents | Run cross-framework agent comparisons using evaluatorq |
Slash commands (
/orq:quickstart, /orq:traces, etc.) are only available in Claude Code. See Skills for details.