Overview
Claude Desktop is Anthropic’s desktop application that supports Model Context Protocol (MCP) integrations. By configuring the Orq MCP server, you can access all Orq.ai features directly in your Claude Desktop conversations.Prerequisites
- Claude Desktop app installed
- Active Orq.ai account
- Orq.ai API key
- Node.js installed (required for
npx mcp-remote)
Installation
You can configure the Orq MCP server through Claude Desktop Settings or using the Terminal.Option 1: Settings Path (Recommended)
- Open Claude Desktop Settings by clicking Claude in the top-left menu, then select Settings
- Click Developer in the sidebar
- Click Edit Config to open the
claude_desktop_config.jsonfile - Paste the following configuration into the file:
- Replace
<ORQ_API_TOKEN>with your actual API key from Workspace Settings → API Keys - Save the file and restart Claude Desktop
If the config file is empty, paste the entire JSON structure above. If it already has content, add the
orq server to the existing mcpServers object.Option 2: Terminal Path
If you prefer using the terminal, you can directly edit the config file: macOS: Run these commands in your terminal:<ORQ_API_TOKEN> with your actual API key, save the file, and restart Claude Desktop.
If the file doesn’t exist, the command will create it. Make sure to use valid JSON formatting.
Verify Installation
After restarting Claude Desktop, start a new conversation and ask:
What You Can Do
Once connected, you can use natural language in Claude Desktop to perform these operations:Agents
Agents
Create an agent with custom instructions and toolsGet agent configuration for [agent-id]Configure agent with evaluators and guardrails
Analytics
Analytics
Get analytics overview for my workspaceShow me workspace metrics for the last 7 daysQuery analytics filtered by deployment ID
Datasets
Datasets
Create a dataset called "customer-queries"List all datapoints in dataset [dataset-id]Add datapoints to dataset [dataset-id]Update datapoint [datapoint-id]Delete dataset [dataset-id]
Experiments
Experiments
Create an experiment from dataset [dataset-id]List all experiment runsExport experiment run [run-id] as CSVRun experiment and auto-evaluate results
Evaluators
Evaluators
Create an LLM-as-a-Judge evaluator for toneCreate a Python evaluator to check response lengthAdd evaluator to experiment [experiment-id]
Traces
Traces
List traces from the last 24 hoursShow me traces with errorsGet span details for trace [trace-id]Find the slowest traces from today
Models & Search
Models & Search
List all available AI modelsSearch for datasets named "customer"Find experiments in project [project-id]List registry keys for filtering traces
Usage Examples
Create Experiments
- Use
search_entitiesto find the “customer-queries” dataset - Use
create_experimentwith the name “Model Comparison Test” and auto-run enabled - Configure two task columns (one for GPT-5.2, one for Claude Sonnet 4.6)
- Execute both models against the dataset automatically via the auto-run option
- Provide a summary of the results with evaluation metrics
Analyze Traces
- Calculate the time range for the last 24 hours
- Use
list_traceswith error status filter - Analyze the trace data
- Provide error count and types, affected deployments, time distribution, and suggested fixes based on error patterns
Generate Synthetic Datasets
- Generate 100 realistic customer support conversation examples (questions and expected responses)
- Use
create_datasetto create a new dataset named “Support Training” - Use
create_datapointsto add all 100 conversations to the dataset - Confirm creation with the dataset ID and sample of generated data
Performance Analysis
- Use
query_analyticswith a 7-day time range - Analyze average latency changes over the week
- Review token usage patterns and cost trends
- Examine error rate fluctuations
- Compare performance across different models
- Provide a summary report with insights on whether performance has improved or decreased
Troubleshooting
MCP Server Not Connecting
MCP Server Not Connecting
- Verify the config file path is correct for your OS
- Check the JSON syntax is valid (no trailing commas, proper quotes)
- Ensure your API key is valid and has the required permissions
- Restart Claude Desktop after making config changes
- Check the Claude Desktop logs for error messages
Authentication Errors
Authentication Errors
- Confirm your API key is active in Orq.ai Settings
- Make sure the API key has workspace access permissions
- Verify the
Authorizationheader format:Bearer YOUR_KEY - Try generating a new API key if the current one is expired
Slow Responses
Slow Responses
MCP operations over HTTP can take a few seconds:
- Be patient with large dataset operations
- Break complex workflows into smaller steps
- Check Orq.ai service status at status.orq.ai
Tool Not Found
Tool Not Found
- Verify the MCP server is properly configured in your config file
- Restart Claude Desktop to reload the MCP configuration
- Try rephrasing your request
- Check the MCP tools list