Setup
1
Choose authentication
- OAuth (recommended)
- API key
Use OAuth when your client supports it. Your client opens a Braintrust authorization page where you sign in and approve access. The server acts with the permissions of the account you sign in with.
- No Braintrust API key required
- No OAuth client ID or client secret to configure
/.well-known/oauth-authorization-server on the same host as your MCP endpoint (see next step), so a client can register itself.2
Choose your endpoint
Use the endpoint for your organization’s data plane region:
Other connection details:
- Self-hosted: Copy the MCP URL from Settings > Data plane. This is your Braintrust API URL with
/mcpappended. - Transport: If your client asks you to choose a transport, choose HTTP (also called streamable HTTP). SSE-only clients can’t connect.
3
Add the server to Devin Desktop
Follow the Devin guide to add the remote server. If you use the legacy Cascade agent, see the Cascade guide instead.
4
Verify the connection
To verify the connection, ask Devin Desktop's agent to list your recent Braintrust projects. If it can’t connect, see Braintrust MCP troubleshooting.
5
Start using Braintrust tools
Devin Desktop's agent can query logs, compare experiments, work with datasets, and use other Braintrust tools. For example:
- “Show me my recent Braintrust experiments.”
- “Query the last 10 logged requests with errors.”
- “Compare accuracy scores between my two latest experiments.”
Next steps
- Run evaluations: Check out the evaluation guide to learn evaluation patterns.
- Explore MCP tools: See the MCP documentation for all available commands.
- Query with SQL: Learn how to query with SQL for complex data analysis.