Opik

What does Opik do?

Opik logs every step of an AI system, from user interactions and context retrieval to tool calls and model responses, then turns those traces into repeatable evaluation workflows. Teams can capture and visualize execution paths, define plain-text assertions or reference datasets, and use LLM-as-a-judge metrics to surface errors across development, testing, and production. The result is a single workflow for tracing, debugging, and scoring agent behavior instead of stitching together separate tools. At scale, Opik supports 30+ metrics and is used by thousands of AI developers and teams, with 450 enterprise, startup, and academic teams and 150k+ developers cited across Comet's site. It supports open-source self-hosting as well as hosted cloud plans, and the platform includes production monitoring, guardrails, token and cost tracking, and multi-media logging. Customers named on the site include Uber, Netflix, Etsy, Shopify, and NatWest Group.

Why use Opik?

• Opik combines tracing, evaluation, and production monitoring in one workflow, so teams can move from debugging to release decisions without switching systems.
• Its open-source codebase matches the hosted versions, which lets teams start free and keep the same workflow if they later self-host.
• The platform supports 30+ metrics and plain-text assertions, giving teams a structured way to compare agent versions and catch regressions.
• Production guardrails and audit logs help teams spot policy issues and create governance-ready records from the same traces they already collect.
• Enterprise plans add flexible deployments, SSO, service accounts, and compliance coverage for teams with stricter operational requirements.

Who is Opik for?

• ML engineers who need trace-level visibility into agent execution and failures.
• AI product teams who want repeatable tests before shipping model changes.
• Subject matter experts who review outputs and annotate problem traces.
• Platform teams who need production monitoring, guardrails, and cost tracking.
• Organizations with compliance needs that want self-hosting and flexible deployments.

What are Opik's key features?

What does Opik integrate with?

• Shopify

What are Opik's use cases?

How does Opik work?

1. Connect your first application or agent and start capturing runs with Trace & Debug Any Step. Use the trace view to inspect each model call, tool action, and failure point.
2. Add Test Suites & Assertions to define expected behavior for key workflows. Run them against new prompts or model versions before you ship changes.
3. Score outputs with LLM-as-a-Judge Metrics to compare quality across traces and spot regressions. Review edge cases in Agent Playground when you need hands-on debugging.
4. Turn on Monitor Your Agents in Production to watch live traffic, errors, and cost trends. Use the same dashboards to keep teams aligned on reliability and performance.
5. Refine prompts with Prompt Optimizer, then rerun tests to confirm improvements. If you need broader rollout controls, use self-hosting and flexible deployments for compliance-sensitive environments.

How much does Opik cost?

Frequently asked questions