Skip to content
AgentsIndex

Galileo AI Evaluate

AI observability and eval engineering for turning traces into guardrails.

Best for
AI teams who need evals, monitoring, and guardrails in one workflow.

What we checked

Pages last read
AI answers
Too few read

58 buyer-question answers read, November 2026

At a glance

Tags
Self-hosted

For developers

Works with
NVIDIA NeMo, NVIDIA NIM, MCP server

What is Galileo AI Evaluate?

Galileo AI Evaluate is an AI observability and eval engineering platform for AI teams that turns live feedback, production traces, and subject-matter annotations into measurable datasets and tuned evaluators. It includes Capture your groundtruth, Build accurate evals, and Go from evals to guardrails, plus 20+ out-of-box evals, custom evaluators, and real-time guardrails. Customers include Writer, Cisco, NVIDIA, and MongoDB. Plans run Free $0, Pro $100/month, and Enterprise custom.

Ownership: this is now a Cisco/Splunk product, mid-transition

Cisco announced intent to acquire Galileo Technologies, Inc. on April 9, 2026 (networkworld.com/article/4156855/cisco-to-acquire-galileo-for-ai-observability.html), and the deal closed within Cisco's Q4 FY2026 — Splunk's own May 28, 2026 blog post already says 'Cisco has completed its acquisition of Galileo' (splunk.com/en_us/blog/leadership/splunk-observability-galileo.html), and Galileo's GitHub org is now literally titled 'Galileo (now part of Cisco)' (api.github.com/orgs/rungalileo, checked 27 August 2026). Terms were not disclosed (crn.com/news/networking/2026/cisco-to-snap-up-ai-observability-startup-galileo-technologies-to-expand-splunk-platform). As of August 7, 2026, Galileo's own release notes state the product 'is now Splunk Agent Observability' for anyone onboarding after that date, with new documentation moved to agent-observability-docs.splunk.com (docs.galileo.ai/release-notes). The galileo.ai marketing site, self-serve signup, and free tier are all still live and independently operable as of this check (verified by loading app.galileo.ai/sign-up directly), but a buyer should assume the product will keep converging into the Splunk/Cisco Observability Cloud line rather than continuing as a standalone roadmap.

What it's actually good at: cheap evaluation at 100% of traffic

Galileo's core technical bet is running evaluation with small, purpose-distilled 'Luna' models instead of a frontier LLM-as-judge for every trace. This isn't just a marketing claim — Galileo's engineering team published it as a peer-reviewable arXiv paper (Luna-2: Scalable Single-Token Evaluation with Small Language Models, Feb 2026, arXiv:2602.18583), which reports over 80x lower inference cost and over 20x lower latency than frontier-LLM judges at comparable accuracy on content-safety and hallucination benchmarks, and claims (self-reported, not independently audited) that Luna-2 is protecting 100M+ AI sessions and >100B tokens/month in production with $30M+ in annual eval-cost savings for customers. Whatever one makes of the self-reported production numbers, the architecture itself — LoRA/PEFT heads on a shared SLM backbone, enabling many concurrent specialized metrics on one GPU — is a real, technically legible answer to the 'evaluation is too expensive to run on everything' problem that most LLM-as-judge tools don't solve. Galileo also publishes and maintains a public, still-updated Agent Leaderboard on Hugging Face ranking LLMs on agentic tasks (453 likes, huggingface.co/spaces/galileo-ai/agent-leaderboard) — an artifact independent of the vendor pricing pitch that a buyer can inspect directly.

Pricing: a real free tier, but the paid tier scales opaquely

The pricing page (galileo.ai/pricing, checked 27 August 2026) publishes concrete numbers for two of three tiers: Free ($0/month, 5,000 traces/month, unlimited users and custom evals) and Pro ($100/month billed yearly, 50,000 traces/month, standard RBAC, advanced analytics, Slack support) — but the Pro card is explicitly annotated '*Pricing scales based on number of traces,' with no published rate card for what a trace costs above 50,000/month. Enterprise is 'Contact us' with no published floor. A buyer evaluating this for meaningful production volume (the whole pitch is evaluating 100% of traffic) needs a sales call to find the real cost curve — the headline $100/month tells you almost nothing about what running it on real production traffic costs.

Company history and funding, pre-acquisition

Galileo Technologies was founded in 2021 by Vikram Chatterji, Yash Sheth, and Atindriyo Sanyal — alumni of Google AI (BERT), Google speech recognition, and Uber AI/Apple Siri respectively (galileo.ai/about). It raised a $45M Series B in October 2024 led by Scale Venture Partners with Databricks Ventures and ServiceNow Ventures participating, bringing total funding to $68.1M per Crunchbase (crn.com/news/networking/2026/cisco-to-snap-up-ai-observability-startup-galileo-technologies-to-expand-splunk-platform; corroborated at forbes.com/sites/richardnieva/2024/10/15/galileo-series-b-45-million-scale-venture-partners). Customers named in vendor-published case studies include Comcast, HP, NTT, and Twilio, per Cisco/CRN reporting and Galileo's own case studies page — these are vendor claims, not independently verified, and should be read as such (galileo.ai/case-studies).

How much does Galileo AI Evaluate cost?

Prices excluding tax, as Galileo AI Evaluate publishes them.

  • Free

    Free

    For developers and small teams who want to experiment, iterate and build.

    • Our Free plan includes:
    • 5,000 traces per month
    • Unlimited users
  • Pro

    $100 a month

    Launch your app with confidence, on a plan that's built to grow with you.

    • Everything in Free plus:
    • 50,000 traces per month
    • Standard RBAC
    • Analytics & insights
    • Dedicated support: Slack
    • Pricing scales based on number of traces.
  • Enterprise

    Contact us

    For teams that need unlimited scale, security and support.

    • Everything in Pro plus:
    • Unlimited traces
    • Custom rate limits
    • Deploy: Hosted, VPC, or on-prem
    • Security RBAC, SSO
    • Dedicated CSM
    • Real-time guardrails
    • 24/7 Support: Slack, email, or phone
    • Low-latency dedicated inference servers
    • Forward deployed engineering support
Galileo AI Evaluate's pricing page

Pricing page, captured

galileo.ai/pricing, checked

What we checked on Galileo AI Evaluate

How you build with itNo public code found

Open source

51 public repositories on GitHub, none of them the product's code

On the page: github.com/rungalileo repositories

github.com/rungalileoChecked by us,

Questions about Galileo AI Evaluate

How much does Galileo AI Evaluate cost?
Galileo AI Evaluate costs $100 per 1 2m spans month. From its own pages, checked 1 November 2026.
Is Galileo AI Evaluate open source, and can you host it yourself?
You can host Galileo AI Evaluate yourself.

How we check every listing

Sources and changes

Last full check

What changed1

  • Free tier

Galileo AI Evaluate price history

We have read the price once so far, on 1 November 2026: from $100 per 1 2m spans month.

PricePlanFirst seenLast seenReadingsSource
$100 per 1 2m spans month1 November 20261 November 20261

From our research on 1 November 2026. A date is when we read the page, not when the price changed.

Similar in Agent tools and integrations

See all in Agent tools and integrations

From our research

All research

Is Galileo AI Evaluate yours?

Free, and the page then carries the verified owner mark. You confirm it with an email at galileo.ai. Claim this listing

Report an error if a fact is wrong.