# Groq

> Source: https://agentsindex.ai/groq

Hosted OpenAI-compatible inference for open-weight models, priced per token.

Groq is a cloud inference provider that serves open-weight models such as GPT-OSS, Llama and Whisper over an OpenAI-compatible API on its own LPU hardware. It also runs a console, a browser playground and server-side MCP tool orchestration.

- Best for: Developers who need fast, predictable inference for production AI apps.
- Not for: Teams that must run models on their own servers: Groq serves every model from its own data centers. Teams set on a closed model, since its catalog is open-weight models.

Starting price

Free

Paid plans from **$0.075 per 1m input tokens**

From [console.groq.com/docs/models](https://console.groq.com/docs/models), checked 19 October 2026

- MCP server No From console.groq.com/docs/tool-use/remote-mcp, 19 October 2026 [console.groq.com](https://console.groq.com/docs/tool-use/remote-mcp)
- API Yes From console.groq.com/docs/overview, 19 October 2026 [console.groq.com](https://console.groq.com/docs/overview)
- Open source No From console.groq.com/docs/legal/services-agreement, 19 October 2026 [console.groq.com](https://console.groq.com/docs/legal/services-agreement)
- Self-host No From trust.groq.com/faq, 19 October 2026 [trust.groq.com](https://trust.groq.com/faq)

What we checked

- Pages last read: 19 October 2026
- Facts checked: 4 facts · From 14 sources
- AI answers: Too few read · 58 buyer-question answers read, November 2026

[How we check](https://agentsindex.ai/methodology) [Editorial policy](https://agentsindex.ai/editorial-policy#not-for-sale)

[Visit Groq](https://agentsindex.ai/go/groq) [Compare](https://agentsindex.ai/compare?cat=ai-model-providers&products=groq)

## At a glance

- Category: [AI model providers](https://agentsindex.ai/categories/ai-model-providers)
- Tags: BYOK, SOC 2

### For developers

- Works with: OpenAI, whisper v3 large, whisper-large-v3-turbo, llama-4-scout, llama-3.1-8b-instant, llama-3.3-70b-versatile and 5 more

## Groq in our research

[All research](https://agentsindex.ai/blog)

Study 19 October 2026 – 16 November 2026

### [AI Tool Pricing Index, November 2026](https://agentsindex.ai/data/ai-tool-pricing-index)

Pricing

Usage-based

43 of the 361 tools we checked bill by usage.

Edition price, checked 19 October 2026.

Pricing pages of the AI tools, November 2026 edition as of 16 November 2026 n = 361 tools checked

## Groq sells hosted inference on hardware it designed

Groq operates a cloud that answers model requests, and the models are other people's. Its agreement defines what it serves as [models that are openly available, obtained from third party developers, or the Customer](https://console.groq.com/docs/legal/services-agreement), so the catalog is OpenAI's GPT-OSS pair, Meta Llama, Qwen, Whisper for speech to text and Orpheus for speech synthesis. What Groq contributes is the silicon and the data centers: the LPU, and an [LPX rack of 256 LPU accelerators](https://groq.com/platform) stated to pair with NVIDIA hardware when released, running across data centers the company lists on four continents.

The API is a deliberate clone of someone else's. The docs give the [OpenAI base URL](https://console.groq.com/docs/overview) as [https://api.groq.com/openai/v1](https://api.groq.com/openai/v1), so existing OpenAI client code moves over by changing one string, and the official SDKs, LangChain, LiteLLM and the Vercel AI SDK all have published paths in. Throughput is the selling point on every page: 1,000 tokens per second quoted for GPT-OSS 20B, 500 for the 120B model.

## Pricing is per token, and the vendor's own pricing page is gone

There is no plan fee. Published rates sit in the [models table](https://console.groq.com/docs/models): $0.075 per million input tokens and $0.30 per million output tokens on GPT-OSS 20B, $0.15 and $0.60 on the 120B model, $0.80 and $4.00 on Qwen 3.8 27B, $0.04 per hour of audio on Whisper Large V3 Turbo. Several entries, including Llama 3.1 8B, Llama 3.3 70B and MiniMax M2.7, read ContactSales instead of a rate, so part of the catalog has no public price at all.

Billing starts before a month ends. New Developer accounts are invoiced at [cumulative thresholds of $1, $10, $100, $500 and $1,000](https://console.groq.com/docs/billing-faqs), with a different ladder for customers billed in India, after which monthly invoicing takes over. Spend limits and a usage dashboard are Developer tier features, and batch jobs run at half the synchronous rate.

One thing does not add up. Both the [services agreement](https://console.groq.com/docs/legal/services-agreement) and the batch documentation say fees are published at groq.com/pricing, and that address now serves the homepage instead of a rate card. Opening it in a browser lands on groq.com with no plan table, and the URL appears nowhere in the site's own sitemap. The per-token rates survive only inside the developer documentation.

## The agentic half is MCP orchestration, and it is in beta

Groq runs the tool loop rather than handing it back. Point a Responses API request at a remote MCP server and, in the vendor's words, [the Groq API will discover tools and pass them into the model at inference time](https://console.groq.com/docs/tool-use/remote-mcp), execute the calls the model returns, and feed results back for another pass. Each tool definition takes an allowed_tools filter and a require_approval field, so the caller decides how much the model may reach.

The direction matters for anyone shopping for a connector. Groq is the MCP client here: it calls servers you nominate, such as Hugging Face or Firecrawl, and publishes no MCP endpoint of its own that ChatGPT or Claude could add. The same page states that remote MCP on Groq is currently in beta, and the beta clause of the agreement puts such features outside the data processing addendum and the HIPAA addendum unless a model is specifically designated.

Governance of model access is further along. [Model permissions](https://console.groq.com/docs/model-permissions) allow or block individual models at organization and project level, with organization settings always winning, and projects carry their own API keys, rate limits and logs.

## Data handling is published, and Zero Data Retention is open to all

Inference requests are not stored by default. Where they are, the [data documentation](https://console.groq.com/docs/your-data) limits it to reliability and abuse logs kept up to 30 days, plus batch files for 30 days and fine-tuning datasets until the customer deletes them. Zero Data Retention is available to every customer, globally or feature by feature, and switching it on disables the features that need storage to work.

Training is ruled out in two places. The agreement says Groq is not permitted to use inputs or outputs for training or fine-tuning without customer instruction, and the trust center states plainly that [Groq does not use customer data to train any models for Groq's own purposes](https://trust.groq.com/faq). Encryption is TLS 1.2+ in transit and AES-256 GCM at rest, customer managed keys are stated as not offered, and retained data sits in Google Cloud buckets in the United States. Processing inside one country or region is an Enterprise arrangement through sales.

Compliance evidence exists and is gated: [SOC 2 Type II maintained with a 2025 report](https://trust.groq.com/), a 2026 bridge letter and GDPR and HIPAA entries, all behind an access request, with a BAA that excludes beta features and the compound systems. No uptime number is published for self-serve use; service level commitments are bought separately. Nothing in the documentation describes SAML or OIDC sign-in for customer organizations, and the single sign-on mentioned in the DPA is Groq's own internal access control.

## Where it fits, and where it does not

It fits an application that already speaks the OpenAI API and wants open-weight models answered fast, or a voice and transcription pipeline that can use Whisper at four cents an audio hour. It fits a team that wants per-project keys, per-project rate limits and model allowlists across development and production.

It does not fit a buyer who wants a frontier proprietary model, because Groq trains nothing and serves what is openly available. It does not fit a non-technical team: the path in is an API key and code. It does not fit a workload that must run in your own data center, since the models stay in Groq's cloud and reach you over the API. And it does not fit anyone who needs a committed uptime figure or an auditable record of administrative actions from the published material alone, because neither is documented.

## Groq price and terms

### Terms

- Free plan: Yes A standing Free tier with lower rate limits
- Card to start: Not required
- Sign up without sales: Yes

The terms in full

moving to the pay-as-you-go Developer tier requires a payment method and unlocks higher limits, Batch and Flex processing and spend limits. Groq publishes the Developer plan base limits (for example 30 requests per minute and 1,000 requests per day on openai/gpt-oss-120b) but not a separate Free tier table.

### For AI agents

- MCP server: No [console.groq.com, 19 October 2026](https://console.groq.com/docs/tool-use/remote-mcp)
- API: Yes [console.groq.com, 19 October 2026](https://console.groq.com/docs/overview)

[![Groq](https://agentsindex.ai/img/1024/screenshots/groq/pricing.webp)](https://agentsindex.ai/img/1920/screenshots/groq/pricing.webp)

Pricing page, captured 18 October 2026

[console.groq.com/docs/models](https://console.groq.com/docs/models), checked 19 October 2026

## What we checked on Groq

Yes Partly No

What it costs to start Yes

### Free to use

A standing Free tier exists and the billing FAQ treats it as the starting point you upgrade from and may return to at any time.

> To upgrade from the Free tier to the Developer tier, you'll need to provide a valid payment method (credit card, US bank account, or SEPA debit…

Upgrading to Developer Tier, first answer [console.groq.com/docs/billing-faqs](https://console.groq.com/docs/billing-faqs) Checked 19 October 2026

How you build with it Yes

### Public API

The product is an API: a documented OpenAI-compatible endpoint with official SDKs, so existing OpenAI client code works after a base URL change.

> Fast LLM inference, OpenAI-compatible. Simple to integrate, easy to scale. Start building in minutes.

Welcome section, opening line [console.groq.com/docs/overview](https://console.groq.com/docs/overview) Checked 19 October 2026

How you build with it No

### MCP server

Groq sits on the client side of MCP: the API connects out to remote MCP servers you name and executes their tools, and it publishes no MCP endpoint of its own for an assistant to call.

> Groq supports remote tool use via MCP servers, allowing you to simply point to an MCP server URL and the Groq API will start using its tools without…

Remote Tools and Model Context Protocol, opening paragraph [console.groq.com/docs/tool-use/remote-m…](https://console.groq.com/docs/tool-use/remote-mcp) Checked 19 October 2026

How you build with it No

### Open source

The platform is proprietary: Groq keeps all rights in the cloud services and the agreement forbids copying, reverse engineering or redistributing them.

> Groq retains all Intellectual Property Rights in the Cloud Services. Customer obtains only a limited right to access and use the Cloud Services.

Section 8.1, Intellectual Property Rights and Permissions [console.groq.com/docs/legal/services-ag…](https://console.groq.com/docs/legal/services-agreement) Checked 19 October 2026

## Groq alternatives

- [Fireworks AI](https://agentsindex.ai/fireworks-ai) · Inference, model routing and fine-tuning for open models on one OpenAI-compatible endpoint, serverless or in your cloud. · From $0.05 per 1m input tokens Checked 6 Nov · HIPAA SOC 2 · [Visit](https://agentsindex.ai/go/fireworks-ai)
  - MCP server: partly
  - API: yes
  - Open source: no
  - Self-host: partly
- Groq and Fireworks AI
  | Groq | Free, then $0.075 per 1m input tokens | 19 Oct |
  | --- | --- | --- |
  | [Fireworks AI](https://agentsindex.ai/fireworks-ai) | From $0.05 per 1m input tokens | 6 Nov |

## Questions about Groq

- How much does Groq cost?: Groq has a free plan. From console.groq.com/docs/models, checked 19 October 2026.
- Does Groq have an API or an MCP server?: Groq has an API. From console.groq.com/docs/overview, checked 19 October 2026. Groq has no MCP server. From console.groq.com/docs/tool-use/remote-mcp, checked 19 October 2026.
- Is Groq open source, and can you host it yourself?: Groq is not open source. From console.groq.com/docs/legal/services-agreement, checked 19 October 2026. You cannot host Groq yourself. From trust.groq.com/faq, checked 19 October 2026.
- What have we checked on Groq?: 4 facts, under these headings: What it costs to start, how you build with it.
- How do we check Groq?: We hold 4 facts on Groq, quoted from 14 pages. Facts and price last checked 19 October 2026. Last change found 1 April 2026.

[How we check every listing](https://agentsindex.ai/methodology)

## Sources and changes

Last changed 1 April 2026

Sources 14

- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/legal/services-agreement) /docs/legal/services-agreement
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/billing-faqs) /docs/billing-faqs
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/models) /docs/models
- Read 19 October 2026 · [trust.groq.com](https://trust.groq.com/faq) /faq
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/tool-use/remote-mcp) /docs/tool-use/remote-mcp
- Read 18 October 2026 · [console.groq.com](https://console.groq.com/docs/performance-tier) /docs/performance-tier
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/your-data) /docs/your-data
- Read 19 October 2026 · [trust.groq.com](https://trust.groq.com/) /
- Read 18 October 2026 · [console.groq.com](https://console.groq.com/docs/flutterflow) /docs/flutterflow
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/model-permissions) /docs/model-permissions
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/overview) /docs/overview
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/projects) /docs/projects
- Read 19 October 2026 · [console.groq.com](https://console.groq.com/docs/quickstart) /docs/quickstart
- Read 18 October 2026 · [console.groq.com](https://console.groq.com/docs/rate-limits) /docs/rate-limits

## Groq price history

Groq had a free plan, and paid plans from $0.075 per 1m input tokens, on both of our reads, from 18 October 2026 to 19 October 2026.

| Price | Plan | First seen | Last seen | Readings | Source |
| --- | --- | --- | --- | --- | --- |
| $0.075 per 1m input tokens | Cheapest paid plan | 18 October 2026 | 19 October 2026 | 2 | [Pricing page, read 18 October 2026](https://console.groq.com/docs/models) |

From our research, read twice since 18 October 2026. A date is when we read the page, not when the price changed.

## Similar to Groq

- [ERIUS PHONE](https://agentsindex.ai/eriusphone) Rented cloud Android phones, each in its own container, that keep an agent's apps and sign-ins between sessions. From about $44 a month
- [TinyFish](https://agentsindex.ai/tinyfish) Web search, page fetching, cloud browsers and goal-driven web automation for AI agents, with search and fetch free. Free plan, then $0.002 per minute
- [Smithery](https://agentsindex.ai/smithery) Public MCP server registry, now run by Arcade, listing direct vendor MCP URLs after its proxy shut down. Free plan
- [UI Discovery](https://agentsindex.ai/uidiscovery) A library of real websites, iOS apps and dashboards with each one's palette, fonts and original build prompt. From $20 a month

## Is Groq yours?

Free, and the page then carries the verified owner mark. You confirm it with an email at groq.com. [Claim this listing](https://agentsindex.ai/claim/groq?from=owner-line)

[Report an error](mailto:hello@agentsindex.ai?subject=Report%20an%20error%3A%20Groq%20(groq)&body=What%20is%20wrong%20on%20the%20page%2C%20and%20where%20on%20the%20product) if a fact is wrong.
