# Crawl4AI

> Source: https://agentsindex.ai/crawl4ai

A crawler for clean Markdown and typed JSON extraction from pages for RAG pipelines.

- Best for: Developers who need LLM-ready web data with browser control and self-hosting.

Starting price

Free

Paid plans from **$10 a month**

From [crawl4ai.com/#pricing](https://crawl4ai.com/#pricing), checked 8 November 2026

Paid plans in Agent tools and integrations

**#6** cheapest of 46

**$30** median a month

Cheapest $3, median $30 Priciest $650

- **5** cheaper
- **0** same price
- **40** pricier

Cheaper than 40 of the other 45 with a monthly price in agent tools and integrations.

Vendor pricing pages as of 20 November 2026 n = 46 with a monthly price [All 98 in agent tools and integrations](https://agentsindex.ai/categories/agent-tools-and-integrations)

- MCP server Yes Checked by us api.crawl4ai.com/.well-known/oauth-protected-resource, 15 November 2026 [Checked by us](https://api.crawl4ai.com/.well-known/oauth-protected-resource)
- API Yes From crawl4ai.com/docs, 29 October 2026 [crawl4ai.com](https://crawl4ai.com/docs)
- Open source Yes Checked by us github.com/unclecode/crawl4ai/blob/main/LICENSE, 15 November 2026 [Checked by us](https://github.com/unclecode/crawl4ai/blob/main/LICENSE)
- Self-host Yes

- GitHub stars: 85.6k

[Docs](https://docs.crawl4ai.com/) [GitHub](https://github.com/unclecode/crawl4ai)

[Visit Crawl4AI](https://agentsindex.ai/go/crawl4ai) [Compare](https://agentsindex.ai/compare?cat=agent-tools-and-integrations&products=crawl4ai)

What we checked

- Pages last read: 15 November 2026
- Facts checked: 5 facts · From 8 sources
- AI answers: Too few read · 58 buyer-question answers read, November 2026

[How we check](https://agentsindex.ai/methodology) [Editorial policy](https://agentsindex.ai/editorial-policy#not-for-sale)

## At a glance

- Category: [Agent tools and integrations](https://agentsindex.ai/categories/agent-tools-and-integrations)
- Tags: Open source, Self-hosted

### Code

- Last push: 15 October 2026

### For developers

- Works with: Claude, Cursor, Windsurf

## What is Crawl4AI?

Crawl4AI is an open-source web crawling tool for developers who need LLM-ready data with browser control and self-hosting. It combines Generate Clean Markdown, Structured Extraction, Advanced Browser Control, and Adaptive Crawling, with hooks, proxies, stealth modes, and session reuse for harder pages. It integrates with CSS/XPath and LLM-based extraction paths, and the project is documented around AsyncWebCrawler workflows. The repo shows 65.7k GitHub stars and 6.7k forks.

## What it actually does well

Crawl4AI is an async Python crawler (Playwright-based, also usable via a CLI or a Docker/FastAPI server) built specifically for feeding LLMs and RAG pipelines rather than general-purpose scraping. Its markdown generator applies heuristic content filtering (a pruning filter and a BM25 filter keyed to a query) to strip nav/boilerplate before the page ever reaches an LLM, and it ships three extraction paths — CSS/XPath schemas, LLM-based extraction against a Pydantic schema, and a table-specific LLM extractor with automatic chunking for large tables. Version 0.7.0 added 'adaptive crawling', which stops crawling a site once an information-sufficiency threshold is met rather than exhausting a fixed page budget, and 0.8.0 added crash-recoverable deep crawls (BFS/DFS/best-first with resumable state). It needs no API key or account to use at all — everything runs on infrastructure you control.

## Adoption and maintenance

The PyPI package (github.com/unclecode/crawl4ai) has been downloaded 18.5 million times all-time and 1.64 million times in the trailing 30 days (pepy.tech/projects/crawl4ai, checked today); the Docker image has 3.21 million pulls (Docker Hub API). Development is active day-to-day, not just at release time, against a steady release cadence (v0.9.0 on 18 June 2026, v0.9.1 on 8 July 2026, v0.9.2 on 15 July 2026). This is a genuinely live, high-traffic project, not an abandoned star-farm.

## The Docker API's security history

If you self-host the Docker deployment (rather than the plain pip library), know that it has twice shipped a critical, unauthenticated remote-code-execution flaw with a maximum CVSS score of 10.0. CVE-2026-26216 (disclosed Jan 2026, fixed in v0.8.0) let an unauthenticated caller smuggle Python code into the `/crawl` endpoint's `hooks` parameter and run arbitrary system commands via `exec()`. CVE-2026-57572 (disclosed mid-2026, fixed in v0.9.0) let an unauthenticated caller inject Chromium launch switches through `browser_config.extra_args` to spawn an attacker-controlled process — a partial denylist fix in v0.8.9 didn't fully close it. Both are documented candidly in the project's own SECURITY.md, which also lists a third fixed deserialization RCE (v0.8.1) and commits to a 48-hour acknowledgment and severity-tiered fix timeline. v0.9.0 (18 June 2026) changed the default posture: the Docker API now requires authentication and binds to loopback unless a token is explicitly configured, rather than shipping open by default. (Sources: github.com/advisories/GHSA-5882-5rx9-xgxp, ionix.io/threat-center/cve-2026-57572, github.com/unclecode/crawl4ai/blob/main/SECURITY.md)

## Cost and what's actually priced

The library and Docker image are free under Apache 2.0 — no seat fees, no usage caps, no account required. The project's only current monetization is GitHub Sponsors, with published tiers from $5/month (support the project) to $2,000/month (a 'Data Infrastructure Partner' tier with dedicated support) — these buy sponsor recognition and, at higher tiers, direct maintainer access, not product features (github.com/sponsors/unclecode). A hosted 'Crawl4AI Cloud API' is announced as a closed beta with no public pricing; access is by application through a Google Form, and the vendor's own framing — 'drastically more cost-effective than any of the existing solutions' — is an unverified marketing claim with no numbers behind it yet.

## Who's behind it, and what that means for continuity

Crawl4AI is led by Hossein Tohidi ('Unclecode' on GitHub/X), who is also the founder of Kidocode, an ed-tech company that appears in Crawl4AI's own sponsor list as a Gold-tier sponsor (github.com/unclecode/crawl4ai README). We found no evidence of institutional (VC) funding behind Crawl4AI itself, and no public information on team size beyond the maintainer and a small number of named contributors thanked in SECURITY.md. This is, as far as we can establish, a single-founder open-source project rather than a funded company — which is consistent with its extremely active commit history but also means there is no established institutional continuity plan if the maintainer stops.

## One thing to check before you rely on their attribution language

The README states that using Crawl4AI 'requires' one of two attribution methods — a badge or a text credit — in your own documentation or product. The Apache 2.0 license itself (github.com/unclecode/crawl4ai/blob/main/LICENSE) only obligates preserving existing copyright and license notices when you redistribute the licensed source; it does not require a public 'powered by' badge on a downstream product built with the library. Teams with legal review processes should treat this as the maintainer's request, not a license term, when deciding whether to comply.

## Independent reviews are thin

We could not find neutral, non-vendor-authored comparisons of Crawl4AI. Most comparison content found in search (Apify's blog, Bright Data's blog, Firecrawl's own 'alternatives' page, spider.cloud's benchmark post) is published by a competing scraping vendor and should be read as competitor marketing, not independent testing. We found no rating on Trustpilot, G2, or a comparable independent review site.

Our take

Check whether your target sites require the browser-level controls in the docs, such as proxies, stealth modes, or session reuse. If your crawl depends on those behaviors, verify they work on your pages before committing to a self-hosted setup.

## Crawl4AI price and terms

### Terms

- Free plan: Yes

The terms in full

The Free hosted plan is presented as a standing no-card plan with 1,000 credits per month, 10 requests per minute, and two concurrent requests.

### For AI agents

- MCP server: Yes [Checked by us, 15 November 2026](https://api.crawl4ai.com/.well-known/oauth-protected-resource)
- API: Yes [crawl4ai.com, 29 October 2026](https://crawl4ai.com/docs)

[Developer docs](https://docs.crawl4ai.com/)

Where these prices come from

[crawl4ai.com](https://crawl4ai.com/#pricing), checked 8 November 2026

### All plans and limits

| Plan | Price | Concurrency | Credits | Rate limit |
| --- | --- | --- | --- | --- |
| Free | $0 a month | 2 at a time | 1,000 every month | 10 a minute requests/minute |
| Starter | $10 a month | 10 at a time | 10,000 a month | 120 a minute requests/minute |
| Builder | $99 a month | 20 at a time | 125,000 a month | 600 a minute requests/minute |
| Scale | $499 a month | 50 at a time | 750,000 a month | 1,500 a minute requests/minute |
| Enterprise | Price on request | Not stated | Not stated | Not stated |

Read 6 November 2026 from [crawl4ai.com](https://crawl4ai.com/).

## What we checked on Crawl4AI

Yes Partly No

What it costs to start Partly

### What the price counts

The hosted offering combines fixed monthly plan charges with included credits and separately priced extra credits.

> Money enters through a monthly plan, and extra credits on a plan.

Pricing section, introductory billing description [crawl4ai.com/docs](https://crawl4ai.com/docs#pricing) Checked 29 October 2026

What it costs to start Yes

### Free to use

A standing hosted Free plan costs nothing, and the self-hosted crawler is also available without payment.

> $0 · no card

Pricing table, Free plan price cell [crawl4ai.com](https://crawl4ai.com/#pricing) Checked 29 October 2026

How you build with it Yes

### Public API

The hosted service documents an authenticated HTTP interface for crawling, extraction, search, and related operations.

> One key, plain JSON, one fast endpoint.

API reference introduction [crawl4ai.com/docs](https://crawl4ai.com/docs) Checked 29 October 2026

How you build with it Yes

### MCP server

MCP server at api.crawl4ai.com, behind OAuth sign-in

> https://api.crawl4ai.com/mcp

OAuth protected-resource metadata, "resource" [api.crawl4ai.com/.well-known/oauth-prot…](https://api.crawl4ai.com/.well-known/oauth-protected-resource) Checked by us, 15 November 2026

How you build with it Yes

### Open source

Apache-2.0 licence in its public repository

> Apache License Version 2.0

LICENSE in github.com/unclecode/crawl4ai [github.com/unclecode/crawl4ai/blob/main…](https://github.com/unclecode/crawl4ai/blob/main/LICENSE) Checked by us, 15 November 2026

## Crawl4AI alternatives

- [TinyFish](https://agentsindex.ai/tinyfish) · The team behind TinyFish runs this listing · Web search, page fetching, cloud browsers and goal-driven web automation for AI agents, with search and fetch free. · Free, then $0.002 per minute Checked 19 Nov · ISO 27001 · [Visit](https://agentsindex.ai/go/tinyfish)
  - MCP server: yes
  - API: yes
  - Open source: no
  - Self-host: partly
- Crawl4AI and TinyFish
  | Crawl4AI | Free, then $10 a month | 29 Oct |
  | --- | --- | --- |
  | [TinyFish](https://agentsindex.ai/tinyfish) | Free, then $0.002 per minute | 19 Nov |

## Questions about Crawl4AI

- How much does Crawl4AI cost?: Crawl4AI has a free plan. Its paid plans include Starter at $10 a month, Builder at $99 a month and Scale at $499 a month. From crawl4ai.com/#pricing, checked 8 November 2026.
- Does Crawl4AI have an API or an MCP server?: Crawl4AI has an API. From crawl4ai.com/docs, checked 29 October 2026. Crawl4AI has an MCP server. We checked api.crawl4ai.com/.well-known/oauth-protected-resource ourselves on 15 November 2026.
- Is Crawl4AI open source, and can you host it yourself?: Crawl4AI is open source. We checked github.com/unclecode/crawl4ai/blob/main/LICENSE ourselves on 15 November 2026. You can host Crawl4AI yourself.
- What have we checked on Crawl4AI?: 5 facts, under these headings: What it costs to start, how you build with it.
- How do we check Crawl4AI?: We hold 5 facts on Crawl4AI, quoted from 8 pages. Facts last checked 15 November 2026. Price last checked 8 November 2026. Last change found 15 November 2026.

[How we check every listing](https://agentsindex.ai/methodology)

## Sources and changes

Last full check 8 November 2026

Sources on crawl4ai.com 6

- Read 5 November 2026 · [/](https://crawl4ai.com/)
- Read 29 October 2026 · [/](https://crawl4ai.com/#pricing)
- Read 29 October 2026 · [/](https://crawl4ai.com/#self-host)
- Read 29 October 2026 · [/docs](https://crawl4ai.com/docs#pricing)
- Read 29 October 2026 · [/docs](https://crawl4ai.com/docs)
- Read 29 October 2026 · [/docs](https://crawl4ai.com/docs#mcp)

What changed 1

- 15 November 2026 What it does

Repository

- Licence: Apache-2.0
- Stars: 85,621
- Last push: 15 October 2026

## Crawl4AI price history

Crawl4AI had a free plan, and paid plans from $10 a month, on all 4 of our reads, from 29 October 2026 to 8 November 2026.

| Price | Plan | First seen | Last seen | Readings | Source |
| --- | --- | --- | --- | --- | --- |
| $10 a month | Cheapest paid plan | 29 October 2026 | 8 November 2026 | 4 | [Pricing page, read 29 October 2026](https://crawl4ai.com/#pricing) |

From our research, read twice since 29 October 2026, and 2 of our own checks since 30 October 2026. 2 more of our checks could not pick this price out of the page and are left out. A date is when we read the page, not when the price changed.

## Similar in Agent tools and integrations

[See all in Agent tools and integrations](https://agentsindex.ai/categories/agent-tools-and-integrations)

- [ERIUS PHONE](https://agentsindex.ai/eriusphone) Rented cloud Android phones, each in its own container, that keep an agent's apps and sign-ins between sessions. From about $44 a month
- [ClineFlow](https://agentsindex.ai/clineflow) Git-native project memory and handoffs for coding agents. Free plan
- [Smithery](https://agentsindex.ai/smithery) Public MCP server registry, now run by Arcade, listing direct vendor MCP URLs after its proxy shut down. Free plan
- [UI Discovery](https://agentsindex.ai/uidiscovery) A library of real websites, iOS apps and dashboards with each one's palette, fonts and original build prompt. From $20 a month

## From our research

[All research](https://agentsindex.ai/blog)

- [Data table](https://agentsindex.ai/data/healthcare-ai-agents-security) 17 Nov 2026 Healthcare AI agents: SOC 2, ISO 27001, GDPR and SSO
- [Data table](https://agentsindex.ai/data/sales-agents-security) 17 Nov 2026 Sales agents: SOC 2, ISO 27001, GDPR and SSO
- [Data study](https://agentsindex.ai/data/what-ai-cites-on-ai-tools) November 2026 91% of pages cited by AI on AI tools weren’t product sites

## Is Crawl4AI yours?

Free, and the page then carries the verified owner mark. You confirm it with an email at crawl4ai.com. [Claim this listing](https://agentsindex.ai/claim/crawl4ai?from=owner-line)

[Report an error](mailto:hello@agentsindex.ai?subject=Report%20an%20error%3A%20Crawl4AI%20(crawl4ai)&body=What%20is%20wrong%20on%20the%20page%2C%20and%20where%20on%20the%20product) if a fact is wrong.
