Universal Dynamic Curated DirectoryUDCD MVP
← Back to home Archive

Crawl4AI

Local, self-hosted, LLM-friendly web crawler

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

AI Crawlers

GitHub

Last updated: 2026-10-11T07:10:00.949983+00:00

Evidence Chain

FieldValueSourceTierFetchedConfidence
archived No https://api.github.com/repos/unclecode/crawl4ai 1 2026-10-11T07:10:00.949983+00:00 0.99
description Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. https://api.github.com/repos/unclecode/crawl4ai 1 2026-10-11T07:10:00.949983+00:00 0.99
license Apache-2.0 https://api.github.com/repos/unclecode/crawl4ai 1 2026-10-11T07:10:00.949983+00:00 0.99
open_issues 237 https://api.github.com/repos/unclecode/crawl4ai 1 2026-10-11T07:10:00.949983+00:00 0.99
page_title GitHub - unclecode/crawl4ai: Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. https://github.com/unclecode/crawl4ai 2 2026-10-11T07:10:00.949983+00:00 0.9
pushed_at 2026-10-11T06:06:31Z https://api.github.com/repos/unclecode/crawl4ai 1 2026-10-11T07:10:00.949983+00:00 0.99
stars 85174 https://api.github.com/repos/unclecode/crawl4ai 1 2026-10-11T07:10:00.949983+00:00 0.99
topics ai, ai-agents, crawler, data-extraction, llm, markdown, mcp, open-source, playwright, python, rag, scraper, web-crawler, web-crawling, web-scraping https://api.github.com/repos/unclecode/crawl4ai 1 2026-10-11T07:10:00.949983+00:00 0.99