unclecode/crawl4ai

开源的用于LLMs和AI代理的网页爬虫和抓取工具：将任何网站转换为干净的、LLM就绪的Markdown格式。自行运行，或使用Crawl4AI Cloud，只需一个密钥即可。

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.