Unclecode Crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

What you get

Unclecode Crawl4ai is a free, open-source AI agent framework published on GitHub by unclecode. Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. GitHub stars: 86,022 License: Apache-2.0 (free to use) Language: Python Topics: ai, ai-agents, crawler, data-extraction, llm, markdown, mcp, open-source Last updated: 2026-10-21 How to get it: open the repository on GitHub, read the README and follow the setup steps. HEEEXY lists it in the Lab because it is popular, actively maintained and openly licensed.

More for ai agents

  • Browser Use: Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
  • Deepseek Harness: DeepSeek Harness: Everything is a Plugin.
  • Langchain: The agent engineering platform.