ai crawler

Firecrawl / Firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

ScrapeGraphAI / Scrapegraph Ai

Python scraper based on AI

BrowserCash / Teracrawl

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown