SoftPickscrawler
A collection of awesome web crawler,spider in different languages
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on
An ergonomic Rust HTTP Client with TLS fingerprint
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or
A framework for creating semi-automatic web content extractors
Lightweight scraper for Google News
Library for Rapid (Web) Crawler and Scraper Development
Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server
Web Data Scraper - no-code internet scraping. Extract and export to CSV, Excel, JSON, Google Sheets,
Powerful web scraping framework for Crystal