SoftPicksScrapers & Parsers
Explore the highest-rated open-source web scraping tools and data extraction scripts. Sorted by GitHub authority, core language, and update frequency.
Helios (was) my first unblockable attempt at a fully static, serviceworkerless proxy. It has since
A desktop app for tracking and batch downloading anime
Free trial Web Unblocker - an AI-powered proxy solution that can bypass even the most sophisticated
Library for Rapid (Web) Crawler and Scraper Development
Lightweight scraper for Google News
This repository contains a script to scrape Facebook Marketplace data using Playwright,
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown
A framework for creating semi-automatic web content extractors
Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.
100% free and full open-source edge Firecrawl alternative with better links extraction for agents -
A universal web-util for PHP.
AI Scraper is a powerful scraping tool and scrape agent built to automate data extraction with
A list of scrapers from around the web.
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or
An ergonomic Rust HTTP Client with TLS fingerprint
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets,
Bulk download your favourite anime episodes from your favourite anime websites
:rocket: Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on
Web Scraper in Go, similar to BeautifulSoup
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
Self-hosted webscraper.
A collection of awesome web crawler,spider in different languages
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub,