A fast Python proxy scraper and multi-threaded validator that pulls from 235 API sources and scrapes over 1.75 Million to 2.0 Million+ proxies in about 20 seconds.
Most proxy scrapers on GitHub only check 5 or 10 dead websites and give you a few hundred slow proxies.
This tool queries 235 active API sources and raw endpoints in parallel:
- Fetches 2,000,000+ proxies in ~20 seconds
- Automatically deduplicates into 1,750,000+ unique proxies
- ~618,000 HTTP / HTTPS proxies
- ~559,000 SOCKS4 proxies
- ~581,000 SOCKS5 proxies
- Tests them across multi-threaded worker pools with customizable latency thresholds
- Filters out proxies that are already banned on target platforms (Discord, Steam, Epic Games, TikTok, Cloudflare, etc.)
- 235 Scrape Sources: 130 HTTP sources, 52 SOCKS4 sources, and 53 SOCKS5 sources.
- Protocols Supported: HTTP, HTTPS, SOCKS4, SOCKS5.
- Fast Multi-Processing Engine: Windows-optimized using
spawn+ thread pools to bypass GIL limits. - Quality Filter Tiers:
1ULTIMATE (Strict): 3s timeout, <1500ms max speed (keeps only the fastest proxies)2MEDIUM (Balanced): 6s timeout, <3500ms max speed3DEFAULT (Recommended): 8s timeout, <6000ms max speed4LOW (Catch-All): 15s timeout, <12000ms max speed5CUSTOM: Set your own threads, timeout, max latency, and retry counts
- Target Ban / Blacklist Filter: Optional post-check test to ensure your working proxies are not blocked by Discord, Steam, Epic Games, TikTok, Instagram, Twitter/X, Roblox, or Cloudflare.
- Check Custom Files: Load your own raw proxy file (
.txt) and validate it across any protocol. - Clean File Exports: Saves working proxies into
working_http_YYYY-MM-DD.txt,working_socks4_YYYY-MM-DD.txt,working_socks5_YYYY-MM-DD.txt, or combined.
Double click setup.bat. It will set up the virtual environment, install requirements (requests, PySocks, rich), and launch the tool.
git clone https://github.com/zyrexdz/proxy-scraper-checker.git
cd proxy-scraper-checker
chmod +x setup.sh && ./setup.shpip install -r requirements.txt
python main.py- Python 3.9+
requests,PySocks,rich,urllib3
MIT
