Skip to content

Repository files navigation

Zyre Proxy Scraper & Checker v2.0

A fast Python proxy scraper and multi-threaded validator that pulls from 235 API sources and scrapes over 1.75 Million to 2.0 Million+ proxies in about 20 seconds.

Zyre Proxy Scraper Demo

Why use this

Most proxy scrapers on GitHub only check 5 or 10 dead websites and give you a few hundred slow proxies.

This tool queries 235 active API sources and raw endpoints in parallel:

  • Fetches 2,000,000+ proxies in ~20 seconds
  • Automatically deduplicates into 1,750,000+ unique proxies
    • ~618,000 HTTP / HTTPS proxies
    • ~559,000 SOCKS4 proxies
    • ~581,000 SOCKS5 proxies
  • Tests them across multi-threaded worker pools with customizable latency thresholds
  • Filters out proxies that are already banned on target platforms (Discord, Steam, Epic Games, TikTok, Cloudflare, etc.)

Features

  • 235 Scrape Sources: 130 HTTP sources, 52 SOCKS4 sources, and 53 SOCKS5 sources.
  • Protocols Supported: HTTP, HTTPS, SOCKS4, SOCKS5.
  • Fast Multi-Processing Engine: Windows-optimized using spawn + thread pools to bypass GIL limits.
  • Quality Filter Tiers:
    • 1 ULTIMATE (Strict): 3s timeout, <1500ms max speed (keeps only the fastest proxies)
    • 2 MEDIUM (Balanced): 6s timeout, <3500ms max speed
    • 3 DEFAULT (Recommended): 8s timeout, <6000ms max speed
    • 4 LOW (Catch-All): 15s timeout, <12000ms max speed
    • 5 CUSTOM: Set your own threads, timeout, max latency, and retry counts
  • Target Ban / Blacklist Filter: Optional post-check test to ensure your working proxies are not blocked by Discord, Steam, Epic Games, TikTok, Instagram, Twitter/X, Roblox, or Cloudflare.
  • Check Custom Files: Load your own raw proxy file (.txt) and validate it across any protocol.
  • Clean File Exports: Saves working proxies into working_http_YYYY-MM-DD.txt, working_socks4_YYYY-MM-DD.txt, working_socks5_YYYY-MM-DD.txt, or combined.

Quick Start

1. Windows (Easiest)

Double click setup.bat. It will set up the virtual environment, install requirements (requests, PySocks, rich), and launch the tool.

2. Linux / macOS

git clone https://github.com/zyrexdz/proxy-scraper-checker.git
cd proxy-scraper-checker
chmod +x setup.sh && ./setup.sh

3. Manual Python Run

pip install -r requirements.txt
python main.py

Requirements

  • Python 3.9+
  • requests, PySocks, rich, urllib3

License

MIT

About

Fast multi-threaded proxy scraper and checker pulling 1.7M+ proxies from 235 API sources with SOCKS4/5/HTTP support and ban filters.

Topics

Resources

Stars

2 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages