Open Library book catalog bulk harvester grouped onto the harvestkit resumable-harvest engine. Extracted from metadatarr's scraper collection into its own standalone package.
| Scraper | Registry name | Source |
|---|---|---|
openlibrary_books |
openlibrary_books |
Open Library /search.json, 60+ subject seeds |
pip install pyopenlibrary
# or, for the HuggingFace publisher (via harvestkit):
pip install "pyopenlibrary[hf]"
# or, for Cloudflare-guarded sources:
pip install "pyopenlibrary[stealth]"# list every registered scraper
pyopenlibrary-harvest --list
# harvest one source (resumable — safe to Ctrl-C and rerun)
pyopenlibrary-harvest openlibrary_books --output ~/.cache/metadatarr/scrapers/Every scraper is a harvestkit.engine.Source subclass: checkpoint/dedup/
pagination/throttle are handled by the shared engine, each module only
answers initial_cursor() and fetch(cursor). See
harvestkit for the full engine
API.
Apache-2.0