Skip to content

fix: list Extract in the PyPI summary and keywords - #42

Merged
jonathan-zenrows merged 4 commits into
mainfrom
fix/extract-pypi-metadata
Oct 14, 2026
Merged

jonathan-zenrows merged 4 commits into
mainfrom
fix/extract-pypi-metadata

Conversation

@jonathan-zenrows

Copy link
Copy Markdown
Contributor

Replaces #40, which closed when its branch was renamed.

What

  • PyPI summary: "ZenRows Python SDK: synchronous scraping + Batch (async job) API" becomes "Zenrows Python SDK: Fetch, Extract (structured data), Batch and Crawl APIs".
  • Keywords: add extract, structured-data, web-scraping, crawl.
  • The extract() docstring and its tests no longer describe mode="auto" as a gated beta. The docstring documents 403 REQS007 for a domain that isn't prepared yet, and how to prepare one (POST /v1/extract/prepared-domains).
  • Extract is no longer labelled beta in the README or the extract() docstring. It is generally available.
  • The README's Extract link points at the Extract docs instead of the docs home.

Why

The 1.6.0 page on PyPI undersells the package: the summary and keywords leave Extract out, and the docs describe a gate and a beta status that no longer apply. See https://docs.zenrows.com/extract/introduction.

Testing

  • pytest: 229 passed
  • make lint and make check clean
  • uv build sdist PKG-INFO shows the new Summary and Keywords

After merge

Cut a patch release so PyPI shows the new metadata. #41 rewrites the same extract() docstring paragraph, so whichever merges second needs a small rebase.

🤖 Generated with Claude Code

jonathan-zenrows and others added 4 commits October 13, 2026 15:36
The PyPI summary still read "synchronous scraping + Batch (async job) API"
and the keywords left Extract out, so the package page undersold what 1.6.0
ships. Name Fetch, Extract, Batch and Crawl in the summary and add extract,
structured-data, web-scraping and crawl to the keywords.

Drop "domain-gated open beta" from the extract() docstring and its tests:
Extract has worked on any prepared domain with any active key since the
gate was removed. Point the README's Extract link at the Extract docs.

The new metadata reaches PyPI on the next release.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Extract is generally available, but the README and the extract()
docstring still labelled it beta. Drop the label.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… README

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@jonathan-zenrows
jonathan-zenrows merged commit 83e4ec6 into main Oct 14, 2026
1 check passed
@jonathan-zenrows
jonathan-zenrows deleted the fix/extract-pypi-metadata branch October 14, 2026 06:34
@linear

linear Bot commented Oct 19, 2026

Copy link
Copy Markdown

MAG-512

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants