Skip to content

release: the 0.4.7 wheel and sdist are missing the entire openagent_eval.reports subpackage — oaeval unusable #233

Description

@Nitjsefnie

Found while updating the #188 notebook to 0.4.7 as requested on #226. The v0.4.7 release artifacts on PyPI are broken:

pip install openagent-eval==0.4.7
oaeval --help
# File .../openagent_eval/cli/commands/compare.py, line 14
#   from openagent_eval.reports.base import ExperimentComparison
# ModuleNotFoundError: No module named 'openagent_eval.reports'

Every CLI command dies at import (--help, --version, doctor/init/run/…). Evidence it's a packaging regression, not source:

  • The PyPI wheel has zero reports/ entries (unzip -l openagent_eval-0.4.7-py3-none-any.whl | grep -c reports/ → 0); the sdist likewise; dist-info/RECORD has none.
  • The git tag v0.4.7 source tree has all 9 reports/ files, and pyproject.toml's hatch packaging config is byte-identical between v0.4.6 and v0.4.7 — so the drop happened in the release build/publish environment, not in source or config.
  • The 0.4.6 wheel DOES ship reports/ — this is new in 0.4.7.

Practical impact: 0.4.7 is strictly worse than 0.4.6's #227 (the missing-reports import fires before the pytest import ever would). The SDK path (openagent_eval.core.Engine) still works — Engine doesn't import reports.

Suggest yanking 0.4.7 on PyPI and publishing a rebuilt 0.4.8 from a clean checkout; happy to re-verify the artifacts the moment it's up (the check is: pytest-free venv → pip install, python -c 'import openagent_eval.reports.base', oaeval --help).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions