Found while updating the #188 notebook to 0.4.7 as requested on #226. The v0.4.7 release artifacts on PyPI are broken:
pip install openagent-eval==0.4.7
oaeval --help
# File .../openagent_eval/cli/commands/compare.py, line 14
# from openagent_eval.reports.base import ExperimentComparison
# ModuleNotFoundError: No module named 'openagent_eval.reports'
Every CLI command dies at import (--help, --version, doctor/init/run/…). Evidence it's a packaging regression, not source:
- The PyPI wheel has zero
reports/ entries (unzip -l openagent_eval-0.4.7-py3-none-any.whl | grep -c reports/ → 0); the sdist likewise; dist-info/RECORD has none.
- The git tag v0.4.7 source tree has all 9
reports/ files, and pyproject.toml's hatch packaging config is byte-identical between v0.4.6 and v0.4.7 — so the drop happened in the release build/publish environment, not in source or config.
- The 0.4.6 wheel DOES ship
reports/ — this is new in 0.4.7.
Practical impact: 0.4.7 is strictly worse than 0.4.6's #227 (the missing-reports import fires before the pytest import ever would). The SDK path (openagent_eval.core.Engine) still works — Engine doesn't import reports.
Suggest yanking 0.4.7 on PyPI and publishing a rebuilt 0.4.8 from a clean checkout; happy to re-verify the artifacts the moment it's up (the check is: pytest-free venv → pip install, python -c 'import openagent_eval.reports.base', oaeval --help).
Found while updating the #188 notebook to 0.4.7 as requested on #226. The v0.4.7 release artifacts on PyPI are broken:
Every CLI command dies at import (
--help,--version, doctor/init/run/…). Evidence it's a packaging regression, not source:reports/entries (unzip -l openagent_eval-0.4.7-py3-none-any.whl | grep -c reports/→ 0); the sdist likewise;dist-info/RECORDhas none.reports/files, andpyproject.toml's hatch packaging config is byte-identical between v0.4.6 and v0.4.7 — so the drop happened in the release build/publish environment, not in source or config.reports/— this is new in 0.4.7.Practical impact: 0.4.7 is strictly worse than 0.4.6's #227 (the missing-reports import fires before the pytest import ever would). The SDK path (
openagent_eval.core.Engine) still works — Engine doesn't import reports.Suggest yanking 0.4.7 on PyPI and publishing a rebuilt 0.4.8 from a clean checkout; happy to re-verify the artifacts the moment it's up (the check is: pytest-free venv →
pip install,python -c 'import openagent_eval.reports.base',oaeval --help).