Skip to content

Dependency overhaul#183

Merged
tokebe merged 14 commits into
mainfrom
dependency-overhaul
Jun 8, 2026
Merged

Dependency overhaul#183
tokebe merged 14 commits into
mainfrom
dependency-overhaul

Conversation

@tokebe

@tokebe tokebe commented Jun 7, 2026

Copy link
Copy Markdown
Contributor

Completely overhauls dependency handling such that Retriever is able to catch and report dependency outages and contine trucking without them as best it can.

Highlights:

  • Fallback from one tier to another (disableable)
  • /asyncquery handling even when job state storage is unavailable
  • Optable management when Redis is down
  • Warnings all around
  • HTTP 424 when an endpoint is truly unavailable (with dependency outage details in response)
  • /monitor endpoint for a visual overview of status and jobs
  • Various fixes

@sentry

sentry Bot commented Jun 7, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 37.71323% with 1351 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
src/retriever/utils/mongo.py 32.64% 328 Missing ⚠️
src/retriever/status.py 27.01% 208 Missing ⚠️
src/retriever/utils/redis.py 27.16% 126 Missing ⚠️
src/retriever/metadata/optable.py 17.35% 100 Missing ⚠️
src/retriever/server.py 0.00% 68 Missing ⚠️
src/retriever/utils/backend_client.py 60.27% 54 Missing and 4 partials ⚠️
src/retriever/query.py 49.54% 52 Missing and 4 partials ⚠️
src/retriever/data_tiers/tier_0/gandalf/driver.py 24.61% 49 Missing ⚠️
src/retriever/utils/orphan_detection.py 0.00% 48 Missing ⚠️
src/retriever/lookup/lookup.py 16.00% 42 Missing ⚠️
... and 18 more
Files with missing lines Coverage Δ
src/retriever/config/general.py 96.06% <100.00%> (+3.32%) ⬆️
src/retriever/config/openapi.py 87.64% <100.00%> (+0.14%) ⬆️
src/retriever/data_tiers/base_driver.py 100.00% <100.00%> (+4.34%) ⬆️
src/retriever/types/general.py 100.00% <100.00%> (ø)
src/retriever/types/status.py 100.00% <100.00%> (ø)
src/retriever/types/trapi_pydantic.py 100.00% <100.00%> (ø)
src/retriever/utils/logs.py 45.87% <50.00%> (ø)
src/retriever/data_tiers/tier_0/base_query.py 32.65% <0.00%> (-0.69%) ⬇️
src/retriever/lookup/utils.py 27.94% <33.33%> (+1.07%) ⬆️
src/retriever/metadata/trapi_metakg.py 53.84% <33.33%> (+3.84%) ⬆️
... and 24 more
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@tokebe tokebe merged commit f4aca36 into main Jun 8, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant