Repository navigation
Closed
Labels
approved-directionhive/claimed-by-scannerhive/partially-addressedA merged PR addressed only part of this issue; remainder still actionableA merged PR addressed only part of this issue; remainder still actionablehive/verified-openhive/workflows-laneHive: routed to the lane that can push workflow filesHive: routed to the lane that can push workflow filestriage/acceptedScope accepted; ready for work. Use `/triage accepted`.Scope accepted; ready for work. Use `/triage accepted`.
Description
Problem
A read-only coverage audit against shipping refs found that several runs can report success without exercising the image under test:
tests/common/features/environment.pyselected@bluefincoverage only for image names containingbluefinorbazzite. Utah release gates and common PR e2e (ghcr.io/projectbluefin/common:e2e-pr-*) therefore skipped every common feature, although common PR e2e overlays common'ssharedandbluefintrees and Utah is Bluefin built on Fedora Hummingbird.tests/smoke/features/environment.pyread onlyIMAGE. With the defaultcompose_image: true,IMAGEisghcr.io/<owner>/testsuite-e2e:run-<id>, so smoke skipped@bluefinand@dakota_onlyscenarios. The GUI runner container also did not receiveBASE_IMAGE..github/workflows/e2e.ymldid not applyscripts/assert_passed.pytocommon, so an all-skipped common shard could pass.
Proposed fix
- Use one shared image-family helper for common and smoke.
- Read
BASE_IMAGEbeforeIMAGE, and passBASE_IMAGEinto the GUI runner container. - Treat
bluefin,bazzite,utah, andcommonimage names as Bluefin-family; keep Dakota separate. - Require at least one passing common scenario.
- Update the affected skill guidance and add regression coverage.
Local evidence
ruff check tests/ --select E,F,W --ignore E501python -m pytest tests/unit/ -q: 2,463 passedpython scripts/validate_docs.pypython scripts/generate_skill_index.py --checkbehave --dry-run --no-summary tests/common/features
behave --dry-run tests/smoke/features fails locally on both main and the fix with the same 28 undefined qecore built-in steps; it needs the Fedora runner image.
Required VM validation
Run manual.yml from the branch with test_ref set to the branch head SHA and digest-pinned images for Dakota, Bluefin, Utah, and the relevant common candidate. Inspect scenario-level results for skip reasons, not just job conclusions.
Impact
The common-shard gate may correctly turn previously green runs red when a shard executes no passing scenario. This is intended: such runs do not establish coverage.
Assisted-by: GPT-6.1-Sol via omp
Metadata
Metadata
Assignees
Labels
approved-directionhive/claimed-by-scannerhive/partially-addressedA merged PR addressed only part of this issue; remainder still actionableA merged PR addressed only part of this issue; remainder still actionablehive/verified-openhive/workflows-laneHive: routed to the lane that can push workflow filesHive: routed to the lane that can push workflow filestriage/acceptedScope accepted; ready for work. Use `/triage accepted`.Scope accepted; ready for work. Use `/triage accepted`.
Activity
fix(e2e): keep variant selection valid across runner and shards
fix(smoke): scope Bluefin extension defaults by source contract
fix(e2e): pass matrix inputs through environment
test(smoke): align exposed variant coverage with shipping images
fix(software): assert parsed Flatpak override values
fix(software): target Bazaar with bounded GUI checks
fix(software): use valid Bazaar input and image applicability
docs(e2e): document Bluefin-family Flatpak preload scope
fix(software): make Bazaar GUI preconditions explicit
fix(software): dismiss Bluefin welcome modal via its Escape binding
fix(software): read Bazaar search entry role
fix(software): activate Bazaar and use original image applicability
castrojo commentedon Oct 31, 2026
Coverage audit status
Family-gate branch:
fix/coverage-family-gatesRuntime-tested at
d2fbbf3d. HEADd5953e8aadds documentation only. I compared each image against same-digestmainbaselines:mainUtah software was cancelled by the existing Bazaar hang, which is fixed in #1075.
This branch is not opened as a PR yet: it overlaps open #1037 in
.github/workflows/e2e.ymlanddocs/skills/ci-ops/e2e-workflow/SKILL.md.Software and Compass branch: #1075
VM-tested at
9f518f88:The two Bluefin failures are Bazaar Curated-tab failures. Bluefin pins an old curated config format that Bazaar 0.9.x rejects.
Product findings
power-status-color@localfrom an old Bling pin, while the test expectspower-status-color@projectbluefin.io.mainand this branch: Files/Settings AT-SPI failures, shell hook errors, andbrew/distroboxavailability failures.Coverage gaps still open
Coverage is incomplete. The completeness review still lists missing tests in these areas:
Some gaps need infrastructure that does not exist yet: hardware, an enforcing-SELinux lane, startup or installed-system qualification lanes, and suite selection in consumer workflows. Others are human decisions.
Assisted-by: GPT-6.1-Sol via omp
test(software): cover Compass FlatPark lifecycle and real Bazaar UI (#…
35 remaining items
hivecommons-hive commentedon Nov 1, 2026
🛠️ Hive agent
scanner(hive hosted-projectbluefin-knuckle-gjvq) started work on this issue at 2026-11-01T05:07:11Z. A pull request referencing this issue supersedes this mark; it lapses on its own at 2026-11-01T07:07:11Z if none appears.hivecommons-hive commentedon Nov 1, 2026
Workflow half of #1073 (bot cannot push
.github/workflows/*). Applies cleanly to currentmain; taken from castrojo'sfix/coverage-family-gatesbranch.Changes: pass
-e BASE_IMAGEand-D image=${BASE_IMAGE}into the GUI runner container (smoke family detection in the companion PR depends on it); addcommonto the pass-count gate; stop splitting common on Dakota; include utah in Flatpak cache conditions.Overlap: touches e2e.yml regions also edited by #1037; land after or rebase on it.
Risk: credentials/owner-only infra
— hive: agent=scanner backend=copilot model=claude-opus-5.5 copilot=1.0.88
Danathar commentedon Nov 5, 2026
/hive decision Your token can push .github/workflows (the hive pushed e2e.yml in #1089, commit a017ce1). Open one PR with the workflow half described above (from castrojo's fix/coverage-family-gates branch); rebase it on current main and drop any part that has already landed.
hivecommons-hive commentedon Nov 5, 2026
Approved by @Danathar. Decision: Your token can push .github/workflows (the hive pushed e2e.yml in #1089, commit a017ce1). Open one PR with the workflow half described above (from castrojo's fix/coverage-family-gates branch); rebase it on current main and drop any part that has already landed.
approved-directionis applied and Hive's ownstage/045-needs-decisionremoved. Anyholdlabel is left exactly as it was.hivecommons-hive commentedon Nov 5, 2026
Fixed by #1083 (merged e06a534). Closing. Reply /reopen if the problem persists.