From 3834edf7957c3ef4d95ed0b19369d8b02332cdf5 Mon Sep 17 00:00:00 2001 From: castrojo Date: Sat, 31 Oct 2026 02:22:51 -0400 Subject: [PATCH 1/7] test: replace Search Light checks with Compass launcher Assert the Compass Super+Space custom keybinding in common dconf, add a pending check for the preinstalled org.tunaos.compass Flatpak, drop the Search Light extension scenario, and refresh skill docs and coverage. Assisted-by: Claude Opus 5.5 via GitHub Copilot Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- docs/skills/test-authoring/behave/SKILL.md | 2 +- docs/skills/test-authoring/gnome/SKILL.md | 8 +++++--- tests/common/features/common_dconf.feature | 12 +++++++++--- tests/common/features/common_flatpak_state.feature | 7 +++++++ tests/smoke/features/bluefin_extensions.feature | 7 ------- tests/unit/test_gnome_extensions_steps.py | 2 +- 6 files changed, 23 insertions(+), 15 deletions(-) diff --git a/docs/skills/test-authoring/behave/SKILL.md b/docs/skills/test-authoring/behave/SKILL.md index 3d419114a..513900b78 100644 --- a/docs/skills/test-authoring/behave/SKILL.md +++ b/docs/skills/test-authoring/behave/SKILL.md @@ -383,7 +383,7 @@ For commands that produce multiline output (e.g. `flatpak install ... 2>&1; echo In the SSH-driven `common` suite, validate Bluefin desktop identity overrides with the API that matches the schema type: - Use `gsettings get` for regular schemas shipped via `zz0-bluefin-modifications.gschema.override` (for example `org.gnome.desktop.interface accent-color` or `org.gnome.desktop.app-folders folder-children`). -- Use `dconf read` for relocatable schemas and extensions without XML schemas (for example custom media-key keybindings under `/org/gnome/settings-daemon/plugins/media-keys/custom-keybindings/`, Search Light under `/org/gnome/shell/extensions/search-light/`, and Ptyxis profile palette keys under `/org/gnome/Ptyxis/Profiles//`). +- Use `dconf read` for relocatable schemas and extensions without XML schemas (for example custom media-key keybindings under `/org/gnome/settings-daemon/plugins/media-keys/custom-keybindings/` such as Compass at `.../custom-keybindings/compass/`, and Ptyxis profile palette keys under `/org/gnome/Ptyxis/Profiles//`). This keeps common-suite assertions aligned with how Bluefin actually ships those defaults in `projectbluefin/common`. diff --git a/docs/skills/test-authoring/gnome/SKILL.md b/docs/skills/test-authoring/gnome/SKILL.md index e788cd96e..ebe875d76 100644 --- a/docs/skills/test-authoring/gnome/SKILL.md +++ b/docs/skills/test-authoring/gnome/SKILL.md @@ -244,10 +244,12 @@ The smoke suite's UUID-specific extension checks use the same `_run_host(...)` helper so they work both inside the VM and from the Fedora runner container over SSH. -Bluefin's 9 bundled extensions each get a named scenario in -`tests/smoke/features/bluefin_extensions.feature`. Tag the -`search-light@icedman.github.com` scenario `@bluefin` and guard it with +Bluefin's bundled extensions each get a named scenario in +`tests/smoke/features/bluefin_extensions.feature`. For an extension that a +newer GNOME image stops shipping, tag the scenario `@bluefin` and guard it with `... is installed, otherwise skip on GNOME 51+` (missing on older shells fails). +The Super+Space launcher is Compass (`org.tunaos.compass` Flatpak), not a Shell +extension; its keybinding is asserted in `common_dconf.feature`. Use the distinct step phrase `GNOME extension "{uuid}" is enabled` (not bazzite's `Extension "{uuid}" is enabled`) to avoid cross-suite step collisions. diff --git a/tests/common/features/common_dconf.feature b/tests/common/features/common_dconf.feature index 1cc00e034..da9fb6277 100644 --- a/tests/common/features/common_dconf.feature +++ b/tests/common/features/common_dconf.feature @@ -84,10 +84,16 @@ Feature: Bluefin common dconf and GSettings defaults * SSH command return code is "0" * SSH command output stripped "is" "'xdg-terminal-exec'" - Scenario: Searchlight extension is configured - * Run SSH command: "dconf read /org/gnome/shell/extensions/search-light/shortcut-search" + Scenario: Compass launcher keybinding is configured + * Run SSH command: "gsettings get org.gnome.settings-daemon.plugins.media-keys custom-keybindings" + * SSH command return code is "0" + * SSH command output contains "/org/gnome/settings-daemon/plugins/media-keys/custom-keybindings/compass/" + * Run SSH command: "dconf read /org/gnome/settings-daemon/plugins/media-keys/custom-keybindings/compass/binding" + * SSH command return code is "0" + * SSH command output stripped "is" "'space'" + * Run SSH command: "dconf read /org/gnome/settings-daemon/plugins/media-keys/custom-keybindings/compass/command" * SSH command return code is "0" - * SSH command output stripped "is" "['space']" + * SSH command output contains "org.tunaos.compass toggle" # Pending: the Ptyxis palette is user-session dconf state, not image state. @pending diff --git a/tests/common/features/common_flatpak_state.feature b/tests/common/features/common_flatpak_state.feature index 30825d33b..7fd2a8675 100644 --- a/tests/common/features/common_flatpak_state.feature +++ b/tests/common/features/common_flatpak_state.feature @@ -28,3 +28,10 @@ Feature: Flatpak first-boot state Scenario: flatpak user installations directory exists * Run SSH command: "test -d /var/home/$(id -un)/.local/share/flatpak 2>/dev/null || test -d /root/.local/share/flatpak" * SSH command return code is "0" + + # Pending: flatpak-preinstall.service is masked in CI, so preinstalled + # system Flatpaks (Compass from the flatpark remote) are absent there. + @pending + Scenario: Compass launcher Flatpak is preinstalled + * Run SSH command: "flatpak info --system org.tunaos.compass" + * SSH command return code is "0" diff --git a/tests/smoke/features/bluefin_extensions.feature b/tests/smoke/features/bluefin_extensions.feature index d0542ee24..532cb0343 100644 --- a/tests/smoke/features/bluefin_extensions.feature +++ b/tests/smoke/features/bluefin_extensions.feature @@ -45,10 +45,3 @@ Feature: Bluefin GNOME extension presence Scenario: Custom Command List extension is enabled * GNOME Shell is accessible via AT-SPI * GNOME extension "custom-command-list@storageb.github.com" is enabled - - @bluefin @extensions - Scenario: Search Light extension is enabled - # Broken on GNOME 51: GNOME 51 images do not ship it, so skip there only. - * GNOME extension "search-light@icedman.github.com" is installed, otherwise skip on GNOME 51+ - * GNOME Shell is accessible via AT-SPI - * GNOME extension "search-light@icedman.github.com" is enabled diff --git a/tests/unit/test_gnome_extensions_steps.py b/tests/unit/test_gnome_extensions_steps.py index fc6ba6365..351042a8f 100644 --- a/tests/unit/test_gnome_extensions_steps.py +++ b/tests/unit/test_gnome_extensions_steps.py @@ -220,7 +220,7 @@ def fake_run_host(cmd): class TestExtensionInstalledOrSkip: - UUID = "search-light@icedman.github.com" + UUID = "gsconnect@andyholmes.github.io" def _run(self, installed: bool, major): m = _import_gnome_extensions_steps() From cbe809ee276584c6597c591da1b48c6748118e93 Mon Sep 17 00:00:00 2001 From: castrojo Date: Sat, 31 Oct 2026 02:29:51 -0400 Subject: [PATCH 2/7] test(smoke): add Compass launcher Super+Space e2e scenario Wait for the FlatPark preinstall of org.tunaos.compass (skipped where flatpak-preinstall.service is masked), press Super+Space via dogtail and assert the Compass window appears, then hides on the second press. Assisted-by: Claude Opus 5.5 via GitHub Copilot Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- .../features/common_flatpak_state.feature | 7 --- tests/smoke/features/compass_launcher.feature | 15 ++++++ tests/smoke/features/steps/steps.py | 47 +++++++++++++++++++ 3 files changed, 62 insertions(+), 7 deletions(-) create mode 100644 tests/smoke/features/compass_launcher.feature diff --git a/tests/common/features/common_flatpak_state.feature b/tests/common/features/common_flatpak_state.feature index 7fd2a8675..30825d33b 100644 --- a/tests/common/features/common_flatpak_state.feature +++ b/tests/common/features/common_flatpak_state.feature @@ -28,10 +28,3 @@ Feature: Flatpak first-boot state Scenario: flatpak user installations directory exists * Run SSH command: "test -d /var/home/$(id -un)/.local/share/flatpak 2>/dev/null || test -d /root/.local/share/flatpak" * SSH command return code is "0" - - # Pending: flatpak-preinstall.service is masked in CI, so preinstalled - # system Flatpaks (Compass from the flatpark remote) are absent there. - @pending - Scenario: Compass launcher Flatpak is preinstalled - * Run SSH command: "flatpak info --system org.tunaos.compass" - * SSH command return code is "0" diff --git a/tests/smoke/features/compass_launcher.feature b/tests/smoke/features/compass_launcher.feature new file mode 100644 index 000000000..fa07f65b2 --- /dev/null +++ b/tests/smoke/features/compass_launcher.feature @@ -0,0 +1,15 @@ +@smoke_suite +Feature: Compass launcher + Compass (org.tunaos.compass) is preinstalled from FlatPark and bound to + Super+Space through a GNOME custom keybinding. + + Scenario: Compass launcher Flatpak is preinstalled + * Compass Flatpak is installed system-wide within 600 seconds + + Scenario: Super+Space toggles the Compass launcher + * Compass Flatpak is installed system-wide within 600 seconds + * GNOME Shell is accessible via AT-SPI + * Key combo: "space" + * Compass launcher window is visible within 60 seconds + * Key combo: "space" + * Compass launcher window is hidden within 30 seconds diff --git a/tests/smoke/features/steps/steps.py b/tests/smoke/features/steps/steps.py index e17842812..1ce5d6023 100644 --- a/tests/smoke/features/steps/steps.py +++ b/tests/smoke/features/steps/steps.py @@ -892,3 +892,50 @@ def flatpak_no_excessive_permissions(context, app_id: str) -> None: assert not re.search(r"filesystems=(host|home)", perms_out), ( f"{app_id} has excessive filesystem access:\n{perms_out}" ) + + +# ── Compass launcher (org.tunaos.compass Flatpak, Super+Space) ── + +_COMPASS_VISIBLE_JS = ( + "global.get_window_actors().some(a => { const w = a.meta_window; " + "const ids = [w.get_wm_class(), w.get_wm_class_instance(), " + "w.get_gtk_application_id(), w.get_sandboxed_app_id(), w.get_title()]" + ".join(' ').toLowerCase(); " + "return ids.includes('compass') && a.visible && !w.minimized " + "&& w.showing_on_its_workspace(); })" +) +_WINDOWS_JS = ( + "JSON.stringify(global.get_window_actors().map(a => { const w = a.meta_window; " + "return [w.get_wm_class(), w.get_gtk_application_id(), " + "w.get_sandboxed_app_id(), w.get_title(), a.visible, w.minimized]; }))" +) + + +@step("Compass Flatpak is installed system-wide within {timeout:d} seconds") +def compass_flatpak_installed_within(context, timeout: int) -> None: + # flatpak-preinstall downloads a ~71 MB extra-data AppImage at boot. + # The VM e2e lane masks flatpak-preinstall.service (no first-boot network + # pulls), so Compass can never appear there: skip instead of timing out. + state, _, _ = _run_host("systemctl is-enabled flatpak-preinstall.service") + if state == "masked": + context.scenario.skip("flatpak-preinstall.service is masked in this lane") + return + deadline = time.monotonic() + timeout + while True: + out, rc, err = _run_host("flatpak info --system org.tunaos.compass") + if rc == 0: + return + assert time.monotonic() < deadline, ( + f"org.tunaos.compass not installed after {timeout}s: {err or out}" + ) + sleep(10) + + +@step("Compass launcher window is {state} within {timeout:d} seconds") +def compass_window_state_within(context, state: str, timeout: int) -> None: + assert state in ("visible", "hidden"), f"unknown state {state!r}" + if _wait_eval_bool(_COMPASS_VISIBLE_JS, state == "visible", retries=timeout, delay=1): + return + raise AssertionError( + f"Compass window not {state} after {timeout}s; windows: {_shell_eval(_WINDOWS_JS)}" + ) From 24db2d3bfcd0e225ee882a97e0f3f2a2df06d6e8 Mon Sep 17 00:00:00 2001 From: castrojo Date: Sat, 31 Oct 2026 04:15:56 -0400 Subject: [PATCH 3/7] test(smoke): prove Compass session unit serves before Super+Space Assert compass.service is wanted by graphical-session.target, restart it after the late preinstall, and require it active and answering 'flatpak run org.tunaos.compass ping' before the keybinding toggle checks. Assisted-by: Claude Opus 5.5 via GitHub Copilot Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- tests/smoke/features/compass_launcher.feature | 2 + tests/smoke/features/steps/steps.py | 37 +++++++++++++++++++ 2 files changed, 39 insertions(+) diff --git a/tests/smoke/features/compass_launcher.feature b/tests/smoke/features/compass_launcher.feature index fa07f65b2..e2412b271 100644 --- a/tests/smoke/features/compass_launcher.feature +++ b/tests/smoke/features/compass_launcher.feature @@ -8,6 +8,8 @@ Feature: Compass launcher Scenario: Super+Space toggles the Compass launcher * Compass Flatpak is installed system-wide within 600 seconds + * Compass user service is wanted by graphical-session.target + * Compass user service is restarted and answers ping within 60 seconds * GNOME Shell is accessible via AT-SPI * Key combo: "space" * Compass launcher window is visible within 60 seconds diff --git a/tests/smoke/features/steps/steps.py b/tests/smoke/features/steps/steps.py index 1ce5d6023..1c53db354 100644 --- a/tests/smoke/features/steps/steps.py +++ b/tests/smoke/features/steps/steps.py @@ -931,6 +931,43 @@ def compass_flatpak_installed_within(context, timeout: int) -> None: sleep(10) +_SESSION = "source /tmp/session.env 2>/dev/null; " + + +@step("Compass user service is wanted by graphical-session.target") +def compass_service_wanted_by_session(context) -> None: + enabled, _, _ = _run_host(_SESSION + "systemctl --user is-enabled compass.service") + exec_start, _, _ = _run_host(_SESSION + "systemctl --user show -p ExecStart compass.service") + print(f"compass.service is-enabled={enabled!r} {exec_start}", flush=True) + wanted_by, rc, err = _run_host(_SESSION + "systemctl --user show -p WantedBy compass.service") + assert rc == 0 and "graphical-session.target" in wanted_by, ( + f"compass.service not wanted by graphical-session.target: {wanted_by!r} {err}" + ) + + +@step("Compass user service is restarted and answers ping within {timeout:d} seconds") +def compass_service_restarted_and_pings(context, timeout: int) -> None: + # ConditionPathExists is false at login when preinstall finishes later. + _, rc, err = _run_host(_SESSION + "systemctl --user restart compass.service") + assert rc == 0, f"systemctl --user restart compass.service failed: {err}" + deadline = time.monotonic() + timeout + while True: + active, _, _ = _run_host(_SESSION + "systemctl --user is-active compass.service") + out, ping_rc, ping_err = _run_host(_SESSION + "flatpak run org.tunaos.compass ping") + if active == "active" and ping_rc == 0: + return + if time.monotonic() >= deadline: + status, _, _ = _run_host( + _SESSION + "systemctl --user status --no-pager compass.service 2>&1" + ) + raise AssertionError( + f"compass.service not serving after {timeout}s: is-active={active!r} " + f"ping rc={ping_rc} {ping_err or out}\n{status}" + ) + sleep(2) + + + @step("Compass launcher window is {state} within {timeout:d} seconds") def compass_window_state_within(context, state: str, timeout: int) -> None: assert state in ("visible", "hidden"), f"unknown state {state!r}" From e43a2ed730daa7b7bcc83919ff894f79529e84d8 Mon Sep 17 00:00:00 2001 From: castrojo Date: Sat, 31 Oct 2026 05:14:43 -0400 Subject: [PATCH 4/7] test(smoke): tag Compass feature and dump launcher diagnostics Tag the Compass feature @compass for targeted runs, log process, unit, journal, session environment, doctor and logs output after the first Super+Space, and append them plus a manual toggle to the window-state timeout failure. Assisted-by: Claude Opus 5.5 via GitHub Copilot Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- tests/smoke/features/compass_launcher.feature | 3 +- tests/smoke/features/steps/steps.py | 32 ++++++++++++++++++- 2 files changed, 33 insertions(+), 2 deletions(-) diff --git a/tests/smoke/features/compass_launcher.feature b/tests/smoke/features/compass_launcher.feature index e2412b271..57a05f45c 100644 --- a/tests/smoke/features/compass_launcher.feature +++ b/tests/smoke/features/compass_launcher.feature @@ -1,4 +1,4 @@ -@smoke_suite +@smoke_suite @compass Feature: Compass launcher Compass (org.tunaos.compass) is preinstalled from FlatPark and bound to Super+Space through a GNOME custom keybinding. @@ -12,6 +12,7 @@ Feature: Compass launcher * Compass user service is restarted and answers ping within 60 seconds * GNOME Shell is accessible via AT-SPI * Key combo: "space" + * Compass diagnostics are logged * Compass launcher window is visible within 60 seconds * Key combo: "space" * Compass launcher window is hidden within 30 seconds diff --git a/tests/smoke/features/steps/steps.py b/tests/smoke/features/steps/steps.py index 1c53db354..846c199ad 100644 --- a/tests/smoke/features/steps/steps.py +++ b/tests/smoke/features/steps/steps.py @@ -967,12 +967,42 @@ def compass_service_restarted_and_pings(context, timeout: int) -> None: sleep(2) +_COMPASS_DIAG_CMDS = ( + "ps -eo pid,ppid,user,args | grep -i [c]ompass", + "systemctl --user status compass.service --no-pager -l 2>&1 | tail -30", + "journalctl --user -b --no-pager 2>&1 | grep -i -E 'compass|media-keys|custom' | tail -80", + "systemctl --user show-environment | grep -E 'WAYLAND|DISPLAY|XDG_SESSION|DBUS'", + "timeout 20 flatpak run org.tunaos.compass doctor 2>&1 | tail -60", + "timeout 10 flatpak run org.tunaos.compass logs 2>&1 | tail -80", +) + + +def _compass_diagnostics(include_toggle: bool) -> str: + cmds = list(_COMPASS_DIAG_CMDS) + if include_toggle: + # Mutates launcher state, so only run once the assertion has failed. + cmds.append("timeout 15 flatpak run org.tunaos.compass toggle 2>&1; echo rc=$?") + parts = [] + for cmd in cmds: + out, rc, err = _run_host(_SESSION + cmd, timeout=40) + parts.append(f"$ {cmd} [rc={rc}]\n{out}\n{err}".rstrip()) + report = "\n".join(parts) + print(f"── Compass diagnostics ──\n{report}", flush=True) + return report + + +@step("Compass diagnostics are logged") +def compass_diagnostics_are_logged(context) -> None: + _compass_diagnostics(include_toggle=False) + @step("Compass launcher window is {state} within {timeout:d} seconds") def compass_window_state_within(context, state: str, timeout: int) -> None: assert state in ("visible", "hidden"), f"unknown state {state!r}" if _wait_eval_bool(_COMPASS_VISIBLE_JS, state == "visible", retries=timeout, delay=1): return + windows = _shell_eval(_WINDOWS_JS) raise AssertionError( - f"Compass window not {state} after {timeout}s; windows: {_shell_eval(_WINDOWS_JS)}" + f"Compass window not {state} after {timeout}s; windows: {windows}\n" + + _compass_diagnostics(include_toggle=True) ) From 4ce10ab40a5a052083c273574a5a34cfffe1239e Mon Sep 17 00:00:00 2001 From: castrojo Date: Sat, 31 Oct 2026 05:25:32 -0400 Subject: [PATCH 5/7] test(smoke): prove compass.service stop/start/restart own one engine Stop must kill the sandboxed engine (ping fails, no serve process); start and restart must leave the unit active, answering ping, with exactly one 'compass serve --no-hotkey' engine and NRestarts=0 after restart, before the Super+Space toggle checks. Assisted-by: Claude Opus 5.5 via GitHub Copilot Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- tests/smoke/features/compass_launcher.feature | 4 +- tests/smoke/features/steps/steps.py | 73 ++++++++++++++++--- 2 files changed, 65 insertions(+), 12 deletions(-) diff --git a/tests/smoke/features/compass_launcher.feature b/tests/smoke/features/compass_launcher.feature index 57a05f45c..3bec2012d 100644 --- a/tests/smoke/features/compass_launcher.feature +++ b/tests/smoke/features/compass_launcher.feature @@ -9,7 +9,9 @@ Feature: Compass launcher Scenario: Super+Space toggles the Compass launcher * Compass Flatpak is installed system-wide within 600 seconds * Compass user service is wanted by graphical-session.target - * Compass user service is restarted and answers ping within 60 seconds + * Compass user service is stopped and its engine is gone within 30 seconds + * Compass user service is started with one serving engine within 60 seconds + * Compass user service is restarted with one serving engine within 60 seconds * GNOME Shell is accessible via AT-SPI * Key combo: "space" * Compass diagnostics are logged diff --git a/tests/smoke/features/steps/steps.py b/tests/smoke/features/steps/steps.py index 846c199ad..559b7de41 100644 --- a/tests/smoke/features/steps/steps.py +++ b/tests/smoke/features/steps/steps.py @@ -945,26 +945,77 @@ def compass_service_wanted_by_session(context) -> None: ) -@step("Compass user service is restarted and answers ping within {timeout:d} seconds") -def compass_service_restarted_and_pings(context, timeout: int) -> None: - # ConditionPathExists is false at login when preinstall finishes later. - _, rc, err = _run_host(_SESSION + "systemctl --user restart compass.service") - assert rc == 0, f"systemctl --user restart compass.service failed: {err}" +def _compass_engine_ps() -> tuple[list[str], str]: + """Return (engine lines, full compass ps listing). + + An engine is the sandboxed binary itself (argv[0] basename ``compass``, + e.g. /app/extra/compass/usr/bin/compass) running ``serve --no-hotkey``; + the bwrap and ``flatpak run`` wrappers carry other argv[0]s. + """ + out, _, _ = _run_host("ps -eo pid=,ppid=,user=,args=") + listing = [line for line in out.splitlines() if "compass" in line.lower()] + engines = [] + for line in listing: + argv = line.split()[3:] + if (argv and os.path.basename(argv[0]) == "compass" + and "serve" in argv and "--no-hotkey" in argv): + engines.append(line) + return engines, "\n".join(listing) + + +def _compass_ping_rc() -> tuple[int, str]: + out, rc, err = _run_host(_SESSION + "timeout 15 flatpak run org.tunaos.compass ping") + return rc, (err or out) + + +def _systemctl_user(verb: str) -> None: + _, rc, err = _run_host(_SESSION + f"systemctl --user {verb} compass.service", timeout=60) + assert rc == 0, f"systemctl --user {verb} compass.service failed: {err}" + + +@step("Compass user service is stopped and its engine is gone within {timeout:d} seconds") +def compass_service_stopped(context, timeout: int) -> None: + _systemctl_user("stop") deadline = time.monotonic() + timeout while True: - active, _, _ = _run_host(_SESSION + "systemctl --user is-active compass.service") - out, ping_rc, ping_err = _run_host(_SESSION + "flatpak run org.tunaos.compass ping") - if active == "active" and ping_rc == 0: + ping_rc, ping_out = _compass_ping_rc() + engines, listing = _compass_engine_ps() + if ping_rc != 0 and not engines: return + if time.monotonic() >= deadline: + raise AssertionError( + f"Compass engine survived 'systemctl --user stop' for {timeout}s: " + f"ping rc={ping_rc} {ping_out}; engines={len(engines)}\n{listing}" + ) + sleep(2) + + +@step("Compass user service is {verb} with one serving engine within {timeout:d} seconds") +def compass_service_serves_one_engine(context, verb: str, timeout: int) -> None: + action = {"started": "start", "restarted": "restart"}[verb] + _systemctl_user(action) + deadline = time.monotonic() + timeout + while True: + active, _, _ = _run_host(_SESSION + "systemctl --user is-active compass.service") + ping_rc, ping_out = _compass_ping_rc() + engines, listing = _compass_engine_ps() + if active == "active" and ping_rc == 0 and len(engines) == 1: + break if time.monotonic() >= deadline: status, _, _ = _run_host( - _SESSION + "systemctl --user status --no-pager compass.service 2>&1" + _SESSION + "systemctl --user status --no-pager -l compass.service 2>&1" ) raise AssertionError( - f"compass.service not serving after {timeout}s: is-active={active!r} " - f"ping rc={ping_rc} {ping_err or out}\n{status}" + f"compass.service not serving one engine {timeout}s after {action}: " + f"is-active={active!r} ping rc={ping_rc} {ping_out}; " + f"engines={len(engines)}\n{listing}\n{status}" ) sleep(2) + if action == "restart": + restarts, _, _ = _run_host(_SESSION + "systemctl --user show -p NRestarts compass.service") + assert restarts == "NRestarts=0", ( + f"compass.service crash-looped after restart: {restarts!r}\n{listing}" + ) _COMPASS_DIAG_CMDS = ( From 5b57891f1d5418b2af150cb984fd173a74204061 Mon Sep 17 00:00:00 2001 From: castrojo Date: Sat, 31 Oct 2026 11:39:04 -0400 Subject: [PATCH 6/7] docs(skills): keep gnome skill under the 500-line limit Assisted-by: Claude Opus 5.5 via GitHub Copilot Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- docs/skills/test-authoring/gnome/SKILL.md | 8 +++----- 1 file changed, 3 insertions(+), 5 deletions(-) diff --git a/docs/skills/test-authoring/gnome/SKILL.md b/docs/skills/test-authoring/gnome/SKILL.md index ebe875d76..6f54a10d7 100644 --- a/docs/skills/test-authoring/gnome/SKILL.md +++ b/docs/skills/test-authoring/gnome/SKILL.md @@ -245,11 +245,9 @@ The smoke suite's UUID-specific extension checks use the same runner container over SSH. Bluefin's bundled extensions each get a named scenario in -`tests/smoke/features/bluefin_extensions.feature`. For an extension that a -newer GNOME image stops shipping, tag the scenario `@bluefin` and guard it with -`... is installed, otherwise skip on GNOME 51+` (missing on older shells fails). -The Super+Space launcher is Compass (`org.tunaos.compass` Flatpak), not a Shell -extension; its keybinding is asserted in `common_dconf.feature`. +`tests/smoke/features/bluefin_extensions.feature`; guard ones newer GNOME stops +shipping with `@bluefin` and `... is installed, otherwise skip on GNOME 51+`. +Super+Space is Compass (`org.tunaos.compass` Flatpak): `compass_launcher.feature`. Use the distinct step phrase `GNOME extension "{uuid}" is enabled` (not bazzite's `Extension "{uuid}" is enabled`) to avoid cross-suite step collisions. From d9ecdcdb977a698f14b67b0dc7d90203523ebf34 Mon Sep 17 00:00:00 2001 From: castrojo Date: Sat, 31 Oct 2026 12:24:03 -0400 Subject: [PATCH 7/7] docs(skills): regenerate suite map after rebase Assisted-by: Claude Opus 5.5 via GitHub Copilot Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --- docs/skills/test-authoring/suite-map/SKILL.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/skills/test-authoring/suite-map/SKILL.md b/docs/skills/test-authoring/suite-map/SKILL.md index be1fa336f..0ca737f99 100644 --- a/docs/skills/test-authoring/suite-map/SKILL.md +++ b/docs/skills/test-authoring/suite-map/SKILL.md @@ -163,7 +163,7 @@ Set `chunked_enabled: true` once `ghcr.io/projectbluefin/bluefin:latest` ships z -573 scenarios across 82 feature files: 455 active, 0 quarantined, 118 `@future`/`@pending`/`@hardware_blocked` +574 scenarios across 83 feature files: 456 active, 0 quarantined, 118 `@future`/`@pending`/`@hardware_blocked` | Suite | Scenarios | Active | Quarantined | Pending/Future | Notes | |---|---|---|---|---|---| @@ -180,7 +180,7 @@ Set `chunked_enabled: true` once `ghcr.io/projectbluefin/bluefin:latest` ships z | lifecycle | 33 | 30 | 0 | 3 | bootc upgrade / rollback / migration; switch is `@future` (needs a valid alternate image ref; pin activated with settled-deployment barrier) | | nvidia | 12 | 0 | 0 | 12 | `@future` / `@hardware_blocked` until GPU passthrough exists in the lab | | security | 15 | 15 | 0 | 0 | cosign verify: projectbluefin (bluefin, lts, dakota) + ublue-os (latest, LTS, DX, nvidia, GTS, DX-nvidia, negative) | -| smoke | 223 | 177 | 0 | 46 | 39 `@pending` flatpak-permission audits blocked on CI never seeding system Flatpaks; MIME handler coverage (Firefox/Papers/Loupe/Text Editor/video); GNOME accessibility (AT-SPI daemon, high-contrast toggle, a11y panel); display fractional/integer scaling via Mutter DisplayConfig; Bluefin desktop identity (Wayland, hardware accel, Dash to Dock); GNOME regression guards in gnome_regression.feature; Dakota sudo-rs privilege and PAM checks | +| smoke | 224 | 178 | 0 | 46 | 39 `@pending` flatpak-permission audits blocked on CI never seeding system Flatpaks; MIME handler coverage (Firefox/Papers/Loupe/Text Editor/video); GNOME accessibility (AT-SPI daemon, high-contrast toggle, a11y panel); display fractional/integer scaling via Mutter DisplayConfig; Bluefin desktop identity (Wayland, hardware accel, Dash to Dock); GNOME regression guards in gnome_regression.feature; Dakota sudo-rs privilege and PAM checks | | software | 35 | 27 | 0 | 8 | Bazaar GUI (`@bazaar_ui`: launch, view content per tab, typed search with a visible result, Ctrl+Q quit) + CLI presence/info/remote + config YAML parse (non-empty mappings; empty dir fails) active on images that carry Bazaar; CLI (Flathub remote + permissions DB) active on all images; Flatpak per-app permission management active on all images; FlatPark remote + Compass (`org.tunaos.compass`) system install/permission/export/uninstall lifecycle active (x86_64 only) and the shipped `compass@tunaos.org` default gated on the image enabling it (#1073); upstream GNOME Software scenarios are `@future` (#847) | | vanilla-gnome | 15 | 15 | 0 | 0 | Baseline GNOME Shell parity check; runs on any GNOME image; org.gnome.desktop.a11y.interface reduced-motion + keyboard-focus-visible-timeout gsettings round-trips (@requires_gnome_51, skip on GNOME <= 50 via runtime Shell version probe) |