Skip to content

test: semantic CI contracts and visible required browser regressions - #283

Merged
codeasier merged 1 commit into
mainfrom
test/ci-contract-browser-278-279
Nov 1, 2026
Merged

codeasier merged 1 commit into
mainfrom
test/ci-contract-browser-278-279

Conversation

@codeasier

@codeasier codeasier commented Nov 1, 2026 •

Copy link
Copy Markdown
Owner

Scope

Test-system-only implementation for #278 and #279. No runtime/product code, CI permissions, runner/network settings, parser compatibility decisions or release changes. #277's additional coverage inventory is intentionally separate and will depend on this semantic-contract foundation.

Browser execution (#278)

  • Move Playwright import to fixture setup so all 12 existing browser regression identities remain collected when dependency support is missing.
  • Optional runs show per-case skips and an explicit execution/not-run summary. Broken installations and launch failures fail instead of becoming optional skips.
  • Required mode fails for missing package/binary, any skip, empty/deselected collection and incomplete execution. Collection-only is explicitly diagnostic, never claimed as execution.
  • Linux still installs real Chromium and executes the original 12 interaction tests. Their function bodies/assertions were independently AST-compared after the expectation accessor rename and are unchanged.

Semantic CI protection (#279)

  • Parse YAML/TOML and bounded command/condition semantics instead of step names and complete run-text equality.
  • Preserve Python 3.10–3.13, full/fast/nightly membership, branch+overall and independent coverage floors, fixture-before-execution, exact-head checkout, real Chromium, wheel audit/acceptance, 200-seed differential and failure evidence.
  • Positive mutations cover labels/action versions/cache, shell quoting/continuations, equivalent conditions, matrix representations and safe step splits/merges.
  • Negative mutations reject skipped gates, ignored failures, unsafe OR/AND lists, selectors/environment overrides, incorrect coverage scope, wrong wheel/provenance bindings and missing acceptance.
  • The expression reader implements the supported GitHub semantics (case-insensitive string comparisons, literal quoting, precedence and matrix exclude/include order). Unknown syntax/coercion fails closed, rather than pretending to be a general Actions or shell interpreter.

Verification

Independent reviewer raised and confirmed fixes for expression semantics, matrix ordering, same-step wheel provenance and environment bindings before publication. Scoped Ruff/Black, AST and diff checks pass. No local pytest/build duplication. Exact head 7210555c33adbbf31faf7faddaa4fc6b6fad6e1d passed all 12 applicable checks: Linux Python 3.10–3.13 (including full coverage and installed-wheel acceptance), lint, provenance, real Chromium (12/12 browser regressions), four Windows shards and macOS. Evidence: Test run 41283090530 and Platform run 41283090526. Nightly/manual gates remain scheduled/manual and no skipped acceptance is claimed as executed.

Refs #278 and #279. These issues will be closed after post-merge CI also reaches a successful terminal state.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant