Skip to content

ci(e2e): Shard the submitqueue e2e test so its suites run in parallel - #956

Merged
manjari25 merged 1 commit into
mainfrom
manjari/e2e-shard-submitqueue
Oct 27, 2026
Merged

manjari25 merged 1 commit into
mainfrom
manjari/e2e-shard-submitqueue

Conversation

@manjari25

@manjari25 manjari25 commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Why?

//test/e2e/submitqueue runs three top-level suites (git merge, GitHub land, and the main e2e suite) one after another, each with its own Docker Compose stack. A run takes 254 to 291s against Bazel's default 300s timeout, so a slow runner or registry tips it over. That is failing merge-queue runs, for example the ones for PRs 910 and 911, where the log ends with panic: test timed out after 5m0s.

What?

  • shard_count = 3 on the test: rules_go assigns top-level tests to shards by index, so each suite runs in its own shard, in parallel. Each shard gets its own 300s limit, and wall time drops to that of the longest suite.
  • The suites use separate Compose project names, ephemeral ports, per-test temp dirs and content-hashed image tags, so they don't clash.
  • The shard count has to match the number of top-level tests in the package; a fourth would share a shard.

Test Plan

  • CI: the E2E job passed with three shards. //test/e2e/submitqueue took 145.9s (the slowest shard), against 254 to 291s before, so the 300s limit now has about 2x headroom.

Issue

@manjari25
manjari25 marked this pull request as ready for review October 27, 2026 19:50
@manjari25
manjari25 requested review from a team, behinddwalls and sbalabanov as code owners October 27, 2026 19:50
@manjari25
manjari25 enabled auto-merge October 27, 2026 20:02
@manjari25
manjari25 added this pull request to the merge queue Oct 27, 2026
Merged via the queue into main with commit cc1bdf8 Oct 27, 2026
36 checks passed
@manjari25
manjari25 deleted the manjari/e2e-shard-submitqueue branch October 27, 2026 20:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants