Skip to content

Split slow test jobs - #23675

Merged
MikeMcQuaid merged 3 commits into
mainfrom
split-slow-test-jobs
Aug 28, 2026
Merged

MikeMcQuaid merged 3 commits into
mainfrom
split-slow-test-jobs

Conversation

@MikeMcQuaid

Copy link
Copy Markdown
Member
  • Shard test files across the four jobs exceeding ten minutes.
  • Preserve existing required checks with aggregate result jobs.

  • Have you followed our Contributing guidelines?
  • Have you checked for other open Pull Requests for the same change?
  • Have you explained what your changes do? Performance claims (e.g. "this is faster") must include brew benchmark results.
  • Have you explained why you'd like these changes included, not just what they do?
  • For bug fixes, have you given step-by-step brew commands to reproduce the bug?
  • Have you written new tests (excluding integration tests)? Here's an example.
  • Have you successfully run brew lgtm (style, typechecking and tests) locally?

  • I did not use AI/LLM to create this PR, or I disclosed the tool/model below and reviewed its output; I did not attribute commits to AI and will answer maintainer questions and review comments myself without AI/LLM.

OpenAI Codex 5.6 sol xhigh with local review and testing.


Copilot AI balanced review requested due to automatic review settings August 27, 2026 18:41

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds test-file sharding to reduce CI duration while retaining legacy check names.

Changes:

  • Adds and tests brew tests --shard=<index>/<total>.
  • Splits four slow CI jobs into two shards.
  • Updates generated documentation, completions, and Sorbet definitions.

Reviewed changes

Copilot reviewed 8 out of 9 changed files in this pull request and generated 1 comment.

Show a summary per file
File Description
.github/workflows/tests.yml Shards CI tests and adds result jobs.
Library/Homebrew/dev-cmd/tests.rb Implements shard parsing and selection.
Library/Homebrew/test/dev-cmd/tests_spec.rb Tests shard selection.
Library/Homebrew/sorbet/rbi/dsl/homebrew/dev_cmd/tests.rbi Adds the typed shard argument.
docs/Manpage.md Documents --shard.
manpages/brew.1 Updates the generated manpage.
completions/bash/brew Adds Bash completion.
completions/fish/brew.fish Adds fish completion.
completions/zsh/_brew Adds zsh completion and conflicts.
Files not reviewed (1)
  • Library/Homebrew/sorbet/rbi/dsl/homebrew/dev_cmd/tests.rbi: File type not supported

馃挕 Add a code-review agent skill for context-aware, tailored reviews. Learn more in the docs.

Comment thread .github/workflows/tests.yml
@MikeMcQuaid
MikeMcQuaid force-pushed the split-slow-test-jobs branch from 202a86c to eb06e07 Compare August 28, 2026 07:43

@ZhongRuoyu ZhongRuoyu left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sharding FTW!

@MikeMcQuaid
MikeMcQuaid force-pushed the split-slow-test-jobs branch 2 times, most recently from c630a17 to 2b93e5e Compare August 28, 2026 12:38
Comment thread .github/workflows/run-tests.yml Fixed
@MikeMcQuaid
MikeMcQuaid force-pushed the split-slow-test-jobs branch from 2b93e5e to efc29b5 Compare August 28, 2026 13:46
- Balance four slow test groups by source size across two shards.
- Preserve required checks with independent aggregate jobs.
- Share test setup through a reusable workflow.
- Start test jobs without waiting for syntax checks.
- Fail CI tests when required dependencies are unavailable.
- Replace prefix-cache actions with direct installs where still needed.
@MikeMcQuaid
MikeMcQuaid force-pushed the split-slow-test-jobs branch from efc29b5 to c261086 Compare August 28, 2026 13:59
- Test every documented command through an outside-in smoke path.
- Record child coverage with Ruby `Coverage` and skip Sorbet loading.
- Build installed fixtures directly and combine Formula and Cask paths.
Speed up and expand integration coverage
@MikeMcQuaid
MikeMcQuaid enabled auto-merge August 28, 2026 14:44
@MikeMcQuaid
MikeMcQuaid added this pull request to the merge queue Aug 28, 2026
Merged via the queue into main with commit 4e31f68 Aug 28, 2026
57 checks passed
@MikeMcQuaid
MikeMcQuaid deleted the split-slow-test-jobs branch August 28, 2026 15:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants