Repository navigation
CI: split CPU build and tests into parallel jobs - #120
Merged
Merged
Conversation
The single CPU job (about 27 minutes, 17 of them the Python test set) becomes parallel jobs: converter and shared settings; FSR front end; launcher; Ray Reconstruction plugin (with the one Python module that needs its build, test_optimal.py); the Python test set in three shards. Each job builds what it needs; no build output is shared. A final job keeps the required check name "CPU build and tests" and passes only when every split job passed. run_python_tests.py: --shard K/N and --group proxy run parts of the set; without options it runs the whole set as before. test_stages.py (812 s) is split by test id into six lists. Every shard computes the whole plan and checks that each module or test id is in exactly one part; --plan N prints it. Signed-off-by: phantoslayer21 <156617979+phantoslayer21@users.noreply.github.com>
phantoslayer21
marked this pull request as ready for review
November 14, 2026 01:17
A cancelled run skipped the gate job, and a skipped required check counts as passing. With always() the gate runs and fails unless every split job reports success. Signed-off-by: phantoslayer21 <156617979+phantoslayer21@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The single "CPU build and tests" job (about 27 minutes on main) becomes parallel jobs. No test is dropped; the steps are
the same commands, moved into jobs.
Jobs
ctest(out/converter); wgshared build +ctest(out/wgshared)ctest -R "unit|hosted|diagnostic|support" -E "overlay|split|d3d12"ctest -R "^(wg-core|launcher-core|coexist-core|convert-ignore|source-size|wording)$"build.py --no-tests(with its WARP probe/hook tests),run_proxy_core_tests.py, thenrun_python_tests.py --group proxy(test_optimal.py, the one Python module that reads the plugin build)run_python_tests.py --jobs 3 --shard K/3: every other Python module; test_stages.py (812 s) split by test id into six listschange. "Licence and line endings" is unchanged.
environment (MSVC developer prompt, numpy, ninja). Grep shows that the only Python module reading the plugin build
(
WG_RR_PROXY_BUILD) is test_optimal.py, which now runs in the plugin job, so it isn't skipped. No module readsthe mock HIP runtime or another job's out/ folder.
run_python_tests.pywithout options runs the whole set as before. In shard mode every shard computes the wholeplan and stops if any module (or test id of a split module) is missing or in two parts;
--plan 3prints it.Totals: old single job against the new jobs
Old: run 43531456640 (main 2085f40, the last green single job). New: this PR's run 43539004405 (base main cdee313).
Every difference comes from commits merged between 2085f40 and cdee313, not from the split:
convert-ignore(added with Converter search: ignore lists for upscaler DLLs another installer placed #46); the other five launcher tests, converter 4, wgshared 4 andfront end 15 are the same tests.
703 + 3 + 2 = 708; skipped 104 = 104.
test_stages.py: 36 tests = six parts of 6 across shards 2 and 3, and test_optimal.py: 4 ran, 0 skipped, in the
plugin job.
Wall time
The jobs ran at the same time on GitHub-hosted runners; queue time isn't counted.