Skip to content

ci: fix the self-hosted gpu job and make it opt-in - #20

Merged
nikbott merged 1 commit into
devfrom
fix/ci-gpu-cmake
Jul 7, 2026
Merged

ci: fix the self-hosted gpu job and make it opt-in#20
nikbott merged 1 commit into
devfrom
fix/ci-gpu-cmake

Conversation

@nikbott

@nikbott nikbott commented Jul 7, 2026

Copy link
Copy Markdown
Owner

Problem

The gpu job was broken two ways:

  1. It built with make -C cuda ARCH=sm_86 and ran ./cuda/test / ./cuda/benchnone exist (no cuda/Makefile; the CUDA targets are CMake's amr_cuda_tests / amr_cuda_bench). It only ever "passed" because continue-on-error: true masked it while the runner was offline.
  2. It ran on every push to dev/main. With the self-hosted A2000 offline, a self-hosted job sits queued indefinitely, so the whole run never completes — the last dev run was auto-cancelled after 23h53m, meaning trunk CI never reports a clean green.

Fix

  • Build via CMake to the real targets (amr_cuda_tests, amr_cuda_bench) and run those binaries.
  • Gate the job to workflow_dispatch — GPU runtime validation is now on-demand (dispatch it when the A2000 is online) instead of stalling every merge. All other jobs (lint, cpu ×4, cuda-build compile-check) still run on push/PR and now complete cleanly.
  • Drop continue-on-error so an opt-in GPU run reports failures honestly.

The CUDA backend is still compile-checked on every push/PR by the existing cuda-build job; only the runtime execution moved to opt-in.

🤖 Generated with Claude Code

The gpu job built via 'make -C cuda' and ran ./cuda/test / ./cuda/bench —
none of which exist (there is no cuda/Makefile; the CUDA targets are CMake's
amr_cuda_tests / amr_cuda_bench). It also ran on every push, so when the
self-hosted A2000 is offline the job sits queued indefinitely and the whole
run never completes (the prior dev run was auto-cancelled after ~24h).

Build via CMake to the real targets, and gate the job to workflow_dispatch
so GPU runtime validation is on-demand (run it when the runner is online)
instead of stalling every merge. Drop continue-on-error so an opt-in run
now reports failures honestly.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@nikbott
nikbott merged commit 83edda2 into dev Jul 7, 2026
9 checks passed
@nikbott
nikbott deleted the fix/ci-gpu-cmake branch July 7, 2026 12:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant