Skip to content

fix(jax): skip JAX wheel builds/tests on ASan builds#6213

Closed
erman-gurses wants to merge 1 commit into
mainfrom
users/erman-gurses/add-gate-for-jax
Closed

fix(jax): skip JAX wheel builds/tests on ASan builds#6213
erman-gurses wants to merge 1 commit into
mainfrom
users/erman-gurses/add-gate-for-jax

Conversation

@erman-gurses

@erman-gurses erman-gurses commented Jun 29, 2026

Copy link
Copy Markdown
Contributor

Description

Fixes: #6210
JAX test jobs are failing with:

ASan runtime does not come first in initial library list

This happens because ASan-instrumented ROCm tarballs are being used to build JAX wheels, but the test environment cannot load the ASan runtime correctly.

Changes

  • Added if: ${{ inputs.build_variant != 'asan' }} guard to the trigger_release_jax_wheels job in multi_arch_release_linux.yml.

This prevents dispatching JAX builds for ASan nightlies while keeping normal builds unaffected.

Testing

  • Verified that normal (non-ASan) builds continue to work.
  • ASan builds will no longer trigger JAX wheel jobs (as expected).

@therock-pr-bot

therock-pr-bot Bot commented Jun 29, 2026

Copy link
Copy Markdown

✅ All Checks Passed — Ready for Review

Check Status Details
🌿 Branch Name ✅ Pass
📝 PR Title/Description ✅ Pass
Forbidden Files ✅ Pass
🧪 Unit Test ✅ Pass PR does not contain code files — Unit Test auto-passed
🔎 pre-commit ✅ Pass
🚫 Draft PR 🔜 To Be Enabled
🚩 Feature Flag 🔜 To Be Enabled
📊 Code Coverage 🔜 To Be Enabled
🤖 therock-pr-bot ✅ Pass

🎉 All checks passed! This PR is ready for review.

📖 Need help? See the Policy FAQ for details on every check and how to fix failures.

@erman-gurses erman-gurses requested a review from geomin12 June 29, 2026 15:24
@therock-pr-bot

Copy link
Copy Markdown

🎉 All checks passed! This PR is ready for review.

@erman-gurses

Copy link
Copy Markdown
Contributor Author

@geomin12 , can you please let me know how to test this from ASAN side?

@ScottTodd ScottTodd left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The asan release workflows have deeper issues than just this. Let's disable the nightly/scheduled release jobs before trying to patch like this.

trigger_release_jax_wheels:
needs: [build_artifacts, build_tarballs, build_python_packages]
name: Trigger Release JAX Wheels
if: ${{ inputs.build_variant != 'asan' }}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have some open PRs that will support a different solution here:

multi_arch_release_asan.yml will set build_pytorch: false and build_jax: false which will propagate through all the workflows.

We shouldn't have something different here for jax than we have for pytorch (see line 234 just above)

@erman-gurses

erman-gurses commented Jun 29, 2026

Copy link
Copy Markdown
Contributor Author

Let's disable the nightly/scheduled release jobs before trying to

Sure @ScottTodd , This will drop then since we will solve it with toggle.

@erman-gurses

Copy link
Copy Markdown
Contributor Author

Closing this since the other solutions are in progress.

@github-project-automation github-project-automation Bot moved this from TODO to Done in TheRock Triage Jun 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

[Issue] Jax test fails: ASan runtime not first in library list

2 participants