Skip to content

Jaxtranspilerpath - #681

Merged
HenryNdubuaku merged 14 commits into
cactus-compute:v2from
Ayan9074:jaxtranspilerpath
Jun 2, 2026
Merged

HenryNdubuaku merged 14 commits into
cactus-compute:v2from
Ayan9074:jaxtranspilerpath

Conversation

@Ayan9074

Copy link
Copy Markdown
Contributor

Summary

Expands generic JAX/Flax fusion support

Changed

  • Added semantic rewrites for RMSNorm/ZCRMSNorm, LayerNorm, and compatible self/cross-attention.
  • Added attention mask/layout guards so unsupported broadcast-mask layouts remain decomposed.
  • Consolidated JAX tests

Internal KV-cache management is still not automatic; users can expose cache-aware decoder_step graphs explicitly.

TODO

  • Add broader attention layout fusion support, especially BTHD/BHSD variants.
  • Add automatic internal KV-cache lowering for compatible decoder-step graphs.
  • Add Conv fusions and Pool support for vision-style Flax/JAX models.

@HenryNdubuaku
HenryNdubuaku merged commit bf31835 into cactus-compute:v2 Jun 2, 2026
0 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants