Skip to content

X33: long real rows (half-length power-of-two chains; r2c pairing in the grid's last phase) - #19

Open
jtravs wants to merge 16 commits into
mainfrom
exp/x33-long-real
Open

jtravs wants to merge 16 commits into
mainfrom
exp/x33-long-real

Conversation

@jtravs

@jtravs jtravs commented Nov 16, 2026 •

Copy link
Copy Markdown
Owner

Experiment X33 (PLAN lead (b), long real rows): dev/experiments/X33-long-real.md.

  • Arm b4 (adopted, Apple and Zen-like caches): a real row's half-length power of two follows X32's chain rule (plan_grid no longer excludes real rows). EPYC long real rows 0.58–0.76 of main (FFTN ÷ FFTW 1.14–1.41 → 0.82–0.93), Mac 0.69–0.97; tracking tiers 0.972 (EPYC) and 0.970 (Mac), nothing slower with evidence. The Xeon has no power-of-two chains, so nothing changes there.
  • Arm b1 (adopted on avx512 and NEON, not on avx2): an r2c grid pairs its bins in its last phase. The phase runs over pairs of mirror column sets (columns c·hb + 1 … c·hb + hb and L − l, with hb = block/2 and each set at least a cache line wide), gathered into one block, transformed, paired in registers and written back. Column 0 gets its own stage, and there is no separate pairing pass. The kernels find the iteration from the loop's twiddle cursor, as c2r_pair_gather does. Xeon r2c 2¹⁸–2²⁰ 0.95–0.96; EPYC no gain; build_settings::r2c_pair_last forces it in tests.
  • Screened but not built: b2 (Xeon r2c 65536 as a grid) and b3 (c2r on x86).

🤖 Generated with Claude Code

jtravs and others added 16 commits November 16, 2026 11:42
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…irror column sets

The last phase of an r2c row's half-length grid runs over pairs of column
sets (columns c hb + 1 .. c hb + hb and their mirrors L - l), both gathered
into one block, transformed, paired in registers and written; column 0 in a
stage of its own. No separate pairing pass over the half spectrum.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…X30b)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ing pass

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…st with sets of 2)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… sets wider than half)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…gs::r2c_pair_last for tests

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… pow2_chain_bytes, as c2c rows do (X32)

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@jtravs jtravs changed the title X33: long real rows (r2c pairing in the grid's last phase) X33: long real rows (half-length power-of-two chains; r2c pairing in the grid's last phase) Nov 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant