Repository navigation
[Kernel][SM70] Pipeline batched E5M2 XQA decode - #269
Conversation
Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
|
First exact-head audit on The commit is DCO-signed, but its tree is byte-for-byte identical to base |
|
源码审计结论:该 Draft PR 当前相对最新 main 为 0 个文件、0 行变更,唯一提交只是启动占位提交;正文列出的性能与质量门禁也尚未产出可合并实现。后续主线已吸收相关 XQA 基线工作,因此关闭为空/已失效的跟踪 PR,不制造空合并提交。若出现新的、经算子正确性与匹配性能证据验证的通用硬件/张量契约改动,请从最新 main 新开独立 PR。 |
|
Latest-main audit: Git three-way merge result tree is exactly current main tree |
Purpose
Continue the SM70/V100 batched long-context XQA decode work after #268. This round profiles the remaining E5M2 conversion, shared-memory publication, and QK/PV consumer dependency chain, then admits only one narrow software-pipeline or vector-movement change with measured benefit.
onecat/main@675a12dedcca8cc020c033f1b1d0f1751d4b8efe8808f8e239Starting bottleneck
The accepted #268 B16 ragged 17.8K kernel still has 30.10% long-scoreboard stall, 0.65 eligible warps/scheduler, 41.60% issue active, and 2.19% tensor active. Occupancy is only 18.16%, but #268 proved useful work can increase without raising occupancy: it removed 41.5% of L1 global-load requests and 14.7% of instructions while leaving HBM bytes and occupancy unchanged.
Pending work and gates
This PR remains Draft and will not be promoted or merged unless both correctness and end-to-end speed gates pass. Rejected variants and their measurements will remain documented.