[Bugfix][SM70] Stabilize PP2 TP4 FP8 tactics - #349
Draft
yangzhuxinyzx wants to merge 5 commits into
Draft
Conversation
Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Keep dynamic scheduling search while retaining the default FP8 kernel and split-K tree unless the unsafe diagnostic lane is explicitly requested. Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Demote the non-reproducible endpoint, capture the latest PP2 x TP4 trace and strict three-arm results, and define the repeated quality gate for safe accumulation. Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Disable the slower WQA prescale and non-bitwise MXFP4-QPN routes by default while preserving explicit fail-closed diagnostic opt-ins. Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Keep the exact DeepSeek V4 six-route TurboMind kernel and split-K tree while allowing scheduling-only swizzle tuning. Co-authored-by: OpenAI Codex <codex@openai.com> Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Contributor
Author
|
Latest-main audit result: keep Open Draft. The safe-selector direction is reasonable, but the current combined head is explicitly non-admitted: the fixed-arithmetic arm has a pinned correct-to-wrong GSM8K transition with no compensating fix, the safe arm was interrupted, and the new MXFP4 selector lacks its fresh-process operator/restart gate. Repair should isolate the deterministic-selector change and close quality/performance on that exact delta. |
yangzhuxinyzx
changed the base branch from
agent/private-v100-dsv4-pp2tp4-followup-20260826
to
main
August 27, 2026 15:59
This was referenced Sep 6, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
pipeline stages and process restarts.
split-K accumulation tree by default.
open private PR.
Test Plan
evidence only when the trace filter reaches decode descriptors.
restart.
before admission.
warmup/cache and fresh-import tests.
Test Result
tests/test_envs.py: 56 passed.tests/quantization/test_sm70_warmup.py: 17 passed.CUDA translation unit compiles for SM70.
_Ctarget built successfully (50/50). Extension SHA256 is139aaf8e2d28d497c53bbd6ea4473523ebaf0802a978294135e8e1f15745debb;all 38 embedded cubins are
sm_70and none targets another architecture.the intended absent-environment defaults: FP8 safe selector on, WQA
prescaled-M1 off, MXFP4 B1 safe selector on, and MXFP4-QPN off.
latter remains rejected after 93/136 non-bitwise operator comparisons plus
a model-level correct-to-wrong transition. The completed deterministic arm
now also rejects the WQA-default-off change; it must be reverted or its
quality root repaired before this Draft can merge.
kernel/split-K tree while retaining measured swizzle. Its planned
64-pattern, fresh-process operator/restart gate was cancelled before launch
when testing was stopped; it is not admitted.
73.662and73.592 token/s; within each restart all three performance outputs match,but the hashes differ across restarts, as do the chat outputs. The first
diagnostic filter spent its trace quota on prefill, so it is explicitly not
claimed as M=1 trace evidence. An older exact M=1 trace of the same selector
mechanism records multiple split-K trees on three of five dense descriptors
(
5/6,2/4, and1/2).That arm records GSM8K
62/64with zero invalid answers, HumanEval29/32,LongBench
40.320, and median64.132 token/s. Pinned-correct GSM item 37regresses from
2to0with no compensating fix, so the hard quality gatefails. The safe arm was interrupted before datasets/performance; diagnostic,
restart, and one-GPU follow-ups did not run. All owned GPU processes and
queues were cleaned. This PR remains Draft and non-admitted.
AI assistance was used. Every changed line and the final evidence must be
reviewed by the human submitter.