[Video] Package H3 execution capabilities for Studio FA and explicit VSA - #588
Merged
yangzhuxinyzx merged 3 commits intoSep 10, 2026
Merged
Conversation
Retain UUID GPU selection, real progress, and disk-backed low-RAM loading. Package the calibrated communication kernel and expose an ABI-checked Studio profile with collective resource fallback. Assisted-by: OpenAI Codex Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Assisted-by: OpenAI Codex Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
Assisted-by: OpenAI Codex Signed-off-by: yangzhuxinyzx <153831768+yangzhuxinyzx@users.noreply.github.com>
yangzhuxinyzx
marked this pull request as ready for review
September 10, 2026 05:18
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
Package H3's existing exact row reduction with the other SM70 extensions and expose a CPU-safe capability descriptor for Studio. Supported TP4 V100 deployments can select column-major floating projections, query-tiled FA, peer residual rows, pageable host masters and shared VAEs without first-request CUDA compilation. Agree on available peer memory and accessibility across ranks; fall back to native FP32 reduction with a recorded reason when unsuitable.
The descriptor separately advertises the sparse binary inherited from #583 for explicit FastH3 VSA selection. Native CLI/AUTO defaults remain compatible. Original floating FL2VA and official Dense/VSA Data-Free adapters are required; this does not repurpose INT8 ConvRot or LightX2V models.
Test Plan
Check source/wheel extension registration, CPU capability probing and peer setup fallbacks, build the actual remote extensions, run focused sparse GPU checks, and compare the two explicit modes through real Studio frontend submissions on the allocated TP4 group.
Test Result
docs/design/minimax_h3/STUDIO_FASTPATH.md.Remote frontend evidence
On the allocated TP4 V100 SXM2 32 GB host (Torch 2.10.0+cu128, CUDA 12.8, 62 GiB host RAM, 300 W limits; no GPU settings changed), real UI submissions used original FL2VA, matched prompt/seed 42, 1280×736, 120 requested frames, 24 FPS, four actual denoiser intervals, and each backend's official FastH3 Data-Free adapter. One excluded warmup + three measured requests per mode.
All eight outputs passed browser playback/download and complete FFmpeg decode with 124 aligned frames and audio. All ranks reported the requested backend and four DiT calls; peer residual route did not fall back. Measured MP4s were bitwise-repeatable within each mode. Adapter changes require reloading (VSA cold preparation: 944.26 s), which is excluded from warmed medians and shown separately in Studio. Tested native source:
5e50ef0df7; later native changes are documentation only. Detailed run IDs and report digest are in the checked-in implementation report.VSA still fails the independent FP32 quality gate inherited from #583. This is explicit experimental execution, with no AUTO/default quality promotion and no promise of halving complete generation time. Dense and VSA use different official adapters; this is not output-equivalence evidence or an INT8/LightX2V comparison.