List view

fix no_shard training convergency and add unittest for no_shard

ApprovedAll necessary approvals have been madeAll necessary approvals have been made

module: megatron-fsdp

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3754

#3754 In NVIDIA/Megatron-LM;

· wplf opened on Mar 9, 2026

Remove MoE throughput test

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2075

#2075 In NVIDIA/Megatron-LM;

· mathemakitten opened on Oct 31, 2025

nonuniform tensor parallelism

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2149

#2149 In NVIDIA/Megatron-LM;

· daiyaanarfeen opened on Nov 5, 2025

feat: Apply RoPE embedding with sequence offsets

complexity: low

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2416

#2416 In NVIDIA/Megatron-LM;

· sudhakarsingh27 opened on Nov 26, 2025

added pad tokens as dummy sequence

ApprovedAll necessary approvals have been madeAll necessary approvals have been made

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2591

#2591 In NVIDIA/Megatron-LM;

· jalbericiola opened on Dec 8, 2025

Track split_megabytes in wandb.

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2629

#2629 In NVIDIA/Megatron-LM;

· yobibyte opened on Dec 11, 2025

Log tokens per second

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2412

#2412 In NVIDIA/Megatron-LM;

· mathemakitten opened on Nov 26, 2025

Add flashinfer

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2768

#2768 In NVIDIA/Megatron-LM;

· kanz-nv opened on Dec 27, 2025

Update MoE functional test 2.0 configs

dev branchDev branch related issues and developmentDev branch related issues and development

Run functional tests

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2731

#2731 In NVIDIA/Megatron-LM;

· Victarry opened on Dec 22, 2025

Fix stale parameter index map in DistributedOptimizer

complexity: medium

Final ReviewPR is in the "final review" stagePR is in the "final review" stage

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2872

#2872 In NVIDIA/Megatron-LM;

· ahmadki opened on Jan 8, 2026

RL training cudagraphs test

ApprovedAll necessary approvals have been madeAll necessary approvals have been made

Run functional tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2949

#2949 In NVIDIA/Megatron-LM;

· mathemakitten opened on Jan 14, 2026

Change final review logic for PRs

complexity: medium

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 3072

#3072 In NVIDIA/Megatron-LM;

· Phlip79 opened on Jan 25, 2026

fix: Improve robustness and correctness in data preprocessing

community-request

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2628

#2628 In NVIDIA/Megatron-LM;

· iuyo5678 opened on Dec 11, 2025

Muon Documentation and user guide

docs-onlydocumentation only (docs or docstrings)documentation only (docs or docstrings)

Status: Open.

Documentation

#3176 In NVIDIA/Megatron-LM;

· BoxiangW opened on Jan 30, 2026

Fix averaging for MoE z-loss metric tracking

community-request

complexity: low

waiting-on-maintainersWaiting on maintainers to respondWaiting on maintainers to respond

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3199

#3199 In NVIDIA/Megatron-LM;

· Marks101 opened on Feb 2, 2026

Draft: Support mamba layer fine grained offloading with cudagraphs

complexity: medium

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 3204

#3204 In NVIDIA/Megatron-LM;

· jiemingz opened on Feb 2, 2026

Fix: disable nccl_ub when ep

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 3299

#3299 In NVIDIA/Megatron-LM;

· youngeunkwon0405 opened on Feb 6, 2026

Remove pickle from dist ckpt

complexity: low

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 3368

#3368 In NVIDIA/Megatron-LM;

· Phlip79 opened on Feb 11, 2026

Remove pickle from rest of repo

complexity: low

Final ReviewPR is in the "final review" stagePR is in the "final review" stage

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 3370

#3370 In NVIDIA/Megatron-LM;

· Phlip79 opened on Feb 11, 2026

Move OS model examples to separate sub-directory

complexity: low

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 3352

#3352 In NVIDIA/Megatron-LM;

· Phlip79 opened on Feb 10, 2026

Create a Protocol for the MLP layer of TransformerLayer

community-request

complexity: medium

Final ReviewPR is in the "final review" stagePR is in the "final review" stage

waiting-on-maintainersWaiting on maintainers to respondWaiting on maintainers to respond

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3435

#3435 In NVIDIA/Megatron-LM;

· nschank opened on Feb 15, 2026

Use Protocols to type-check linear_proj submodules of Attention

ApprovedAll necessary approvals have been madeAll necessary approvals have been made

community-request

complexity: medium

waiting-on-maintainersWaiting on maintainers to respondWaiting on maintainers to respond

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3434

#3434 In NVIDIA/Megatron-LM;

· nschank opened on Feb 15, 2026

Change the cudagraph distribution from linearly to exponentially-decreasing

complexity: low

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Run functional tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3509

#3509 In NVIDIA/Megatron-LM;

· mathemakitten opened on Feb 20, 2026

Remove Triton cache manager patch

complexity: low

Expert Review[deprecated] Apply this label to indicate that your PR is ready for expert review.[deprecated] Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3523

#3523 In NVIDIA/Megatron-LM;

· janEbert opened on Feb 20, 2026

Fuse dLN + add pattern in transformer_layer

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3383

#3383 In NVIDIA/Megatron-LM;

· CarlosGomes98 opened on Feb 12, 2026