Issues

• [ALERT] Access to NVIDIA's Self-Hosted Runners is Expiring

  nvidia-runners
  NVIDIA-NeMo/Emerging-Optimizers#297 · Filter by author nvidia-runner-mgmt opened on Sep 9, 2026

• [Optimizer Proposal] NEAT: conflict-aware optimization via directional gradient correction

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#295 · Filter by author ItCodinTime opened on Sep 5, 2026

• Docs: note where library defaults diverge from the arXiv 2607.20548 recipe (momentum, weight decay, NS iterations, RMS scale)

  NVIDIA-NeMo/Emerging-Optimizers#259 · Filter by author adpena opened on Jul 24, 2026
  1

• Locoprop-S and Newton-Muon support via TE, Megatron-LM changes.

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#215 · Filter by author plugyawn opened on May 30, 2026
  4

• Adding symmetry-compatible / equivariant optimizers for general matrix-valued parameters

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#188 · Filter by author timlautk opened on May 20, 2026
  5

• Reduce latency

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#109 · Filter by author skyw opened on Feb 24, 2026
  

• Adding Layerwise GN (https://arxiv.org/pdf/2510.09378)

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#59 · Filter by author switiz opened on Oct 15, 2025
  2

• Add support for the normalized and orthogonal optimizers with matrix sign

  enhancement
  NVIDIA-NeMo/Emerging-Optimizers#28 · Filter by author mkhona-nvidia opened on Sep 26, 2025