List view

Remove MoE throughput test

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2075

#2075 In NVIDIA/Megatron-LM;

· mathemakitten opened on Oct 31, 2025

[Dev] Changes to support multimodule pipelining

dev branchDev branch related issues and developmentDev branch related issues and development

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2092

#2092 In NVIDIA/Megatron-LM;

· yashaswikarnati opened on Nov 3, 2025

nonuniform tensor parallelism

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2149

#2149 In NVIDIA/Megatron-LM;

· daiyaanarfeen opened on Nov 5, 2025

feat: enhance one_logger_utils to support rankpulse integration

community-request

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 1988

#1988 In NVIDIA/Megatron-LM;

· sanshang-nv opened on Oct 28, 2025

[MoE] Improvement of shared expert overlap, support shared expert overlap for FlexDispatcher

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2207

#2207 In NVIDIA/Megatron-LM;

· Victarry opened on Nov 11, 2025

feat: Apply RoPE embedding with sequence offsets

complexity: low

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2416

#2416 In NVIDIA/Megatron-LM;

· sudhakarsingh27 opened on Nov 26, 2025

[Dev] feat: Dynamic CP (part 2)

dev branchDev branch related issues and developmentDev branch related issues and development

enhancementNew feature or requestNew feature or request

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2000

#2000 In NVIDIA/Megatron-LM;

· xiaoyao0115 opened on Oct 28, 2025

Refactoring of PP implementation for hybrid models to support virtual pipeline parallelism

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2492

#2492 In NVIDIA/Megatron-LM;

· deepakn94 opened on Dec 4, 2025

[Dev] Refactor and Improve MoE Logging

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2569

#2569 In NVIDIA/Megatron-LM;

· yanring opened on Dec 5, 2025

added pad tokens as dummy sequence

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2591

#2591 In NVIDIA/Megatron-LM;

· jalbericiola opened on Dec 8, 2025

Dnarayanan/latent moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2594

#2594 In NVIDIA/Megatron-LM;

· pablo-garay opened on Dec 9, 2025

Track split_megabytes in wandb.

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2629

#2629 In NVIDIA/Megatron-LM;

· yobibyte opened on Dec 11, 2025

Fix kv cache offloading in MRL

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2633

#2633 In NVIDIA/Megatron-LM;

· sidsingh-nvidia opened on Dec 11, 2025

Log tokens per second

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2412

#2412 In NVIDIA/Megatron-LM;

· mathemakitten opened on Nov 26, 2025

Paged Stashing

community-request

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2690

#2690 In NVIDIA/Megatron-LM;

· nanz-nv opened on Dec 17, 2025

Refactor setup.py to use get_pybind_include

community-request

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2611

#2611 In NVIDIA/Megatron-LM;

· sakgoyal opened on Dec 10, 2025

Explicitly delete objects in async checkpoint worker loop and call GC

complexity: low

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2740

#2740 In NVIDIA/Megatron-LM;

· apaithankar opened on Dec 23, 2025

Add flashinfer

complexity: high

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2768

#2768 In NVIDIA/Megatron-LM;

· kanz-nv opened on Dec 27, 2025

Update MoE functional test 2.0 configs

dev branchDev branch related issues and developmentDev branch related issues and development

Run functional tests

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2731

#2731 In NVIDIA/Megatron-LM;

· Victarry opened on Dec 22, 2025

Fix stale parameter index map in DistributedOptimizer

complexity: medium

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2872

#2872 In NVIDIA/Megatron-LM;

· ahmadki opened on Jan 8, 2026

fix --use-te-activation-func

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2908

#2908 In NVIDIA/Megatron-LM;

· ahmadki opened on Jan 12, 2026

Reorganize the building of active-masked tensors in context

complexity: medium

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2929

#2929 In NVIDIA/Megatron-LM;

· tdene opened on Jan 13, 2026

RL training cudagraphs test

Run functional tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2949

#2949 In NVIDIA/Megatron-LM;

· mathemakitten opened on Jan 14, 2026

fix(moe): improve error message for GroupedMLP FP8 support

community-request

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

needs-follow-upIssue needs follow-upIssue needs follow-up

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 3015

#3015 In NVIDIA/Megatron-LM;

· liuyun7345 opened on Jan 20, 2026

[dev] feat(moe): Support packed sequence for gated delta net (GDN)

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2644

#2644 In NVIDIA/Megatron-LM;

· yuzhongw-nvidia opened on Dec 12, 2025