Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
332 Open 2,090 Closed
332 Open 2,090 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Support GEMM + Swiglu fused MLP complexity: high
#3971 opened Mar 20, 2026 by ksivaman Loading…
5 tasks
2
Cudagraphs: Remove fwd_graph_input_surface weakref complexity: low
#3970 opened Mar 20, 2026 by mathemakitten Loading…
5 tasks
Core 0.16
4
Enable cpu_offloading with Full iteration CUDA graph Final Review PR is in the "final review" stage
#3969 opened Mar 20, 2026 by vasunvidia Loading…
5 tasks
2
Phase 1: Add new files from main (main-to-dev migration)
#3968 opened Mar 20, 2026 by ilml Loading…
3 tasks
Core 0.16
2
[OMNIML-3721] Fix tokenizer unwrapping for nested Megatron-Core tokenizer
#3967 opened Mar 20, 2026 by jenchen13 • Draft
5 tasks
1
ci: Split out inference tests
#3966 opened Mar 20, 2026 by ko3n1g • Draft
5 tasks
Core 0.16
8
Fix mtp_use_repeated_layer behavior for GPT models community-request complexity: low
#3965 opened Mar 20, 2026 by rkarimimahab Loading…
5 tasks
3
Fix bug with non-partial rollouts complexity: low
#3964 opened Mar 20, 2026 by tdene Loading…
5 tasks
Core 0.16
2
Fix: qk-clip causes a tensor shape error when tensor-model-parallel-size > 1 community-request Final Review PR is in the "final review" stage
#3963 opened Mar 20, 2026 by xzy-xzy Loading…
5 tasks
2
Clean up TE MXFP8 state after converting to MCore MXFP8 format
#3960 opened Mar 20, 2026 by santhnm2 • Draft
5 tasks
1
Small quality-of-life improvements in megatron/training Approved All necessary approvals have been made complexity: low
#3957 opened Mar 19, 2026 by deepakn94 Loading… Core 0.16
2
Add moe loss normalization for RL SFT complexity: low
#3956 opened Mar 19, 2026 by pthombre Loading…
5 tasks
2
fix: use dump file prefix for NCCL flight recorder temp files complexity: low
#3955 opened Mar 19, 2026 by sbak5 Loading…
5 tasks
7
Add LoRA-after-quantization support and misc Packed Sequence fixes
#3954 opened Mar 19, 2026 by jenchen13 • Draft
5 tasks
1
Fix completions endpoint Approved All necessary approvals have been made complexity: low Run functional tests
#3940 opened Mar 19, 2026 by santhnm2 Loading…
5 tasks
Core 0.16
2
Fix key error in layer_wise_optimizer.sharded_state_dict community-request Final Review PR is in the "final review" stage
#3939 opened Mar 19, 2026 by chenchun Loading…
1 of 5 tasks
2
Fix FSDP checkpoint conversion and loading for Qwen3.5-VL community-request Final Review PR is in the "final review" stage
#3936 opened Mar 19, 2026 by DAISY-gh Loading…
5 tasks
5
Make text generation server hostname configurable complexity: low Final Review PR is in the "final review" stage
#3935 opened Mar 18, 2026 by santhnm2 Loading…
5 tasks
4
Refit optimization Approved All necessary approvals have been made complexity: medium
#3933 opened Mar 18, 2026 by wdykas Loading…
5 tasks
Core 0.16
4
Add Claude PR Tracking complexity: medium
#3932 opened Mar 18, 2026 by Phlip79 • Draft Core 0.16
10
Improve load balancing behavior for prefix cache-aware routing complexity: low Final Review PR is in the "final review" stage
#3930 opened Mar 18, 2026 by santhnm2 Loading…
5 tasks
Core 0.16
24
Inference | Per-block MoE routing storage for prefix caching compatibility complexity: medium
#3928 opened Mar 18, 2026 by lmcafee-nvidia Loading…
2 of 3 tasks
Core 0.16
@lmcafee-nvidia
5
Add --muon-coefficient-type argument for Muon optimizer complexity: low Final Review PR is in the "final review" stage
#3927 opened Mar 18, 2026 by mchrzanowski Loading…
12
Dump router recording data into a ray store for Nemo-RL
#3925 opened Mar 18, 2026 by sidsingh-nvidia • Draft
5 tasks
Core 0.16
3
Add FLOP_EFFICIENCY eviction policy for prefix caching complexity: medium
#3923 opened Mar 18, 2026 by lmcafee-nvidia Loading…
2 tasks
Core 0.16
@lmcafee-nvidia
3
ProTip! What’s not been updated in a month: updated:<2026-02-20.