Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
169 Open 277 Closed
169 Open 277 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Enabling variable_seq_lengths when encoder has Different TP Size
#1470 opened Mar 12, 2025 by xiaojunjie Loading…
fix(moe): the missing argument 'router_dtype' of _DeepepManager.__init__
#1463 opened Mar 11, 2025 by AsakusaRinne Loading…
Draft: Youngeun/a2a hiding
#1460 opened Mar 10, 2025 by lhb8125 Loading…
[Bug Fix] fix p2p communication order error and stuck problems when pp 2 and vpp 2 with remove pad
#1451 opened Mar 5, 2025 by ETOgaosion Loading…
[ENHANCEMENT] add z-loss (improved version)
#1442 opened Feb 28, 2025 by wdevazelhes Loading…
Replace deprecated numpy.product with numpy.prod to ensure compatibility with NumPy >=2.0
#1440 opened Feb 27, 2025 by mustious Loading…
fix seq_aux_loss for DeepSeek-V3
#1439 opened Feb 27, 2025 by yzlnew Loading…
1
fix a bug in load balancing loss aggregation when recompute is turned on
#1433 opened Feb 26, 2025 by lyuwen Loading…
a proof of concept for Distributed Muon
#1428 opened Feb 24, 2025 by toothacher17 Loading…
47
fix: return float instead of tensor from get_rotary_seq_len
#1419 opened Feb 20, 2025 by jasonchiu-codeium Loading…
Fix document regarding GQA (--group-query-attention) argument
#1401 opened Feb 12, 2025 by eagle705 Loading…
Fix issue in converting Mixtral 8x7B checkpoints from HF to MCore and update doc
#1397 opened Feb 11, 2025 by yeahdongcn Loading…
Enabling Alternative Path ABC implementations
#1393 opened Feb 10, 2025 by ashvinnihalani Loading…
Fix typo in GPTModel forward function comments
#1391 opened Feb 9, 2025 by Zzhiter Loading…
support bf16 dtype for optimizer states using precision-aware optimizer in TransformerEngine
#1390 opened Feb 8, 2025 by XiaobingSuper • Draft
add qkv_bias
#1388 opened Feb 7, 2025 by Chandler-Bing Loading…
Update LICENSE
#1382 opened Feb 6, 2025 by maximevtush Loading…
add moe_router_device_choice_method argument to choose method …
#1381 opened Feb 6, 2025 by bzantium Loading…
1
3
Add LongRoPE support
#1377 opened Feb 5, 2025 by 16bitmood Loading…
add .sh file
#1373 opened Feb 4, 2025 by umsanmaru Loading…
KV-cache for T5 model
#1358 opened Jan 17, 2025 by YK-Fu Loading…
fix typo stale No activity in 60 days on issue or PR
#1352 opened Jan 10, 2025 by Jintao-Huang Loading…
1
fix param overwrite problem in saver_mcore stale No activity in 60 days on issue or PR
#1351 opened Jan 9, 2025 by Force1ess Loading…
1
Fix typo stale No activity in 60 days on issue or PR
#1347 opened Jan 4, 2025 by deep-sci Loading…
1
1
fix bugs of data preprocessing with multiple json keys stale No activity in 60 days on issue or PR
#1337 opened Dec 25, 2024 by junjzhang Loading…
1
ProTip! no:milestone will show everything without a milestone.