forked from NVIDIA/Megatron-LM
-
Notifications
You must be signed in to change notification settings - Fork 348
Pull requests: deepspeedai/Megatron-DeepSpeed
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Simplify SP - Opportunity to improve SP scalability
#301
opened Nov 28, 2023 by
RezaYazdaniAminabadi
Loading…
Fix ConstantGradScaler and loss-scale argument not match
#376
opened Apr 12, 2024 by
BeingGod
Loading…
fix --use-cpu-initialization error when expert is not tensor-parallel
#413
opened Jul 3, 2024 by
taozhiwei
Loading…
[Bug]Add sequence_parallel in layernorm init to enable 3D parallelism with DeepSpeed for non CUDA device.
#468
opened Feb 28, 2025 by
ys950902
Loading…
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.