Skip to content

if no expert found in parameter that have expert in name the loop should continue #7685

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 9 commits into
base: master
Choose a base branch
from
+1 −0
Draft

if no expert found in parameter that have expert in name the loop should continue #7685

Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
b3888f3
fixed some weird behaivoir in deepspeed which does allow me to import…
LckyLke Nov 5, 2025
cb0cde7
Update version.txt after release (#7675)
loadams Nov 6, 2025
e37bdef
[modal ci] fixes (#7676)
stas00 Nov 6, 2025
1834cbb
leaf modules: explain better (#7674)
stas00 Nov 7, 2025
ad66ab2
disable nv-lightning-v100.yml cI (#7681)
stas00 Nov 8, 2025
ed8c436
allow seperate learning rate "muon_lr" and "adam_lr" for muon optimiz…
delock Nov 11, 2025
78ada8c
if no expert found in parameter that have expert in name it should co…
LckyLke Nov 11, 2025
eba1752
Revert "fixed some weird behaivoir in deepspeed which does allow me t…
LckyLke Nov 11, 2025
d96c92b
Merge branch 'master' into master
LckyLke Nov 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions deepspeed/runtime/engine.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3601,6 +3601,7 @@ def _save_moe_checkpoint(self, save_dir, tag, client_state={}, exclude_frozen_pa
local_expert_id = None
if not m:
logger.warning(f'No expert found in key {key}.')
continue
else:
local_expert_id = m.group(1)

Expand Down
Loading