Skip to content

Commit 07cc866

Browse files
authored
Update sharded_moe.py for formatting
1 parent ee99408 commit 07cc866

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

deepspeed/moe/sharded_moe.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -535,7 +535,8 @@ def forward(self,
535535

536536
elif self.k == 2:
537537
gate_output = top2gating(logits, self.capacity_factor if self.training else self.eval_capacity_factor,
538-
self.min_capacity, self.drop_tokens, self.ep_group, self.top2_2nd_expert_sampling, use_tutel)
538+
self.min_capacity, self.drop_tokens, self.ep_group, self.top2_2nd_expert_sampling,
539+
use_tutel)
539540
else:
540541
gate_output = topkgating(logits, self.k,
541542
self.capacity_factor if self.training else self.eval_capacity_factor,

0 commit comments

Comments
 (0)