You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fix(infra): convert config.rollout via to_structured_cfg in all launchers (#956)
Launcher subprocesses use parse_cli_args which returns a plain
DictConfig without dataclass defaults. Accessing fields like
return_routed_experts on unconverted config.rollout crashes because
the key is absent from YAML. sglang_server.py already had this fix;
apply the same to_structured_cfg(config.rollout, InferenceEngineConfig)
to vllm_server.py, local.py, ray.py, and slurm.py.
---------
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Wentai Zhang <zhangwentai.zwt@antgroup.com>
0 commit comments