Can't run sglang weights exchange

[chaokunyang]

Search before asking

• I had searched in the issues and found no similar issues.

Version

main

Component(s)

Engine

Minimal reproduce step

/

What did you expect to see?

/

What did you see instead?

File "/inspire/hdd/project/qianghuaxuexi/public/wty/sglang/python/sglang/srt/managers/scheduler.py", line 2713, in run_scheduler_process
    scheduler.event_loop_overlap()
  File "/inspire/hdd/global_user/wangtongyu-25057/miniconda3/envs/py12_dev/lib/python3.12/site-packages/torch/utils/_contextlib.py", line 120, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/sglang/python/sglang/srt/managers/scheduler.py", line 1009, in event_loop_overlap
    self.process_input_requests(recv_reqs)
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/sglang/python/sglang/srt/managers/scheduler.py", line 1187, in process_input_requests
    output = self._request_dispatcher(recv_req)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/sglang/python/sglang/utils.py", line 507, in __call__
    return fn(obj)
           ^^^^^^^
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/sglang/python/sglang/srt/managers/scheduler.py", line 2479, in execute_task_in_model_worker
    result = self.model_worker.execute_task_in_model_worker(task_spec)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/sglang/python/sglang/srt/managers/tp_worker.py", line 106, in execute_task_in_model_worker
    return self.model_runner.execute_task_in_model_worker(task_spec, models=models)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/sglang/python/sglang/srt/model_executor/model_runner.py", line 931, in execute_task_in_model_worker
    return task_func(**kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/asystem-awex/awex/meta/infer_meta_resolver.py", line 151, in _get_model_param_info
    rank_info = get_rank_info_extractor(engine_name)(model_context, engine_rank)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/inspire/hdd/project/qianghuaxuexi/public/wty/asystem-awex/awex/sharding/sglang_sharding.py", line 54, in get_sglang_rank_info
    infer_engine_config.enable_ep_moe
AttributeError: 'ServerArgs' object has no attribute 'enable_ep_moe'. Did you mean: 'enable_eplb'?

Anything Else?

sgl-project/sglang#13595

Are you willing to submit a PR?

• I'm willing to submit a PR!

[new-TonyWang]

Try this pr:#96