Skip to content

'VulkanWorker' object has no attribute '_get_autobind_cpu_ids' #14

Description

@Neppord

Installed via

uv venv --seed --python 3.12
uv pip install vllm --extra-index-url https://wheels.vllm.ai/nightly/cpu --index-strategy first-index --torch-backend cpu
pip install vllm-vulkan@git+https://github.com/ericcurtin/vllm-vulkan.git

When starting I vllm serve I get this error:

(EngineCore pid=24625) Process EngineCore:
(EngineCore pid=24625) Traceback (most recent call last):
(EngineCore pid=24625)   File "/home/neppord/.local/share/uv/python/cpython-3.12.13-linux-x86_64-gnu/lib/python3.12/multiprocessing/process.py", line 314, in _bootstrap
(EngineCore pid=24625)     self.run()
(EngineCore pid=24625)   File "/home/neppord/.local/share/uv/python/cpython-3.12.13-linux-x86_64-gnu/lib/python3.12/multiprocessing/process.py", line 108, in run
(EngineCore pid=24625)     self._target(*self._args, **self._kwargs)
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/v1/engine/core.py", line 1163, in run_engine_core
(EngineCore pid=24625)     raise e
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/v1/engine/core.py", line 1133, in run_engine_core
(EngineCore pid=24625)     engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs)
(EngineCore pid=24625)                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/tracing/otel.py", line 178, in sync_wrapper
(EngineCore pid=24625)     return func(*args, **kwargs)
(EngineCore pid=24625)            ^^^^^^^^^^^^^^^^^^^^^
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/v1/engine/core.py", line 899, in __init__
(EngineCore pid=24625)     super().__init__(
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/v1/engine/core.py", line 118, in __init__
(EngineCore pid=24625)     self.model_executor = executor_class(vllm_config)
(EngineCore pid=24625)                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/tracing/otel.py", line 178, in sync_wrapper
(EngineCore pid=24625)     return func(*args, **kwargs)
(EngineCore pid=24625)            ^^^^^^^^^^^^^^^^^^^^^
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/v1/executor/abstract.py", line 109, in __init__
(EngineCore pid=24625)     self._init_executor()
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/v1/executor/uniproc_executor.py", line 60, in _init_executor
(EngineCore pid=24625)     self.driver_worker.init_device()
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm/v1/worker/worker_base.py", line 325, in init_device
(EngineCore pid=24625)     self.worker.init_device()  # type: ignore
(EngineCore pid=24625)     ^^^^^^^^^^^^^^^^^^^^^^^^^
(EngineCore pid=24625)   File "/home/neppord/code/vulkan-vllm/.venv/lib/python3.12/site-packages/vllm_vulkan/worker.py", line 65, in init_device
(EngineCore pid=24625)     self.local_omp_cpuid = self._get_autobind_cpu_ids(
(EngineCore pid=24625)                            ^^^^^^^^^^^^^^^^^^^^^^^^^^
(EngineCore pid=24625) AttributeError: 'VulkanWorker' object has no attribute '_get_autobind_cpu_ids'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions