Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .cd/Dockerfile.rhel.tenc.pytorch.vllm
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,9 @@ ARG TORCH_TYPE_SUFFIX
FROM ${DOCKER_URL}/${VERSION}/${BASE_NAME}/${REPO_TYPE}/pytorch-${TORCH_TYPE_SUFFIX}installer-${PT_VERSION}:${REVISION}

# Parameterize commit/branch for vllm-plugin checkout
ARG VLLM_GAUDI_COMMIT=main
ARG VLLM_GAUDI_COMMIT=v0.14.1
# leave empty to use last-good-commit-for-vllm-gaudi
ARG VLLM_PROJECT_COMMIT=
ARG VLLM_PROJECT_COMMIT=v0.14.1

ARG BASE_NAME
ENV BASE_NAME=${BASE_NAME}
Expand Down
4 changes: 2 additions & 2 deletions .cd/Dockerfile.rhel.ubi.vllm
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,8 @@ ARG BASE_NAME=rhel9.6
ARG PT_VERSION=2.9.0
# can be upstream or fork
ARG TORCH_TYPE=upstream
ARG VLLM_GAUDI_COMMIT=main
ARG VLLM_PROJECT_COMMIT=
ARG VLLM_GAUDI_COMMIT=v0.14.1
ARG VLLM_PROJECT_COMMIT=v0.14.1

# ============================================================================
# Stage 1: gaudi-base - Base system setup with Habana drivers
Expand Down
5 changes: 2 additions & 3 deletions .cd/Dockerfile.ubuntu.pytorch.vllm
Original file line number Diff line number Diff line change
Expand Up @@ -13,9 +13,8 @@ ARG TORCH_TYPE_SUFFIX
FROM ${DOCKER_URL}/${VERSION}/${BASE_NAME}/${REPO_TYPE}/pytorch-${TORCH_TYPE_SUFFIX}installer-${PT_VERSION}:${REVISION}

# Parameterize commit/branch for vllm-project & vllm-gaudi checkout
ARG VLLM_GAUDI_COMMIT=main
# leave empty to use last-good-commit-for-vllm-gaudi
ARG VLLM_PROJECT_COMMIT=
ARG VLLM_GAUDI_COMMIT=v0.14.1
ARG VLLM_PROJECT_COMMIT=v0.14.1
ENV OMPI_MCA_btl_vader_single_copy_mechanism=none

RUN apt update && \
Expand Down
6 changes: 3 additions & 3 deletions .cd/Dockerfile.ubuntu.pytorch.vllm.nixl.latest
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,8 @@ FROM ${DOCKER_URL}/${VERSION}/${BASE_NAME}/${REPO_TYPE}/pytorch-${TORCH_TYPE_SUF

# Parameterize commit/branch for vllm-project & vllm-gaudi checkout
# leave empty to use last-good-commit-for-vllm-gaudi
ARG VLLM_PROJECT_COMMIT=
ARG VLLM_GAUDI_COMMIT=main
ARG VLLM_PROJECT_COMMIT=v0.14.1
ARG VLLM_GAUDI_COMMIT=v0.14.1

ENV OMPI_MCA_btl_vader_single_copy_mechanism=none

Expand Down Expand Up @@ -47,7 +47,7 @@ RUN \
echo "Using vLLM commit : ${VLLM_PROJECT_COMMIT}"; \
fi && \
mkdir -p $VLLM_PATH && \
# Clone vllm-project/vllm and use configured or last good commit hash
# Clone vllm-project/vllm and use configured or last good commit hash
git clone https://github.com/vllm-project/vllm.git $VLLM_PATH && \
cd $VLLM_PATH && \
git remote add upstream https://github.com/vllm-project/vllm.git && \
Expand Down
8 changes: 4 additions & 4 deletions docs/getting_started/compatibility_matrix.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,8 @@ title: Compatibility Matrix

The following table detail the supported vLLM versions for Intel® Gaudi® 2 and Intel® Gaudi® 3 AI accelerators.

| Intel Gaudi Software | vLLM v0.10.0 | vLLM v0.10.1 | vLLM v0.11.2 | vLLM v0.12.0 |
| Intel Gaudi Software | vLLM v0.10.1 | vLLM v0.11.2 | vLLM v0.13.0 | vLLM v0.14.1 |
| :------------------- | :----------: | :----------: | :----------: | :------------: |
| 1.22.1 | ✅ Alfa | ✅ Beta | ❌ | ❌ |
| 1.22.2 | ❌ | | | ❌ |
| 1.23.0 | ❌ | | | In development |
| 1.22.1 | ✅ Beta | | ❌ | ❌ |
| 1.22.2 | ❌ | | | ❌ |
| 1.23.0 | ❌ | | | |
4 changes: 2 additions & 2 deletions docs/getting_started/installation.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,8 +61,8 @@ There are two ways to install vLLM Hardware Plugin for Intel® Gaudi® from sour

2. Run the latest Docker image from the Intel® Gaudi® vault as in the following code sample. Make sure to provide your versions of vLLM Hardware Plugin for Intel® Gaudi®, operating system, and PyTorch. Ensure that these versions are supported, according to the [Support Matrix](https://docs.habana.ai/en/latest/Support_Matrix/Support_Matrix.html).

docker pull vault.habana.ai/gaudi-docker/1.23.0/ubuntu24.04/habanalabs/pytorch-installer-2.9.0:latest
docker run -it --runtime=habana -e HABANA_VISIBLE_DEVICES=all -e OMPI_MCA_btl_vader_single_copy_mechanism=none --cap-add=sys_nice --net=host --ipc=host vault.habana.ai/gaudi-docker/1.23.0/ubuntu24.04/habanalabs/pytorch-installer-2.9.0:latest
docker pull vault.habana.ai/gaudi-docker/{{ VERSION }}/ubuntu24.04/habanalabs/pytorch-installer-{{ PT_VERSION }}:latest
docker run -it --runtime=habana -e HABANA_VISIBLE_DEVICES=all -e OMPI_MCA_btl_vader_single_copy_mechanism=none --cap-add=sys_nice --net=host --ipc=host vault.habana.ai/gaudi-docker/{{ VERSION }}/ubuntu24.04/habanalabs/pytorch-installer-{{ PT_VERSION }}:latest

For more information, see the [Intel Gaudi documentation](https://docs.habana.ai/en/latest/Installation_Guide/Bare_Metal_Fresh_OS.html#pull-prebuilt-containers).

Expand Down
4 changes: 4 additions & 0 deletions docs/release_notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,10 @@

This document provides an overview of the features, changes, and fixes introduced in each release of the vLLM Hardware Plugin for Intel® Gaudi®.

## 0.14.1

This version is based on [vLLM 0.14.1](https://github.com/vllm-project/vllm/releases/tag/v0.14.1) and supports [Intel® Gaudi® v1.23.0](https://docs.habana.ai/en/v1.23.0/Release_Notes/GAUDI_Release_Notes.html).

## 0.13.0

This version is based on [vLLM 0.13.0](https://github.com/vllm-project/vllm/releases/tag/v0.13.0) and supports [Intel® Gaudi® v1.23.0](https://docs.habana.ai/en/v1.23.0/Release_Notes/GAUDI_Release_Notes.html).
Expand Down
Loading