Skip to content

Add Ubi container #213

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from
Closed

Conversation

strangiato
Copy link

This PR adds a new UBI based containerfile as an alternative to the current docker python container.

UBI generally recommends utilizing /opt/app-root as the default location for installing/configuring end user application software so this PR also makes the entrypoint.sh able to utilize a GUIDELLM_BIN environment variable to allow the correct bin location to be defined in the container.

📦 Build Artifacts Available
The build artifacts (.whl and .tar.gz) have been successfully generated and are available for download: https://github.com/neuralmagic/guidellm/actions/runs/15985795268/artifacts/3436352632.
They will be retained for up to 30 days.

Copy link
Collaborator

@sjmonson sjmonson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@strangiato I don't really want to have two container images that do basically the same thing. Can you make you changes to the existing container image and replace the PYTHON arg with BASE_IMAGE=docker.io/python:3.13-slim. Ideally we would switch over completely to the ubi image, but we need python3.13 for our upstream bulild.

sjmonson added a commit to sjmonson/guidellm that referenced this pull request Jul 30, 2025
sjmonson added a commit that referenced this pull request Jul 30, 2025
Signed-off-by: Samuel Monson <[email protected]>
sjmonson added a commit that referenced this pull request Jul 30, 2025
Signed-off-by: Samuel Monson <[email protected]>
sjmonson added a commit that referenced this pull request Jul 30, 2025
* Drop the container entrypoint script as GuideLLM has had native
support for its features since #99
* Make containerfile more rebuild friendly based on #213 
* Drop the ENV default scenario as it is confusing to users setting CLI
args

Closes: #213

---------

Signed-off-by: Samuel Monson <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants