text-generation-inference 3.1.1 (new formula)

[ankane]

• Have you followed the guidelines for contributing?
• Have you ensured that your commits follow the commit style guide?
• Have you checked that there aren't other open pull requests for the same formula update/change?
• Have you built your formula locally with HOMEBREW_NO_INSTALL_FROM_API=1 brew install --build-from-source <formula>, where <formula> is the name of the formula you're submitting?
• Is your test running fine brew test <formula>, where <formula> is the name of the formula you're submitting?
• Does your build pass brew audit --strict <formula> (after doing HOMEBREW_NO_INSTALL_FROM_API=1 brew install --build-from-source <formula>)? If this is a new formula, does it pass brew audit --new <formula>?

---

Notes

• The project uses a uv lockfile for Python dependencies
• The test downloads a smaller model (~350 MB) by the Hugging Face team

[ankane]

I'm not able to get text-generation-server to use / find the virtual env packages when running (looks like I had the necessary packages installed globally when testing). libexec/bin/text-generation-server references the virtual env Python and I tried write_env_script with PATH and PYTHONPATH, but no luck. Will close this out, but someone is welcome to resubmit if they can figure it out.