lm-eval 0.4.9.2 (new formula)

[marndt]

lm-evaluation-harness (PyPI: lm-eval) is a framework for few-shot evaluation of language models.

• Have you followed the guidelines for contributing?
• Have you ensured that your commits follow the commit style guide?
• Have you checked that there aren't other open pull requests for the same formula update/change?
• Have you built your formula locally with HOMEBREW_NO_INSTALL_FROM_API=1 brew install --build-from-source <formula>, where <formula> is the name of the formula you're submitting?
• Is your test running fine brew test <formula>, where <formula> is the name of the formula you're submitting?
• Does your build pass brew audit --strict <formula> (after doing HOMEBREW_NO_INSTALL_FROM_API=1 brew install --build-from-source <formula>)? If this is a new formula, does it pass brew audit --new <formula>?

---

[github-actions]

Thanks for contributing to Homebrew! 🎉 It looks like you're having trouble with a CI failure. See our contribution guide for help. You may be most interested in the section on dealing with CI failures. You can find the CI logs in the Checks tab of your pull request.

[daeho-ro]

Test is too heavy, and safetensors build numpy and scipy again even though there are homebrew formula. There might be more efficient way to build this, but I have no idea yet.

[github-actions]

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[botantony]

IMO this would look nicer

Suggested change

	venv = virtualenv_create(libexec, "python3.14")
	# Install numpy and scipy from Homebrew formulas first
	# This prevents resources like safetensors from building them from source
	site_packages = Language::Python.site_packages(venv.root/"bin/python3")
	numpy_site_packages = Formula["numpy"].opt_libexec/site_packages
	scipy_site_packages = Formula["scipy"].opt_libexec/site_packages
	# Create .pth files to link Homebrew numpy and scipy into the virtualenv
	(venv.site_packages/"homebrew-numpy.pth").write "import site; site.addsitedir('#{numpy_site_packages}')\n"
	(venv.site_packages/"homebrew-scipy.pth").write "import site; site.addsitedir('#{scipy_site_packages}')\n"
	venv = virtualenv_create(libexec, "python3.14")
	# Install numpy and scipy from Homebrew formulas first
	# This prevents resources like safetensors from building them from source
	site_packages = Language::Python.site_packages(venv.root/"bin/python3")
	(venv.site_packages/"homebrew-numpy.pth").write <<~PYTHON
	import site
	site.addsitedir('#{Formula["numpy"].opt_libexec/site_packages}')
	PYTHON
	(venv.site_packages/"homebrew-scipy.pth").write <<~PYTHON
	import site
	site.addsitedir('#{Formula["scipy"].opt_libexec/site_packages}')
	PYTHON

[botantony]

Suggested change

# Install resources, excluding hf-xet which needs special handling

[botantony]

Same here

Suggested change

	# We depend on pytorch, but that's a separate formula, so install a `.pth` file to link them.
	# NOTE: This is an exception to our usual policy as building `pytorch` is complicated
	pth_contents = "import site; site.addsitedir('#{Formula["pytorch"].opt_libexec/site_packages}')\n"
	(venv.site_packages/"homebrew-pytorch.pth").write pth_contents
	# We depend on pytorch, but that's a separate formula, so install a `.pth` file to link them.
	# NOTE: This is an exception to our usual policy as building `pytorch` is complicated
	(venv.site_packages/"homebrew-pytorch.pth").write <<~PYTHON
	import site
	site.addsitedir('#{Formula["pytorch"].opt_libexec/site_packages}')
	PYTHON