Skip to content

v2.5.0-pre1

Pre-release
Pre-release
Compare
Choose a tag to compare
@apage43 apage43 released this 06 Oct 21:52

Pre-release 1 of version 2.5.0 is now available! This is a pre-release with offline installers and includes:

  • GGUF file format support (only, old model files will not run)
  • Completely new set of models including Mistral and Wizard v1.2
  • Restored support for Falcon model (which is now GPU accelerated)
  • Restored support for MPT
  • Based on latest llama.cpp as of late September
  • Speed improvements and bugfixes to GPU support
  • Improved GUI for cpu/gpu fallback
  • Numerous other improvements