Skip to content

v3.3.0

Choose a tag to compare

@tonywu71 tonywu71 released this 22 Aug 09:25
· 84 commits to main since this release

Features

Added

  • Add int8 quantization for embeddings (experimental)
  • Add tests for int8 quantization
  • Add dynamic versioning with hatch-vcs
  • Add loggers in modules (with loguru)

Changed

  • Re-organize quantization modules

Fixed

  • Fix dtype conversion in ColPaliScorer
  • Fix int8 overflow when computing ColBERT score w/ int8 embeddings
  • Fix quantization tests

Removed

  • Remove unused ColPaliWithPoolingRetriever

Full Changelog: v3.2.0...v3.3.0