v3.3.0
Features
Added
- Add int8 quantization for embeddings (experimental)
- Add tests for int8 quantization
- Add dynamic versioning with
hatch-vcs - Add loggers in modules (with
loguru)
Changed
- Re-organize quantization modules
Fixed
- Fix dtype conversion in
ColPaliScorer - Fix int8 overflow when computing ColBERT score w/ int8 embeddings
- Fix quantization tests
Removed
- Remove unused
ColPaliWithPoolingRetriever
Full Changelog: v3.2.0...v3.3.0