Skip to content

0.2.0 Bicleaner

Compare
Choose a tag to compare
@eu9ene eu9ene released this 26 Jul 17:02
· 336 commits to main since this release
ec783cf
  • SacreBLEU is a regular importer now and evaluation is not limited to sacrebleu datasets.

  • Added bicleaner-ai and bicleaner filtering (one or another based on available pretrained language packs).

  • Added a script to find all datasets based on language pair and importer type, ready to use in config.

  • Fixed conda environment activation to be reproducible on GCP.

  • Other minor reproducibility fixes.