Add CISPO loss option and documentation#4298

gustavorubim wants to merge 1 commit into

huggingface:mainhuggingface/trl:mainfrom

gustavorubim:CISPOCopy head branch name to clipboard