[WIP, do not merge] Integrate FlashAttention into OPT fine-tuning#1

DanFu09 wants to merge 2 commits intoDS3Lab:mainDS3Lab/Decentralized_FM_alpha:mainfrom

DanFu09:mainDanFu09/Decentralized_FM_alpha:mainCopy head branch name to clipboard