MFTCoder v0.3.0: Support more open source models, support Self-Paced Loss, support FSDP
Updates:
- Mainly for MFTCoder-accelerate.
- It now supports more open source models like Mistral, Mixtral(MoE), DeepSeek-coder, chatglm3.
- It supports FSDP as an option.
- It also supports Self-paced Loss as a solution for convergence balance in Multitask Fine-tuning.