mini-moe A simplified implementation of Mixture-of-Experts style model, made for educational purposes.