HMoE: Heterogeneous Mixture of Experts for Language Modeling. - Wang, An; Sun, Xingwu; Xie, Ruobing; Li, Shuaipeng; Zhu, Jiaqi; Yang, Zhen; Zhao, Pinxue; Han, J. N.; Kang, Zhanhui; Wang, Di; Okazaki, Naoaki; Xu, Cheng-Zhong (CoRR, 2024)