Magistral. - Rastogi, Abhinav; Jiang, Albert Q.; Lo, Andy; Berrada, Gabrielle; Lample, Guillaume; Rute, Jason; Barmentlo, Joep; Yadav, Karmesh; Khandelwal, Kartik; Chandu, Khyathi Raghavi; Blier, Léonard; Saulnier, Lucile; et al. (CoRR, 2025)

Magnushammer: A Transformer-Based Approach to Premise Selection. - Mikula, Maciej; Tworkowski, Szymon; Antoniak, Szymon; Piotrowski, Bartosz; Jiang, Albert Q.; Zhou, Jin Peng; Szegedy, Christian; Kucinski, Lukasz; Milos, Piotr; Wu, Yuhuai (2024)

Scaling Laws for Fine-Grained Mixture of Experts. - Ludziejewski, Jan; Krajewski, Jakub; Adamczewski, Kamil; Pióro, Maciej; Krutul, Michal; Antoniak, Szymon; Ciebiera, Kamil; Król, Krystian; Odrzygózdz, Tomasz; Sankowski, Piotr; Cygan, Marek; Jaszczur, Sebastian (2024)

Mixture of Tokens: Continuous MoE through Cross-Example Aggregation. - Antoniak, Szymon; Krutul, Michal; Pióro, Maciej; Krajewski, Jakub; Ludziejewski, Jan; Ciebiera, Kamil; Król, Krystian; Odrzygózdz, Tomasz; Cygan, Marek; Jaszczur, Sebastian (2024)

Mixtral of Experts. - Jiang, Albert Q.; Sablayrolles, Alexandre; Roux, Antoine; Mensch, Arthur; Savary, Blanche; Bamford, Chris; Chaplot, Devendra Singh; Casas, Diego de Las; Hanna, Emma Bou; Bressand, Florian; Lengyel, Gianna; Bour, Guillaume; et al. (CoRR, 2024)

Scaling Laws for Fine-Grained Mixture of Experts. - Krajewski, Jakub; Ludziejewski, Jan; Adamczewski, Kamil; Pióro, Maciej; Krutul, Michal; Antoniak, Szymon; Ciebiera, Kamil; Król, Krystian; Odrzygózdz, Tomasz; Sankowski, Piotr; Cygan, Marek; Jaszczur, Sebastian (CoRR, 2024)

Pixtral 12B. - Agrawal, Pravesh; Antoniak, Szymon; Hanna, Emma Bou; Bout, Baptiste; Chaplot, Devendra Singh; Chudnovsky, Jessica; Costa, Diogo; Monicault, Baudouin De; Garg, Saurabh; Gervet, Théophile; Ghosh, Soham; Héliou, Amélie; et al. (CoRR, 2024)

Magnushammer: A Transformer-based Approach to Premise Selection. - Mikula, Maciej; Antoniak, Szymon; Tworkowski, Szymon; Jiang, Albert Qiaochu; Zhou, Jin Peng; Szegedy, Christian; Kucinski, Lukasz; Milos, Piotr; Wu, Yuhuai (CoRR, 2023)

Mixture of Tokens: Efficient LLMs through Cross-Example Aggregation. - Antoniak, Szymon; Jaszczur, Sebastian; Krutul, Michal; Pióro, Maciej; Krajewski, Jakub; Ludziejewski, Jan; Odrzygózdz, Tomasz; Cygan, Marek (CoRR, 2023)