Structured Packing in LLM Training Improves Long Context Utilization - Konrad Staniszewski; Szymon Tworkowski; Sebastian Jaszczur; Yu Zhao; Henryk Michalewski; Lukasz Kucinski; Piotr Milos (AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25 - March 4, 2025, Philadelphia, PA, USA, 2025)

Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient - Jan Ludziejewski; Maciej Pióro; Jakub Krajewski; Maciej Stefaniak; Michal Krutul; Jan Malasnicki; Marek Cygan; Piotr Sankowski; Kamil Adamczewski; Piotr Milos; Sebastian Jaszczur (CoRR, 2025)

Since Faithfulness Fails: The Performance Limits of Neural Causal Discovery - Mateusz Olko; Mateusz Gajewski; Joanna Wojciechowska; Mikolaj Morzy; Piotr Sankowski; Piotr Milos (CoRR, 2025)

Lightweight Latent Verifiers for Efficient Meta-Generation Strategies - Bartosz Piotrowski; Witold Drzewakowski; Konrad Staniszewski; Piotr Milos (CoRR, 2025)

Beyond Recognition: Evaluating Visual Perspective Taking in Vision Language Models - Gracjan Góral; Alicja Ziarko; Piotr Milos; Michal Nauman; Maciej Wolczyk; Michal Kosinski (CoRR, 2025)

Analysing The Impact of Sequence Composition on Language Model Pre-Training - Yu Zhao; Yuanbin Qu; Konrad Staniszewski; Szymon Tworkowski; Wei Liu; Piotr Milos; Yuxiang Wu; Pasquale Minervini (Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024, 2024)

Magnushammer: A Transformer-Based Approach to Premise Selection - Maciej Mikula; Szymon Tworkowski; Szymon Antoniak; Bartosz Piotrowski; Albert Q. Jiang; Jin Peng Zhou; Christian Szegedy; Lukasz Kucinski; Piotr Milos; Yuhuai Wu (The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024, 2024)

Overestimation, Overfitting, and Plasticity in Actor-Critic: the Bitter Lesson of Reinforcement Learning - Michal Nauman; Michal Bortkiewicz; Piotr Milos; Tomasz Trzcinski; Mateusz Ostaszewski; Marek Cygan (Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024, 2024)

Fine-tuning Reinforcement Learning Models is Secretly a Forgetting Mitigation Problem - Maciej Wolczyk; Bartlomiej Cupial; Mateusz Ostaszewski; Michal Bortkiewicz; Michal Zajac; Razvan Pascanu; Lukasz Kucinski; Piotr Milos (Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024, 2024)

Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe - Albert Q. Jiang; Alicja Ziarko; Bartosz Piotrowski; Wenda Li; Mateja Jamnik; Piotr Milos (Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024, 2024)

Bigger, Regularized, Optimistic: scaling for compute and sample efficient continuous control - Michal Nauman; Mateusz Ostaszewski; Krzysztof Jankowski; Piotr Milos; Marek Cygan (Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024, Vancouver, BC, Canada, December 10 - 15, 2024, 2024)

Fine-tuning Reinforcement Learning Models is Secretly a Forgetting Mitigation Problem - Maciej Wolczyk; Bartlomiej Cupial; Mateusz Ostaszewski; Michal Bortkiewicz; Michal Zajac; Razvan Pascanu; Lukasz Kucinski; Piotr Milos (CoRR, 2024)

Analysing The Impact of Sequence Composition on Language Model Pre-Training - Yu Zhao; Yuanbin Qu; Konrad Staniszewski; Szymon Tworkowski; Wei Liu; Piotr Milos; Yuxiang Wu; Pasquale Minervini (CoRR, 2024)

Overestimation, Overfitting, and Plasticity in Actor-Critic: the Bitter Lesson of Reinforcement Learning - Michal Nauman; Michal Bortkiewicz; Mateusz Ostaszewski; Piotr Milos; Tomasz Trzcinski; Marek Cygan (CoRR, 2024)

tsGT: Stochastic Time Series Modeling With Transformer - Lukasz Kucinski; Witold Drzewakowski; Mateusz Olko; Piotr Kozakowski; Lukasz Maziarka; Marta Emilia Nowakowska; Lukasz Kaiser; Piotr Milos (CoRR, 2024)

Bigger, Regularized, Optimistic: scaling for compute and sample-efficient continuous control - Michal Nauman; Mateusz Ostaszewski; Krzysztof Jankowski; Piotr Milos; Marek Cygan (CoRR, 2024)

What Matters in Hierarchical Search for Combinatorial Reasoning Problems? - Michal Zawalski; Gracjan Góral; Michal Tyrolski; Emilia Wisnios; Franciszek Budrowski; Lukasz Kucinski; Piotr Milos (CoRR, 2024)

Repurposing Language Models into Embedding Models: Finding the Compute-Optimal Recipe - Alicja Ziarko; Albert Q. Jiang; Bartosz Piotrowski; Wenda Li; Mateja Jamnik; Piotr Milos (CoRR, 2024)

RapidDock: Unlocking Proteome-scale Molecular Docking - Rafal Powalski; Bazyli Klockiewicz; Maciej Jaskowski; Bartosz Topolski; Pawel Dabrowski-Tumanski; Maciej Wisniewski; Lukasz Kucinski; Piotr Milos; Dariusz Plewczynski (CoRR, 2024)

The Effectiveness of World Models for Continual Reinforcement Learning - Samuel Kessler; Mateusz Ostaszewski; Michal Pawel Bortkiewicz; Mateusz Zarski; Maciej Wolczyk; Jack Parker-Holder; Stephen J. Roberts; Piotr Milos (Conference on Lifelong Learning Agents, 22-25 August 2023, McGill University, Montréal, Québec, Canada, 2023)

Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search - Michal Zawalski; Michal Tyrolski; Konrad Czechowski; Tomasz Odrzygózdz; Damian Stachura; Piotr Piekos; Yuhuai Wu; Lukasz Kucinski; Piotr Milos (The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023, 2023)

The Tunnel Effect: Building Data Representations in Deep Neural Networks - Wojciech Masarczyk; Mateusz Ostaszewski; Ehsan Imani; Razvan Pascanu; Piotr Milos; Tomasz Trzcinski (Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023)

Trust Your 120513: Gradient-based Intervention Targeting for Causal Discovery - Mateusz Olko; Michal Zajac; Aleksandra Nowak; Nino Scherrer; Yashas Annadani; Stefan Bauer; Lukasz Kucinski; Piotr Milos (Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023)

Focused Transformer: Contrastive Training for Context Scaling - Szymon Tworkowski; Konrad Staniszewski; Mikolaj Pacek; Yuhuai Wu; Henryk Michalewski; Piotr Milos (Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023, 2023)

Magnushammer: A Transformer-based Approach to Premise Selection - Maciej Mikula; Szymon Antoniak; Szymon Tworkowski; Albert Qiaochu Jiang; Jin Peng Zhou; Christian Szegedy; Lukasz Kucinski; Piotr Milos; Yuhuai Wu (CoRR, 2023)

Exploring Continual Learning of Diffusion Models - Michal Zajac; Kamil Deja; Anna Kuzina; Jakub M. Tomczak; Tomasz Trzcinski; Florian Shkurti; Piotr Milos (CoRR, 2023)

The Tunnel Effect: Building Data Representations in Deep Neural Networks - Wojciech Masarczyk; Mateusz Ostaszewski; Ehsan Imani; Razvan Pascanu; Piotr Milos; Tomasz Trzcinski (CoRR, 2023)

Focused Transformer: Contrastive Training for Context Scaling - Szymon Tworkowski; Konrad Staniszewski; Mikolaj Pacek; Yuhuai Wu; Henryk Michalewski; Piotr Milos (CoRR, 2023)

Structured Packing in LLM Training Improves Long Context Utilization - Konrad Staniszewski; Szymon Tworkowski; Sebastian Jaszczur; Henryk Michalewski; Lukasz Kucinski; Piotr Milos (CoRR, 2023)

Off-Policy Correction For Multi-Agent Reinforcement Learning - Michal Zawalski; Blazej Osinski; Henryk Michalewski; Piotr Milos (21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2022, Auckland, New Zealand, May 9-13, 2022, 2022)

Planning and Learning using Adaptive Entropy Tree Search - Piotr Kozakowski; Mikolaj Pacek; Piotr Milos (International Joint Conference on Neural Networks, IJCNN 2022, Padua, Italy, July 18-23, 2022, 2022)

Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers - Albert Qiaochu Jiang; Wenda Li; Szymon Tworkowski; Konrad Czechowski; Tomasz Odrzygózdz; Piotr Milos; Yuhuai Wu; Mateja Jamnik (Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022, 2022)

Disentangling Transfer in Continual Reinforcement Learning - Maciej Wolczyk; Michal Zajac; Razvan Pascanu; Lukasz Kucinski; Piotr Milos (Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022, 2022)

Thor: Wielding Hammers to Integrate Language Models and Automated Theorem Provers - Albert Q. Jiang; Wenda Li; Szymon Tworkowski; Konrad Czechowski; Tomasz Odrzygózdz; Piotr Milos; Yuhuai Wu; Mateja Jamnik (CoRR, 2022)

Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search - Michal Zawalski; Michal Tyrolski; Konrad Czechowski; Damian Stachura; Piotr Piekos; Tomasz Odrzygózdz; Yuhuai Wu; Lukasz Kucinski; Piotr Milos (CoRR, 2022)

Disentangling Transfer in Continual Reinforcement Learning - Maciej Wolczyk; Michal Zajac; Razvan Pascanu; Lukasz Kucinski; Piotr Milos (CoRR, 2022)

Trust Your \(\): Gradient-based Intervention Targeting for Causal Discovery - Mateusz Olko; Michal Zajac; Aleksandra Nowak; Nino Scherrer; Yashas Annadani; Stefan Bauer; Lukasz Kucinski; Piotr Milos (CoRR, 2022)

The Surprising Effectiveness of Latent World Models for Continual Reinforcement Learning - Samuel Kessler; Piotr Milos; Jack Parker-Holder; Stephen J. Roberts (CoRR, 2022)

Structure and Randomness in Planning and Reinforcement Learning - Konrad Czechowski; Piotr Januszewski; Piotr Kozakowski; Lukasz Kucinski; Piotr Milos (International Joint Conference on Neural Networks, IJCNN 2021, Shenzhen, China, July 18-22, 2021, 2021)

Trust, but Verify: Alleviating Pessimistic Errors in Model-Based Exploration - Konrad Czechowski; Tomasz Odrzygózdz; Michal Izworski; Marek Zbysinski; Lukasz Kucinski; Piotr Milos (International Joint Conference on Neural Networks, IJCNN 2021, Shenzhen, China, July 18-22, 2021, 2021)

Subgoal Search For Complex Reasoning Tasks - Konrad Czechowski; Tomasz Odrzygózdz; Marek Zbysinski; Michal Zawalski; Krzysztof Olejnik; Yuhuai Wu; Lukasz Kucinski; Piotr Milos (Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, 2021)

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication - Lukasz Kucinski; Tomasz Korbak; Pawel Kolodziej; Piotr Milos (Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, 2021)

Continual World: A Robotic Benchmark For Continual Reinforcement Learning - Maciej Wolczyk; Michal Zajac; Razvan Pascanu; Lukasz Kucinski; Piotr Milos (Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual, 2021)

Robust and Efficient Planning using Adaptive Entropy Tree Search - Piotr Kozakowski; Mikolaj Pacek; Piotr Milos (CoRR, 2021)

Continual World: A Robotic Benchmark For Continual Reinforcement Learning - Maciej Wolczyk; Michal Zajac; Razvan Pascanu; Lukasz Kucinski; Piotr Milos (CoRR, 2021)

Subgoal Search For Complex Reasoning Tasks - Konrad Czechowski; Tomasz Odrzygózdz; Marek Zbysinski; Michal Zawalski; Krzysztof Olejnik; Yuhuai Wu; Lukasz Kucinski; Piotr Milos (CoRR, 2021)

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication - Lukasz Kucinski; Tomasz Korbak; Pawel Kolodziej; Piotr Milos (CoRR, 2021)

Off-Policy Correction For Multi-Agent Reinforcement Learning - Michal Zawalski; Blazej Osinski; Henryk Michalewski; Piotr Milos (CoRR, 2021)

Continuous Control With Ensemble Deep Deterministic Policy Gradients - Piotr Januszewski; Mateusz Olko; Michal Królikowski; Jakub Swiatkowski; Marcin Andrychowicz; Lukasz Kucinski; Piotr Milos (CoRR, 2021)

Model Based Reinforcement Learning for Atari - Lukasz Kaiser; Mohammad Babaeizadeh; Piotr Milos; Blazej Osinski; Roy H. Campbell; Konrad Czechowski; Dumitru Erhan; Chelsea Finn; Piotr Kozakowski; Sergey Levine; Afroz Mohiuddin; Ryan Sepassi; et al. (8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020, 2020)

Simulation-Based Reinforcement Learning for Real-World Autonomous Driving - Blazej Osinski; Adam Jakubowski; Pawel Ziecina; Piotr Milos; Christopher Galias; Silviu Homoceanu; Henryk Michalewski (2020 IEEE International Conference on Robotics and Automation, ICRA 2020, Paris, France, May 31 - August 31, 2020, 2020)

CARLA Real Traffic Scenarios - novel training ground and benchmark for autonomous driving - Blazej Osinski; Piotr Milos; Adam Jakubowski; Pawel Ziecina; Michal Martyniak; Christopher Galias; Antonia Breuer; Silviu Homoceanu; Henryk Michalewski (CoRR, 2020)

Model-Based Reinforcement Learning for Atari - Lukasz Kaiser; Mohammad Babaeizadeh; Piotr Milos; Blazej Osinski; Roy H. Campbell; Konrad Czechowski; Dumitru Erhan; Chelsea Finn; Piotr Kozakowski; Sergey Levine; Ryan Sepassi; George Tucker; et al. (CoRR, 2019)

Developmentally motivated emergence of compositional communication via template transfer - Tomasz Korbak; Julian Zubek; Lukasz Kucinski; Piotr Milos; Joanna Raczaszek-Leonardi (CoRR, 2019)

Simulation-based reinforcement learning for real-world autonomous driving - Blazej Osinski; Adam Jakubowski; Piotr Milos; Pawel Ziecina; Christopher Galias; Silviu Homoceanu; Henryk Michalewski (CoRR, 2019)

Uncertainty-sensitive Learning and Planning with Ensembles - Piotr Milos; Lukasz Kucinski; Konrad Czechowski; Piotr Kozakowski; Maciej Klimek (CoRR, 2019)

Learning to Run challenge solutions: Adapting reinforcement learning methods for neuromusculoskeletal environments - Lukasz Kidzinski; Sharada Prasanna Mohanty; Carmichael F. Ong; Zhewei Huang; Shuchang Zhou; Anton Pechenko; Adam Stelmaszczyk; Piotr Jarosik; Mikhail Pavlov; Sergey Kolesnikov; Sergey M. Plis; Zhibo Chen; et al. (CoRR, 2018)

Expert-augmented actor-critic for ViZDoom and Montezumas Revenge - Michal Garmulewicz; Henryk Michalewski; Piotr Milos (CoRR, 2018)

Hierarchical Reinforcement Learning with Parameters - Maciej Klimek; Henryk Michalewski; Piotr Milos (1st Annual Conference on Robot Learning, CoRL 2017, Mountain View, California, USA, November 13-15, 2017, Proceedings, 2017)