19/06/2025 We've released a comprehensive overview of hierarchical reinforcement learning. This is our attempt at covering hundreds of research articles and distilling insights from leading experts in the field.
10/02/2025MaestroMotif has been given an oral presentation at ICLR 2025! Take a look at our vision for the future of human-AI collaboration.
25/01/2025 Two papers accepted at ICLR 2025! (1) MaestroMotif: a scalable algorithm for building hierarchical agents. (2) We study the capabilities of LLMs to model policies, rewards and transition functions.
04/03/2023 Co-organizing a workshop on "Training Agents with Foundation Models" at RLC in August. We have some exciting things coming, stay tuned!
25/10/2023 The work resulting from my Meta internship, Motif, has been accepted at ICLR 2024! 🎶
25/10/2023 We have released the code for Motif, a general method to distill prior knowledge from LLMs into actionable RL agents. We have also published a short blogpost that describes Motif.
05/06/2023 Started a research intern at Meta Montreal with Shagun Sodhani, Mikael Henaff and Amy Zhang!
31/01/2023 The project we worked on with Marlos C. Machado during my DeepMind intern has been released on arXiv! We scale up a promising approach for option discovery that yields strong exploration performance.
08/10/2022 Selected as a Top Reviewer at NeurIPS 2022! We all have a part to play in making our research community better, as much as time allows us.
14/09/2022 Our work on leveraging meta learning for emphatic algorithms was accepted at NeurIPS 2022!
11/07/2022 Started a research internship at DeepMind Alberta with Marlos C. Machado!
16/04/2022 Selected as a Highlighted Reviewer for ICLR 2022! Hopefully those reviews helped the authors.
15/10/2021 Selected as an Outstanding Reviewer (top 8%) for NeurIPS 2021! Amazing to be recognized for the time and thought put into the reviewing service.
28/09/2021"Flexible Option Learning" has been accepted as a Spotlight to NeurIPS 2021! The paper and code will be out soon.
23/09/2021 Started a research internship at Amazon Web Services under the supervision of Alex Smola and Rasool Fakoor.
01/04/2021 Started a research internship at Microsoft Research Montreal under the supervision of Mehdi Fatemi and Romain Laroche.
Highlighted Research
MaestroMotif: Skill Design from Artificial Intelligence Feedback Martin Klissarov, Mikael Henaff, Roberta Raileanu, Shagun Sodhani, Pascal Vincent, Amy Zhang, Pierre-Luc Bacon, Doina Precup, Marlos C. Machado*, Pierluca D'Oro*
International Conference on Learning Representations (ICLR), 2025, Oral
Motif: Intrinsic Motivation from Artificial Intelligence Feedback Martin Klissarov*, Pierluca D'Oro*, Shagun Sodhani, Roberta Raileanu, Pierre-Luc Bacon, Pascal Vincent, Amy Zhang and Mikael Henaff
International Conference on Learning Representations (ICLR), 2024
FMDM Workshop at NeurIPS 2023, Spotlight
ALOE Workshop at NeurIPS 2023, Spotlight