Offline RL strikes back! In our new Q-Transformer paper, we introduce a scalable framework for offline reinforcement learning using Transformers and autoregressive Q-Learning to learn from mixed-quality datasets!
Website and paper: q-transformer.github.io 🧵
Robotic foundation models @NVIDIA 🤖
Previously @GoogleDeepMind (VLAs, RT-2, Offline RL) and @Figure_robot (Helix models)
Joined March 2017






