Robert M. Gower

@gowerrobert

Often found scribbling down math with intermittent bursts of bashing out code.

New York City, USA

gowerrobert.github.io

Joined June 2011

358 Following

1,729 Followers

Replies Reposts Media

Pinned
Robert M. Gower
@gowerrobert
Nov 19, 2024
Do you want to do a Postdoc developing new methods/theory in Optimization for deep learning/ML? Do you enjoy bluesky open research and discussions on black boards? Then Apply to the Flatiron Fellowship in the Center of Computational Mathematics simonsfoundation.org/flatiron/caree… 1/3
1
Robert M. Gower
@gowerrobert
Aug 18
We've been working for about a year now on how to port the core idea of Muon to LoRA (low rank) finetuning. If you're interested in Muon, preconditioned Muon, Lora, let me tell you about what we learned and our PoLoRA method arxiv.org/abs/2607.17620 nikhilgsh.github.io/polora/
6
Robert M. Gower
@gowerrobert
Jul 15
Looking for some original acoustic Brazilian songs? Check out my cousins new channel. Her songs and voice are amazing. She's going to be star.
youtube.com
Veridiana
Cantora & compositora brasileira, nascida e residente em São Paulo.
Robert M. Gower
@gowerrobert
May 5
And now we are very proud and humbled to have received the ICLR 2026 Honorable Mention award for this work blog.iclr.cc/2026/04/23/ann… Very fun to have found this useful math nugget that can actually speed-up LLM training.
Robert M. Gower
@gowerrobert
Jun 4, 2025
Are you interested in the new Muon/Scion/Gluon method for training LLMs? To run Muon, you need to approximate the matrix sign (or polar factor) of the momentum matrix. We've developed an optimal method *The PolarExpress* just for this! If you're interested, climb aboard 1/x
Robert M. Gower
@gowerrobert
May 4
Very happy that this has now been accepted to ICML2026! Great, systematic work done by @CrichaelMawshaw
Robert M. Gower
@gowerrobert
Nov 6, 2025
We've just finished some work on improving the sensitivity of Muon to the learning rate, and exploring a lot of design choices. If you want to see how we did this, follow me ....1/x (Work lead by the amazing @CrichaelMawshaw)