Karsten Roth

@confusezius

RS @GoogleDeepMind | PhD @ELLISforEurope 🇪🇺 w/ @zeynepakata & @OriolVinyalsML; Large Models × {Lifelong, Data, Multimodal} | Views are my own.

karroth.com

Joined June 2019

Replies Reposts Media

Pinned
Karsten Roth
@confusezius
Aug 4, 2025
💫 After four PhD years on all things multimodal, pre- and post-training, I’m super excited for a new research chapter @GoogleDeepMind 🇨🇭! Biggest thanks to @zeynepakata and @OriolVinyalsML for all the guidance, support, and incredibly eventful and defining research years ♥️!
23
Karsten Roth
@confusezius
Jul 3
Super sweet to see this paper finally out! This was such a labor of love, and definitely well worth a read!
Vishaal Udandarao
@vishaal_urao
Jul 2
🚀New Paper arxiv.org/abs/2606.28551 Everyone obsesses over VLM architectures & training recipes. But what about the data? Presenting the latest work in the DataComp-series: a testbed for VLM data curation with 1,000+ controlled experiments and some surprising lessons 👀 🧵👇
1
Karsten Roth
@confusezius
Jun 3
So exciting to help build encoder-free Gemma from scratch! Amazing to see all modalities intertwined in one single LLM decoder 🧬. Bonus for my academic heart ❤️👓: it's simple to run and brings some new architectural insights to the OSS community! 🧵1/n
00:00
Google Gemma
@googlegemma
Jun 3
Meet Gemma 4 12B! A unified, encoder-free multimodal model designed to bring high-performance intelligence directly to your laptop, and released under an Apache 2.0 license. Bridging the gap between edge efficiency and advanced reasoning. Here is what’s new with Gemma 4 12B: 👇
1
Karsten Roth
@confusezius
Jun 13, 2025
In Nashville for my last PhD conference 🥲. Come join today 10:30-12:30 in Hall D (#391) to talk insights, tips and tricks to modify pretraining for representation reuse - scalably. 🚀Joint work w/ @zeynepakata, @dimadamen, @ibalazevic & @olivierhenaff while at @GoogleDeepMind.
2
Karsten Roth
@confusezius
Apr 8, 2025
How does lifelong knowledge editing currently hold up in the real world? Fun new work probing where we are at these days with injecting new knowledge into LLMs.
Lukas Thede
@lukas_thede
Apr 8, 2025
🧠 Keeping LLMs factually up to date is a common motivation for knowledge editing. But what would it actually take to support this in practice at the scale and speed the real world demands? We explore this question and really push the limits of lifelong knowledge editing. 👇