Tomasz Limisiewicz

@TomLimi

Postdoctoral researcher at @meta Fair and @uwnlp , Interested in going into the inner workings of neural networks, multilingualism, and fairer NLP (he/him)

Seattle

Joined September 2021

536 Following

888 Followers

Replies Reposts Media

Pinned
Tomasz Limisiewicz
@TomLimi
May 4
We present Compute Optimal Tokenization! 🔡 Common in LLM scaling works stick to one tokenizer, sweeping data/model size. But what happens when we control the tokenizer’s compression rate (bytes/token)? Here we sweep tokenizers, params, and data across compute budgets: [1/N]
21
Tomasz Limisiewicz
@TomLimi
Nov 3
Amazing results! A great case for byte-based and latent-tokenized models like H-Net! Still, most LLM research and all known frontier LLMs use subwords. Here is my list of crucial research directions pushing us toward non-subword frontier models: 1/5
Albert Gu
@_albertgu
Oct 28
I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data. Language
3
Tomasz Limisiewicz
@TomLimi
Oct 27
Szia 👋🇭🇺 Happy to be in Budapest for EMNLP. I'll be sharing few lessons learned on byte language models, latent tokenization at tomorrow’s Tokenization Tutorial (in P2 from 9 -12:30). tokenization-tutorial.github.io/tutorial/
Tomasz Limisiewicz
@TomLimi
Oct 10
There are bigger workshops out there, but @tokshopMeeting is the friendliest one!
2
Tomasz Limisiewicz
@TomLimi
Oct 10
@clara__meister dropping hot takes on tokenization in first sentence already 🔥
Tokenization Workshop (TokShop) @COLM2026
@tokshopMeeting
Oct 10
Finally, we have an amazing lineup in the panel moderated by Yuval!
1

Tomasz Limisiewicz

Tomasz Limisiewicz’s posts