Justin Deschenaux

@jdeschena

PhD student @EPFL advised by @caglarml. Working on diffusion language models ⚡️ Join our reading group: @diffusion_llms

Suisse

jdeschena.com

Joined May 2013

825 Following

1,261 Followers

Replies Reposts Media

Pinned
Justin Deschenaux
@jdeschena
May 13
🔥 New paper: Language Modeling with Hyperspherical Flows Recent flow language models (FLMs) all use Gaussian noise. Makes sense for images, but not necessarily for text 🫠 We propose to add noise by rotating embeddings on 𝕊^{d−1} instead 🌐 w/ @caglarml (1/9)
12
Justin Deschenaux
@jdeschena
12h
Missed the talk? Check out the recording on YouTube: youtu.be/rfkbgd83u-o
Discrete Diffusion Reading Group
@diffusion_llms
Oct 27
This Monday, Nov 2, Dmitry Baranchuk (@DmitryBaranchuk) will present his paper: Representation-Space MMD for Diffusion Language Models Project also co-led by Ilya Drobyshevskiy (@free001style) and Ilia Sudakov (@sudakov_il)!
Justin Deschenaux
@jdeschena
Oct 29
Lets remember that ~6month ago, the strong option was gemini 3.1 / 3.5 flash, and these were really not usable for agentic coding 🤯 crazy times
Sundar Pichai
@sundarpichai
Oct 28
I did say we'd be releasing our models periodically...introducing Gemini 4 Carbon, our next frontier model. Following Argon's release just two weeks ago, Carbon shows the pace at which we’re pushing the frontier, it ranks #1 on the recently updated v5.0 of @ArtificialAnlys
1
Justin Deschenaux
@jdeschena
Oct 27
That’s what you get when ETH falls 🫣
elie
@eliebakouch
Oct 27
potentially 200M$ to benchmark a model on saturated evals like MATH-500 and AIME and claim sovereign ai with a model based on Kimi and that is more closed source and has more restrictions than oai or anthropic
3
Justin Deschenaux
@jdeschena
Oct 27
🔥 Modal is such an amazing platform to use!! It allowed us to finish our S-FLM project (x.com/jdeschena/stat…) right in time. Definitely recommend trying it if you haven’t, it’s super easy: just wrap your python function! No need to manually manage infra 🚀
Filip Makraduli
@f_makraduli
Oct 27
So a career update: I've joined @modal leading Developer Relations in Europe! To celebrate, I won't do resets like @thsottiaux but I'll do one better, and give out free Modal credits. Tell me what you're building with @modal in Europe and I'll pick a few projects to fund!

Justin Deschenaux

Justin Deschenaux’s posts