Ellis Brown

@_ellisbrown

PhD Student @nyu_courant w/ Profs @sainingxie and @rob_fergus, AIM student @meta FAIR. Prev @ai2prior, @carnegiemellon, @vanderbiltu

NYC

ellisbrown.github.io

Replies Reposts Media

Ellis Brown
@_ellisbrown
Jun 4
introducing PaintBench 🎨 a deterministic eval protocol + benchmark for precise visual editing unlike most generative model evals, no judge model in the loop see @itskaixu's 🧵⬇️ for technical details. I'll provide more context / commentary about why it's exciting here
5
Ellis Brown
@_ellisbrown
Mar 10
when I was choosing PhD programs, @sainingxie was my main draw to NYU. he’d led such influential work in representation learning at FAIR and then swam upstream, choosing academia over big labs. I could tell he had a rare sense for what to work on in the new ChatGPT era doing my
Saining Xie
@sainingxie
Mar 10
i’m joining forces with @ylecun and an incredible group of people to start AMI Labs @amilabs. AMI isn’t a conventional lab. we don’t intend to become one. a lot to say about why this moment matters, but for now we’re heads down building. join us: amilabs.xyz
2
Ellis Brown
@_ellisbrown
Mar 5
🤝
alphaXiv
@askalphaxiv
Mar 5
Yann LeCun 🤝 Saining Xie insane crossover of the 2 biggest visual representation researchers in the AI field “Beyond Language Modeling: An Exploration of Multimodal Pretraining” Right now, most multimodal models are basically a language model with a vision adapter bolted on,
Ellis Brown
@_ellisbrown
Nov 10, 2025
🌶️ hot take 🌶️ > we should normalize training on the test set yes, you read that right. no, I'm not joking. and, yes... I have taken ML 101 👉 here's why this is crucial for future multimodal LLM research [1/n] 🧵
8
Ellis Brown
@_ellisbrown
Nov 7, 2025
MLLMs are great at understanding videos, but struggle with spatial reasoning—like estimating distances or tracking objects across time. the bottleneck? getting precise 3D spatial annotations on real videos is expensive and error-prone. introducing SIMS-V 🤖 [1/n]
00:00
3