Jimei Yang

@jimei_yang

Research @ Runway. Ex-Adobe. Opinions are my own.

Mountain View, CA

jimeiyang.github.io

Joined January 2012

352 Following

1,318 Followers

Replies Reposts Media

Jimei Yang
@jimei_yang
Jun 3
Nice analysis. It may suggest the sota mllms does not maintain internal world states
Saining Xie
@sainingxie
Jun 3
how does the brain build and track an internal state of the world from (possibly incomplete and noisy) visual observations? i believe visual state tracking will be the grand challenge for vision in the coming years, and i hope this benchmark can be a useful starting line. enjoy!
Quote
Sihyun Yu
@sihyun_yu
Jun 3
Can MLLMs actually track what's happening in a video? Introducing VSTAT 🎯, our new benchmark for visual state tracking. The tasks are simple: count cups, read typed words, count page flips. Humans solve them easily. MLLMs don't. vision-x-nyu.github.io/vstat-site/ 🧵 [1/11]
Jimei Yang
@jimei_yang
May 29
Join us at CVPR!
Runway
@runwayml
May 29
Last chance to RSVP for our annual CVPR Friends Dinner in Denver on June 4th for conversation, cocktails and bites. RSVP at the link below.
Jimei Yang
@jimei_yang
May 21
30s 1080p, not just a new editing model but a studio designed for it
Runway
@runwayml
May 21
Aleph 2.0 is here. Now you can edit a single frame in your video, preview the change and then Aleph 2.0 carries that edit across the rest of your video. Try it now in the new Edit Studio on web at the link below.
00:00
Jimei Yang
@jimei_yang
May 18
Come to work with our best infra team
Kamil Sindi
@kamilsindi
May 18
Distributed training is hard. We adopted DTensor at Runway to prevent silent gradient bugs and it delivered. But we traded performance for correctness, hitting dispatch overhead, recompilation storms, and MFU drops. Wrote up what we learned and how we work around it.
1
Jimei Yang
@jimei_yang
May 2
Reflecting on recent world model research: “A single flower holds an entire world; a single blade of grass, an entire pagoda.” —Flower Garland Sutra “To see a World in a Grain of Sand, And a Heaven in a Wild Flower…” — Auguries of Innocence, 1803