Ruofei Du (@DuRuofei) / X

Ruofei Du

1,975 posts

Ruofei Du

@DuRuofei

Interactive Perception & Graphics Lead/Mgr @Google, inventing novel #interactive #AI in #XR. PhD '18 @umdcs #VR #AR #Graphics #HCI #VisualBlocks #UIST #CHI

San Francisco, CA

Joined April 2011

Pinned
Ruofei Du
@DuRuofei
Apr 10
Check out our live #VibeCoding #AndroidXR demo @acm_chi at Monday 10:30 AM at the Google Booth! #AR #VR #XR #XRBlocks
Google Research
@GoogleResearch
Mar 25
Introducing Vibe Coding XR, a new rapid prototyping workflow that empowers Gemini Canvas w/ the XR Blocks framework to turn user prompts into interactive, physics-aware WebXR applications, allowing creators to quickly test intelligent spatial experiences →goo.gle/3PwNr1J
00:00
730
Ruofei Du
@DuRuofei
May 13, 2021
I put up a list of #AR and #VR related paper presentations in #CHI2021 here: youtube.com/watch?v=bTdS8Y… Please feel free to add more videos via shorturl.at/abwEX in case I missed one.
Ruofei Du
@DuRuofei
Feb 13, 2024
Finally 1K citations 😜 It is really a challenging journey to gain citations for #HCI system researcher! A great kudos to all collaborators, students, and mentors!
5.5K
Ruofei Du
@DuRuofei
Jan 14, 2023
Congratulations to amazing students @liu_xingyu , @ErzhH314, and Google teams for @acm_chi acceptance! We have 3 papers accepted: my first-authored #Rapsai, last-authored #VisualCaptions, & collaborated #ThingShare. Hope people enjoy these 3 interactive systems! #CHI2023
7.8K
Ruofei Du
@DuRuofei
Feb 21, 2023
Say goodbye to the hassle of sharing physical objects in virtual meetings with #ThingShare! Check it out at erzhenh.com duruofei.com/projects/augme… Special shout out to @ErzhenHu @jensemildk Wen Ying @SeongkookHeo for collaboration @sigchi #CHI2023 @Google @csaudk @VT_CS
00:00
13K
Ruofei Du
@DuRuofei
Nov 6, 2023
As one of the program committee members for #chi2024, half of my papers were rejected this morning 😭, including my favorite one in Visual Blocks... Maybe it's high time to embrace arXiv and let time and community validate.
10K
Ruofei Du
@DuRuofei
Jan 19, 2024
Hearty congratulations to Xun, @liu_xingyu, @SiyouPei, and the team on the #CHI2024 papers in #XR & #AI! Can't wait to finalize the revision and share the latest invention with the world! Thanks @PurdueME @UCLAComSci @ECE_UCLA for the AMAZING collaboration with @GoogleAI!
4K
Ruofei Du
@DuRuofei
May 2, 2022
It was a great honor to chat w/ @yoshifumik and Wolfgang at #CHI2022! So happy to be on-site @sigchi!!
Ruofei Du
@DuRuofei
Feb 17, 2023
Check out #VisualCaptions accepted at #chi2023, a real-time system that augments verbal communication with on-the-fly visuals with #LLM #AR #ARChat -> making metaverse more interactive and useful! youtube.com/watch?v=sL_YeH… @sigchi
11K
Ruofei Du
@DuRuofei
Apr 25, 2024
What if we could model human input/output channels with multi-modal #AI? Congratulations to our amazing intern @liu_xingyu for the Honorable Mentions Award #CHI2024 with amazing collaboration w/ @_JiahaoLi, David Kim, and @_xiang_chen_ ! @sigchi @UCLA #a11y
00:00
11K
Ruofei Du
@DuRuofei
May 11, 2022
I'm excited to see something my team has been working on being shared more broadly. These are early days and I'm proud of this work!
Google
@Google
May 11, 2022
Augmented reality can break down communication barriers – and help us better understand each other by making language visible. Watch what happens when we bring technologies like transcription and translation to your line of sight. #GoogleIO ↓
00:00
Ruofei Du
@DuRuofei
May 10, 2023
visualblocks.withgoogle.com is alive! Try it today! With the right tools, everyone could unleash your inner creativity! Build real-time #ML pipelines today! #VisualBlocks #TensorFlow #ai #breakingnews
Visual Blocks
From visualblocks.withgoogle.com
4.6K
Ruofei Du
@DuRuofei
Nov 1, 2022
We are synthesizing a shared notes of @ACMUIST via Google Docs: docs.google.com/document/d/17g… mostly focusing on #AR #VR #XR. Please feel free to browse and request editing (or contribute by commenting :) #UIST2022
docs.google.com
[Public] UIST 2022 Notes (go/uist22-doc)
ACM UIST 2022 Notes Authors: Ruofei Du, David Kim, Bruce Liu, Xun Qian, Siyou Pei, Erzhen Hu, Ishan Chatterjee, Kaiming Cheng, Haiqing Xu [Feel free to request editing privilege :)] Collaborators,...
Ruofei Du
@DuRuofei
Mar 28, 2023
Are you tired of jittery captions in @Google Meet, @Zoom, @MicrosoftTeams, #FaceTime, @Skype? Check out our latest research in text stability in live captions @sigchi #CHI2023! #TextStability paper available at in duruofei.com/projects/augme… #accessbility #a11y #HCI #UX #AR
00:00
3.3K