Jianing Zhang

I am an M.S. student in Computer Vision at the Robotics Institute, Carnegie Mellon University, where I work with Prof. Katerina Fragkiadaki.

Before that, I received my B.S. in Computer Science (Honors, Cum Laude) from the UW Paul G. Allen School. I was a student researcher at the Allen Institute for AI (Ai2) and the RAIVN Lab, advised by Prof. Ranjay Krishna and working closely with Chenhao Zheng. I was also fortunate to work at Peking University and at Shanghai AI Lab.

My research lies in computer vision and multimodal language models, and in how they can help embodied agents and robots understand, predict, and act in the physical world.

Email  ·  GitHub  ·  Twitter  ·  LinkedIn  ·  CV

News

• 2026/09 MolmoMotion was accepted to NeurIPS 2026 as a Spotlight!
• 2026/07 Started my M.S. at CMU and joined Prof. Katerina Fragkiadaki's lab.
• 2026/06 We released MolmoMotion. See the blog post.
• 2026/02 TrajTok was accepted to CVPR 2026.
• 2026/01 Joined the Allen Institute for AI as a student researcher.
• 2025/04 Joined the RAIVN Lab at UW with Prof. Ranjay Krishna.

Research Interests

• Multimodal LMs Integrating vision, language, and other modalities for grounded understanding and reasoning.
• 3D / 4D Understanding Representation learning, motion forecasting, and world models for spatiotemporal and 3D/4D data.
• Embodied AI & Robotics Turning visual and multimodal understanding into robot policies that perceive, reason, and act in the physical world.

Selected Publications

MolmoMotion: Forecasting Point Trajectories in 3D with Language Instruction

Jianing Zhang*†, Chenhao Zheng*†, Yajun Yang†, Max Argus, Rustin Soraki, Winson Han, Taira Anderson, Chun-Liang Li, Shuo Liu, Jiafei Duan, Zhongzheng Ren†, Jieyu Zhang†, Ranjay Krishna†

* Equal contribution  ·  † Core contributors

NeurIPS 2026 (Spotlight)

paper blog project page code model dataset benchmark

TrajTok: Learning Trajectory Tokens Enhances Video Understanding

Chenhao Zheng, Jieyu Zhang, Jianing Zhang, Weikai Huang, Ashutosh Kumar, Quan Kong, Oncel Tuzel, Chun-Liang Li, Ranjay Krishna

CVPR 2026

paper

Research Experience

• Robotics Institute, CMU Jul 2026 – Present
  Graduate Research Assistant · with Prof. Katerina Fragkiadaki
• Allen Institute for AI (Ai2) Jan 2026 – Jul 2026
  Student Researcher
• RAIVN Lab, UW Apr 2025 – Jul 2026
  Student Researcher · with Chenhao Zheng and Prof. Ranjay Krishna
• ZERO Lab, Peking University Jun – Sep 2024
  Student Researcher · with Prof. Zhouchen Lin
• Shanghai AI Lab & Shanghai Jiao Tong University Jun – Sep 2023
  Student Researcher · with Fang Yan, supervisor: Wei Liu

Projects

• Jane Street Market Data Forecasting Nov 2024 – Jan 2025
  Time-series forecasting (Transformer + XGBoost) over 40M+ rows; finished within 0.003 of the competition winner.
• UW CIRCLE Application Jun 2023 – Jun 2024
  Cross-platform React Native / React app for UW's international student program.

Education

• Carnegie Mellon University 2026 – 2027
  M.S. in Computer Vision, Robotics Institute
• University of Washington 2022 – 2026
  B.S. in Computer Science, Paul G. Allen School · Cum Laude, Honors in CS · GPA 3.94 / 4.00