I teach artificial beings to think and behave, fast and slow.

Hi there!

I'm currently working on building general physically grounded AI at OpenAI's robotics research lab. Before that, I obtained my PhD from MIT CSAIL. I was advised by Prof. Edward H. Adelson, and I had the opportunity to collaborate with Prof. Russ Tedrake and Prof. Kaiming He. Recent highlights:

2025 - Present:

San Francisco, CA

General purpose, physically grounded AI for agents in the real world at OpenAI's robotics research lab. Briefly worked on building brains for humanoid robots at 1X Technologies before that.

2022 - 2025:

Cambridge, MA

Working towards my PhD at MIT CSAIL and MechE. I research contact-aware robotic manipulation and robot learning.

2024 Summer⛱️:

Cambridge, MA

Research intern with the Large Behavior Models team at Toyota Research Institute. Multi-modal sensing and learning.

2021 - 2022🚕:

Mountain View, CA

Planning & prediction for self-driving cars at Nuro Inc.

2018 - 2020🦿:

Pittsburgh, PA

Research robot learning and manipulation during my Master in Robotics degree at The Robotics Institute of Carnegie Mellon University with Prof. Oliver Kroemer.

2017 - 2018🤖:

Berkeley, CA

Building & optimizing exoskeletons with Prof. Ruzena Bajcsy at UC Berkeley HART Lab as an undergrad researcher.

Out of work & school, I enjoy software and hardware robotics DIY. I recently started filming some of my hardware DIYs. Check out my YouTube channel Crafted by JZ or my BiliBili channel 试作间 if interested. Check out the #hobby section for released projects. Recently I'm working on an ambitious software project called tpvortex.org. Stay tuned.

News

  • 2025 Sept: 🏭 Fabrica won the Best Paper Award at CoRL 2025!
  • 2025 Sept: 🏭 Fabrica has been selected as a Best Paper Award Finalist at CoRL 2025!
  • 2025 Aug: 🏭 Fabrica has been accepted to CoRL 2025!
  • 2025 May: PolyTouch won the Best Paper Award in Field and Service Robotics at ICRA 2025!
  • 2025 Feb: I defended my PhD thesis and graduated from MIT! I'm now working on building general purpose physically grounded AI for humanoid robots at 1X Technologies.
  • 2024 Sept: Heterogeneous Pre-trained Transformers (HPT) has been accepted as a NeurIPS 24 spotlight paper!
  • 2024 Sept: Our paper Transferable Tactile Transformers (T3) has been accepted to CoRL 24!
  • 2024 Aug: Wrapped up my internship with the Large Behavior Models team at Toyota Research Institute! More details on my projects at TRI coming soon.
  • 2024 May: We published a new paper on a foundational framework for camera-based tactile sensing and contact-aware manipulation T3!
  • 2024 Jan: PoCo was accepted to RSS 2024! See it on MIT News.
  • 2023 Oct: My paper GelSight Svelte was nominated for the Best Overall Paper Award at IROS 2023! Also see it on MIT News.
  • 2023 May: My paper FingerSLAM was presented at ICRA in London.
  • 2023 May: I passed my qualification exam, so I'm officially a PhD candidate now:)

Resume

[Link]
Fabrica
Fabrica: Dual-Arm Assembly of General Multi-Part Objects via Integrated Planning and Learning
Precisian assembly of complex multi-part objects with planning and learning.
Yunsheng Tian, Joshua Jacob, Yijiang Huang, Jialiang Zhao, Edward Li Gu, Pingchuan Ma, Annan Zhang, Farhad Javid, Branden Romero, Sachin Chitta, Shinjiro Sueda, Hui Li, Wojciech Matusik. CoRL 2025.
Website arXiv Video Code Coming Soon Best Paper Award, CoRL'25
PolyTouch
PolyTouch: A Robust Multi-Modal Tactile Sensor for Contact-rich Manipulation Using Tactile-Diffusion Policies
Close the last-inch gap in dexterous manipulation with a tactile-diffusion policy.
Jialiang Zhao, Naveen Kuppuswamy, Siyuan Feng, Benjamin Burchfiel, Edward Adelson. ICRA 2025.
Website arXiv Best Paper Award in Field and Service Robotics
HPT
Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers
A pre-trained framework to learn robotic manipulation through heterogeneous embodiments.
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He. Accepted to NeurIPS 2024 (Spotlight).
Website arXiv Code Pretrained Weights HF Code
T3
Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks
A tactile representation learned from multi-sensors and multi-tasks, and a tactile dataset that contains over 3M tactile images collected from 13 sensors and 11 tasks.
J. Zhao, Y. Ma, L. Wang, E. Adelson. Accepted to 2024 Conference on Robot Learning (CoRL).
Website arXiv Code Dataset and Weights Colab
Electronics insertion
Learning to insert electronics with submillimeter-level tolerance from tactile sensing and extrinsic contacts
J. Zhao as the leading contributor. In preparation.
more details coming soon.
policy composition
PoCo: Policy Composition From and For Heterogeneous Robot Learning
A new fomulation for diffusion policies that can naturally be extented to multi-task, multi-embodiment settings.
L. Wang, J. Zhao, Y. Du, E. Adelson, R. Tedrake. Accepted to 2024 Robotics: Science and Systems (RSS).
Website arXiv YouTube Twitter
TacLink Sensor
GelLink: A Compact Multi-phalanx Finger with Vision-based Tactile Sensing and Proprioception
A novel articulated tactile finger design that only requires one camera for tactile sensing.
Y. Ma, J. Zhao, E. Adelson. Accepted to the 2024 IEEE International Conference on Robotics and Automation (ICRA 2024).
arXiv
Gelsight Svelte sensor
GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensing
Think outside of the “box”: an optical design that unlocked the door of putting high-res tactile sensing in non-rectangular form factors.
J. Zhao and E. Adelson. Accepted to the 2023 International Conference on Intelligent Robots and Systems (IROS 2023)
Website arXiv YouTube MIT News Best Overall Paper Award Finalist
Gelsight Svelte Hand
GelSight Svelte Hand: A Three-finger, Two-DoF, Low-cost, Tactile-rich Robot Hand for Dexterous Manipulation
A novel robot hand configuration that is dexterous and tactile-rich.
J. Zhao and E. Adelson. Submitted to the IROS workshop on Visuo-Tactile Perception, Learning, Control for Manipulation and HRI (IROS RoboTac 2023)
Website arXiv
FingerSLAM: Closed-loop Unknown Object Localization and Reconstruction from Visuo-tactile Feedback
FingerSLAM: Closed-loop Unknown Object Localization and Reconstruction from Visuo-tactile Feedback
Localizing and reconstructing unknown in-hand objects from vision and tactile with factor grasp-based optimization.
J. Zhao, M. Bauza, and E. Adelson. Accepted to the 2023 IEEE International Conference on Robotics and Automation (ICRA 2023)
arXiv YouTube
Causal Reasoning in Simulation for Structure and Transfer Learning of Robot Manipulation Policies
Causal Reasoning in Simulation for Structure and Transfer Learning of Robot Manipulation Policies
Improve data efficiency in RL by reducing observation and action spaces through causal reasoning.
T. E. Lee, J. Zhao, A. S. Sawhney, S. Girdhar, O. Kroemer. Accepted to the 2021 IEEE International Conference on Robotics and Automation (ICRA 2021)
arXiv Website
Learning to Compose Hierarchical Object-Centric Controllers for Robotic Manipulation
Learning to Compose Hierarchical Object-Centric Controllers for Robotic Manipulation
Improve data efficiency in RL by devising and composing hierarchical controllers.
M. Sharma*, J. Liang*, J. Zhao, A. LaGrassa, O. Kroemer. Conference on Robot Learning (CoRL). November 2020.
arXiv Website YouTube Plenary Presentation
Towards Robotic Assembly by Predicting Robust, Precise and Task-oriented Grasps
Towards Robotic Assembly by Predicting Robust, Precise and Task-oriented Grasps
Improve precision during different types of robotic assembly tasks with probabilistic grasp planning.
J. Zhao, D. Troniak, O.Kroemer. Submitted and accepted to 2020 Conference on Robot Learning (CoRL 2020). Oral presentation.
arXiv YouTube
Towards Precise Robotic Grasping by Probabilistic Post-grasp Displacement Estimation
Towards Precise Robotic Grasping by Probabilistic Post-grasp Displacement Estimation
Improve grasping precision by estimating a probabilistic distribution for post-grasp object displacements.
J. Zhao, J. Liang, O.Kroemer. Submitted and accepted to 12th Conference on Field and Service Robotics (FSR 2019). Oral presentation.
arXiv

...more on my Google Scholar page.

Alkaid Mount

Alkaid Mount: Equatorial mount built with HarmonicDrive for astrophotography

A small yet sturdy equatorial mount built for astronomy/astrophotography, using real HarmonicDrive gearboxes. Fully open-sourced. See my blog post for more details.

GitHub YouTube BiliBili
Neptune MIDI

Neptune MIDI

A 3d printed MIDI controller that can be used for video and photo editing (Lightroom, Photoshop, Premiere, DaVinci Resolve, etc.) It contains mechanical switches, rotary encoders, sliders, a joystick, and a small oled screen. Solidworks source files, STL files, BOM are fully open source.

GitHub YouTube BiliBili
RS-Slider

RS-Slider

A mostly 3d printed, motorized, 2-axis camera slider that is Really Solid (R.S.). Tested with a 15lbs cinema camera setup. Software and hardware W.I.P. Details to be added.

RPI AirPlay HiFi

RPI AirPlay HiFi

AirPlay + DAC + AMP, using a Raspberry Pi Zero W and HiFiBerry. Source files & instructions can be found in

GitHub: alanzjl/RPI_AirPlay_HiFi
Filter Drawer

2" Filter drawer for astrophotography

A filter drawer that houses a single 2" filter which be used between a telescope and a Nikon or Canon camera

GitHub: alanzjl/FilterDrawer

Blog posts coming soon...