Pixie: Physics from Pixels

Long Le, Ryan Lucas, Chen Wang, Chuhao Chen, Dinesh Jayaraman, Eric Eaton, Lingjie Liu

GECO: Generative Image-to-3D within a SECOnd

Chen Wang, Jiatao Gu, Xiaoxiao Long, Yuan Liu, Lingjie Liu

TVCG 2025

PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation

Chen Wang*, Chuhao Chen*, Yiming Huang, Zhiyang Dou, Yuan Liu, Jiatao Gu, Lingjie Liu

NeurIPS 2025

PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction

Qiao Feng, Yiming Huang, Yufu Wang, Jiatao Gu, Lingjie Liu

SIGGRAPH Asia 2025

Zero-1-to-G: Taming Pretrained 2D Diffusion Model for Direct 3D Generation

Xuyi Meng*, Chen Wang*, Jiahui Lei, Kostas Daniilidis, Jiatao Gu, Lingjie Liu

TMLR 2025

CFC: Simulating Character-Fluid Coupling using a Hierarchical World Model

Zhiyang Dou*, Chen Peng*, Xinyu Lu, Xiaohan Ye, Lixing Fang, Yuan Liu, Wenping Wang, Chuang Gan, Lingjie Liu, Taku Komura

SIGGRAPH Asia 2025 (ACM Transactions on Graphics, Journal track, Conditionally Accepted)

ModSkill: Physical Character Skill Modularization

Yiming Huang, Zhiyang Dou, Lingjie Liu

ICCV 2025

DIMO: Diverse 3D Motion Generation for Arbitrary Objects

Linzhan Mou, Jiahui Lei, Chen Wang, Lingjie Liu, Kostas Daniilidis

ICCV 2025 (Highlight)

Extrapolated Urban View Synthesis Benchmark

Xiangyu Han, Zhen Jia, Boyi Li, Yan Wang, Boris Ivanovic, Yurong You, Lingjie Liu, Yue Wang, Marco Pavone, Chen Feng, Yiming Li

ICCV 2025

Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulation

Chuhao Chen, Zhiyang Dou, Chen Wang, Yiming Huang, Anjun Chen, Qiao Feng, Jiatao Gu, Lingjie Liu

CVPR 2025

Ego4o: Egocentric Human Motion Capture and Understanding from Multi-Modal Input

Jian Wang, Rishabh Dabral, Diogo Luvizon, Zhe Cao, Lingjie Liu, Thabo Beeler, Christian Theobalt

CVPR 2025

DICE: End-to-end Deformation Capture of Hand-Face Interactions from a Single Image

Qingxuan Wu, Zhiyang Dou†, Sirui Xu, Soshi Shimada, Chen Wang, Zhengming Yu, Yuan Liu, Cheng Lin, Zeyu Cao, Taku Komura, Vladislav Golyanik, Christian Theobalt, Wenping Wang, Lingjie Liu†

ICLR 2025

RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

Jaidev Shriram*, Alex Trevithick*, Lingjie Liu, Ravi Ramamoorthi

3DV 2025

CBIL: Collective Behavior Imitation Learning for Fish from Real Videos

Yifan Wu*, Zhiyang Dou*, Yuko Ishiwaka, Shun Ogawa, Yuke Lou, Wenping Wang, Lingjie Liu, Taku Komura

SIGGRAPH Asia 2024 (ACM Transactions on Graphics, Journal track)

CoMo: Controllable Motion Generation through Language Guided Pose Code Editing

Yiming Huang, Weilin Wan, Yue Yang, Chris Callison-Burch, Mark Yatskar, Lingjie Liu

ECCV 2024

TLControl: Trajectory and Language Control for Human Motion Synthesis

Weilin Wan, Zhiyang Dou, Taku Komura, Wenping Wang, Dinesh Jayaraman†, Lingjie Liu†

ECCV 2024

EMDM: Efficient Motion Diffusion Model for Fast, High-Quality Human Motion Generation

Wenyang Zhou, Zhiyang Dou†, Zeyu Cao, Zhouyingcheng Liao, Jingbo Wang, Wenjia Wang, Yuan Liu, Taku Komura, Wenping Wang, Lingjie Liu

ECCV 2024

TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos

Yufu Wang, Ziyun Wang, Lingjie Liu, Kostas Daniilidis

ECCV 2024

Track Everything Everywhere Fast and Robustly

Yunzhou Song*, Jiahui Lei*, Ziyun Wang, Lingjie Liu, Kostas Daniilidis

ECCV 2024

BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping

Jiatao Gu, Chen Wang, Shuangfei Zhai, Yizhe Zhang, Lingjie Liu, Josh Susskind

ICML 2024

DressCode: Autoregressively Sewing and Generating Garments from Text Guidance

Kai He, Kaixin Yao, Qixuan Zhang, Jingyi Yu†, Lingjie Liu†, Lan Xu†

SIGGRAPH 2024 (ACM Transactions on Graphics, Journal track, Best Paper Honorable Mention)

NeRF-HuGS: Improved Neural Radiance Fields in Non-static Scenes Using Heuristics-Guided Segmentation

Jiahao Chen, Yipeng Qin, Lingjie Liu, Jiangbo Lu, Guanbin Li

CVPR 2024 (Oral)

GART: Gaussian Articulated Template Models

Jiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu, Kostas Daniilidis

CVPR 2024 (Highlight)

Wonder3D: Single Image to 3D using Cross-Domain Diffusion

Xiaoxiao Long*, Yuan-Chen Guo*, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, Wenping Wang

CVPR 2024 (Highlight)

Egocentric Full Body Motion Capture with FisheyeViT and Diffusion-Based Motion Refinement

Jian Wang, Zhe Cao, Diogo Luvizon, Lingjie Liu, Kripasindhu Sarkar, Danhang Tang, Thabo Beeler, Christian Theobalt

CVPR 2024

Holodeck: Language Guided Generation of 3D Embodied AI Environments

Yue Yang, Fan-Yun Sun, Luca Weihs, Eli VanderBilt, Alvaro Herrasti, Winson Han, Jiajun Wu, Nick Haber, Ranjay Krishna, Lingjie Liu, Chris Callison-Burch, Mark Yatskar, Aniruddha Kembhavi, Christopher Clark

CVPR 2024

State of the Art on Diffusion Models for Visual Computing

R. Po, W. Yifan, V. Golyanik, K. Aberman, J. Barron, A. Bermano, E. Chan, T. Dekel, A. Holynski, A. Kanazawa, K. Liu, L. Liu, B. Mildenhall, M. Nießner, B. Ommer, C. Theobalt, P. Wonka, G. Wetzstein

Eurographics 2024 STAR Program

Initializing Models with Larger Ones

Zhiqiu Xu, Yanjie Chen, Kirill Vishniakov, Yida Yin, Zhiqiang Shen, Trevor Darrell, Lingjie Liu, Zhuang Liu

ICLR 2024 (Spotlight)

SyncDreamer: Generating Multiview-consistent Images from a Single-view Image

Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long, Lingjie Liu, Taku Komura, Wenping Wang

ICLR 2024 (Spotlight)

Learning Controllable 3D Diffusion Models from Single-view Images

Jiatao Gu, Qingzhe Gao, Shuangfei Zhai, Baoquan Chen, Lingjie Liu, Josh Susskind

3DV 2024

DELIFFAS: Deformable Light Fields for Fast Avatar Synthesis

Youngjoong Kwon, Lingjie Liu, Henry Fuchs, Marc Habermann, Christian Theobalt

NeurIPS 2023

DreamEditor: Text-Driven 3D Scene Editing with Neural Fields

Jingyu Zhuang*, Chen Wang*, Liang Lin, Lingjie Liu, Guanbin Li

SIGGRAPH Asia 2023

HDHumans: A Hybrid Approach for High-fidelity Digital Humans

Marc Habermann, Lingjie Liu, Weipeng Xu, Gerard Pons-Moll, Michael Zollhoefer, Christian Theobalt

ACM SCA 2023 (Best Paper Honorable Mention)

Neural Novel Actor: Learning a Generalized Animatable Neural Representation for Human Actors

Qingzhe Gao*, Yiming Wang*, Libin Liu, Lingjie Liu, Christian Theobalt, Baoquan Chen

TVCG 2023

Multimodal Image Synthesis and Editing: A Survey

Fangneng Zhan, Yingchen Yu, Rongliang Wu, Jiahui Zhang, Shijian Lu, Lingjie Liu, Adam Kortylewski, Christian Theobalt, Eric Xing

TPAMI 2023

NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstruction

Yiming Wang*, Qin Han*, Marc Habermann, Kostas Daniilidis, Christian Theobalt, Lingjie Liu

ICCV 2023

Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction

Hansheng Chen, Jiatao Gu, Anpei Chen, Wei Tian, Zhuowen Tu, Lingjie Liu, Hao Su

ICCV 2023

NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion

Jiatao Gu, Alex Trevithick, Kai-En Lin, Josh Susskind, Christian Theobalt, Lingjie Liu, Ravi Ramamoorthi

ICML 2023

NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects From Multiview Images

Yuan Liu, Peng Wang, Cheng Lin, Xiaoxiao Long, Jiepeng Wang, Lingjie Liu, Taku Komura, Wenping Wang

SIGGRAPH 2023 (ACM Transactions on Graphics, Journal track)

Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

Xingang Pan, Ayush Tewari, Thomas Leimkühler, Lingjie Liu, Abhimitra Meka, Christian Theobalt

SIGGRAPH 2023

F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectories

Peng Wang*, Yuan Liu*, Zhaoxi Chen, Lingjie Liu, Ziwei Liu, Taku Komura, Christian Theobalt, Wenping Wang

CVPR 2023 (highlight)

NeuralUDF: Learning Unsigned Distance Fields for Multi-view Reconstruction of Surfaces with Arbitrary Topologies

Xiaoxiao Long, Cheng Lin, Lingjie Liu, Yuan Liu, Peng Wang, Christian Theobalt, Taku Komura, Wenping Wang

CVPR 2023

Scene-aware Egocentric 3D Human Pose Estimation

Jian Wang, Diogo Luvizon, Weipeng Xu, Lingjie Liu, Kripasindhu Sarkar, Christian Theobalt

CVPR 2023

General Neural Gauge Fields

Fangneng Zhan, Lingjie Liu, Adam Kortylewski, Christian Theobalt

ICLR 2023

GAN2X: Non-Lambertian Inverse Rendering of Image GANs

Xingang Pan, Ayush Tewari, Lingjie Liu, Christian Theobalt

3DV 2022

NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priors

Jiepeng Wang, Peng Wang, Xiaoxiao Long, Christian Theobalt, Taku Komura, Lingjie Liu, Wenping Wang

ECCV 2022

NeRF for Outdoor Scene Relighting

Viktor Rudnev, Mohamed Elgharib, William Smith, Lingjie Liu, Vladislav Golyanik, Christian Theobalt

ECCV 2022

Physics Informed Neural Fields for Smoke Reconstruction with Sparse Data

Mengyu Chu, Lingjie Liu, Quan Zheng, Erik Franz, Hans-Peter Seidel, Christian Theobalt, Rhaleb Zayer

SIGGRAPH 2022 (ACM Transactions on Graphics, Journal track)

Estimating Egocentric 3D Human Pose in the Wild with External Weak Supervision

Jian Wang, Lingjie Liu, Weipeng Xu, Kripasindhu Sarkar, Diogo Luvizon, Christian Theobalt

CVPR 2022

Progressively-connected Light Field Network for Efficient View Synthesis

Peng Wang, Yuan Liu, Guying Lin, Jiatao Gu, Lingjie Liu, Taku Komura, Wenping Wang

Arxiv 2022

Neural Rays for Occlusion-aware Image-based Rendering

Yuan Liu, Sida Peng, Lingjie Liu, Qianqian Wang, Peng Wang, Christian Theobalt, Xiaowei Zhou, Wenping Wang

CVPR 2022

Learn to Predict How Humans Manipulate Large-Sized Objects From Interactive Motions

Weilin Wan, Lei Yang, Lingjie Liu, Zhuoying Zhang, Ruixing Jia, Yi-King Choi, Jia Pan, Christian Theobalt,Taku Komura, Wenping Wang

IEEE Robotics and Automation Letters 2022 (Presented at ICRA 2022)

StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis

Jiatao Gu, Lingjie Liu, Peng Wang, Christian Theobalt

ICLR 2022

NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction

Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, Wenping Wang

NeurIPS 2021 (Spotlight)

Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control

Lingjie Liu, Marc Habermann, Viktor Rudnev, Kripasindhu Sarkar, Jiatao Gu, Christian Theobalt

SIGGRAPH Asia 2021

Direct Dense Pose Estimation

Liqian Ma, Lingjie Liu, Christian Theobalt Luc Van Gool

3DV 2021

Estimating Egocentric 3D Human Pose in Global Space

Jian Wang, Lingjie Liu, Weipeng Xu, Kripasindhu Sarkar, Christian Theobalt

ICCV 2021 (Oral)

Adaptive Surface Normal Constraint for Depth Estimation

Xiaoxiao Long, Cheng Lin, Lingjie Liu, Wei Li, Christian Theobalt, Ruigang Yang, Wenping Wang

ICCV 2021

Efficient and Differentiable Shadow Computation for Inverse Problems

Linjie Lyu, Marc Habermann, Lingjie Liu, Mallikarjun B R, Ayush Tewari, Christian Theobalt

ICCV 2021

EgoRenderer: Rendering Human Avatars from Egocentric Camera Images

Tao Hu, Kripasindhu Sarkar, Lingjie Liu, Matthias Zwicker, Christian Theobalt

ICCV 2021

Real-time Deep Dynamic Characters

Marc Habermann, Lingjie Liu, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt

SIGGRAPH 2021

Style and Pose Control for Image Synthesis of Humans from a Single Monocular View

Kripasindhu Sarkar, Vladislav Golyanik, Lingjie Liu, Christian Theobalt

Arxiv 2021

Learning Speech-driven 3D Conversational Gestures from Video

Ikhsanul Habibie, Weipeng Xu, Dushyant Mehta, Lingjie Liu, Hans-Peter Seidel, Gerard Pons-Moll, Mohamed Elgharib, Christian Theobalt

ACM International Conference on Intelligent Virtual Agents (IVA) 2021 (Best Paper Award)

HumanGAN: A Generative Model of Human Images

Kripasindhu Sarkar, Lingjie Liu, Vladislav Golyanik, Christian Theobalt

3DV 2021 (Oral)

Pose-Guided Human Animation from a Single Image in the Wild

Jae Shin Yoon, Lingjie Liu, Vladislav Golyanik, Kripasindhu Sarkar, Hyun Soo Park, Christian Theobalt

CVPR 2021

Learnable Motion Coherence for Correspondence Pruning

Yuan Liu, Lingjie Liu, Cheng Lin, Zhen Dong, Wenping Wang

CVPR 2021

Multi-view Depth Estimation using Epipolar Spatio-Temporal Networks

Xiaoxiao Long, Lingjie Liu, Wei Li, Christian Theobalt, Wenping Wang

CVPR 2021

Neural Sparse Voxel Fields

Lingjie Liu*, Jiatao Gu*, Kyaw Zaw Lin, Tat-Seng Chua, Christian Theobalt

NeurIPS 2020 (Spotlight)

SEG-MAT: 3D Shape Segmentation Using Medial Axis Transform

Cheng Lin, Lingjie Liu, Changjian Li, Leif Kobbelt, Bin Wang, Shiqing Xin, Wenping Wang

TVCG 2020

MulayCap: Multi-layer Human Performance Capture Using A Monocular Video Camera

Zhaoqi Su, Weilin Wan, Tao Yu , Lingjie Liu, Lu Fang, Wenping Wang, Yebin Liu

TVCG 2020

Occlusion-Aware Depth Estimation with Adaptive Normal Constraints

Xiaoxiao Long, Lingjie Liu, Christian Theobalt, Wenping Wang

ECCV 2020

Vid2Curve: Simultaneous Camera Motion Estimation and Thin Structure Reconstruction from an RGB Video

Peng Wang, Lingjie Liu, Nenglun Chen, Hung-Kuo Chu, Christian Theobalt, Wenping Wang

SIGGRAPH 2020

Unsupervised Learning of Intrinsic Structural Representation Points

Nenglun Chen, Lingjie Liu, Zhiming Cui, Runnan Chen, Duygu Ceylan, Changhe Tu, Wenping Wang

CVPR 2020

Neural Human Video Rendering by Learning Dynamic Textures and Rendering-to-Video Translation

Lingjie Liu, Weipeng Xu, Marc Habermann, Michael Zollhöfer, Florian Bernard, Hyeongwoo Kim, Wenping Wang, Christian Theobalt

TVCG 2020

@article{article,
			author = {Liu, Lingjie and Xu, Weipeng and Habermann, Marc and Zollhöfer, Michael and Bernard, Florian and Kim, Hyeongwoo and Wang, Wenping and Theobalt, Christian},
			year = {2020},
			month = {05},
			pages = {1-1},
			title = {Neural Human Video Rendering by Learning Dynamic Textures and Rendering-to-Video Translation},
			volume = {PP},
			journal = {IEEE Transactions on Visualization and Computer Graphics},
			doi = {10.1109/TVCG.2020.2996594}
			}
			

Neural Animation and Reenactment of Human Actor Videos

Lingjie Liu, Weipeng Xu, Michael Zollhöfer, Hyeongwoo Kim, Florian Bernard, Marc Habermann, Wenping Wang, Christian Theobalt

ACM Transactions on Graphics (TOG) 2019

@article{10.1145/3333002,
				author = {Liu, Lingjie and Xu, Weipeng and Zollh\"{o}fer, Michael and Kim, Hyeongwoo and Bernard, Florian and Habermann, Marc and Wang, Wenping and Theobalt, Christian},
				title = {Neural Rendering and Reenactment of Human Actor Videos},
				year = {2019},
				issue_date = {November 2019},
				publisher = {Association for Computing Machinery},
				address = {New York, NY, USA},
				volume = {38},
				number = {5},
				issn = {0730-0301},
				url = {https://doi.org/10.1145/3333002},
				doi = {10.1145/3333002},
				journal = {ACM Trans. Graph.},
				month = oct,
				articleno = {Article 139},
				numpages = {14},
				keywords = {deep learning, rendering-to-video translation, video-based characters, Neural rendering, conditional GAN}
				}

				

MAT-Net: Medial Axis Transform Network for 3D Object Recognition

Jianwei Hu, Bin Wang, Lihui Qian, Yiling Pan, Xiaohu Guo, Lingjie Liu, Wenping Wang

IJCAI 2019

@inproceedings{ijcai2019-109,
  title     = {MAT-Net: Medial Axis Transform Network for 3D Object Recognition},
  author    = {Hu, Jianwei and Wang, Bin and Qian, Lihui and Pan, Yiling and Guo, Xiaohu and Liu, Lingjie and Wang, Wenping},
  booktitle = {Proceedings of the Twenty-Eighth International Joint Conference on
               Artificial Intelligence, {IJCAI-19}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},             
  pages     = {774--781},
  year      = {2019},
  month     = {7},
  doi       = {10.24963/ijcai.2019/109},
  url       = {https://doi.org/10.24963/ijcai.2019/109},
}

CurveFusion: Reconstructing Thin Structures from RGBD Sequences

Lingjie Liu*, Nenglun Chen*, Duygu Ceylan, Christian Theobalt, Wenping Wang, Niloy J. Mitra

SIGGRAPH Asia 2018

@article{Liu:2018:CUF:3272127.3275097,
                author = {Liu, Lingjie and Chen, Nenglun and Ceylan, Duygu and Theobalt, Christian and Wang, Wenping and Mitra, Niloy J.},
                title = {CurveFusion: Reconstructing Thin Structures from RGBD Sequences},
                journal = {ACM Trans. Graph.},
                issue_date = {November 2018},
                volume = {37},
                number = {6},
                month = dec,
                year = {2018},
                issn = {0730-0301},
                pages = {218:1--218:12},
                articleno = {218},
                numpages = {12},
                url = {http://doi.acm.org/10.1145/3272127.3275097},
                doi = {10.1145/3272127.3275097},
                acmid = {3275097},
                publisher = {ACM},
                address = {New York, NY, USA},
                keywords = {L1 axis, RGBD scans, curve reconstruction, data fusion},
               }

Image-based Reconstruction of Wire Art

Lingjie Liu, Duygu Ceylan, Cheng Lin, Wenping Wang, Niloy J. Mitra

SIGGRAPH 2017

@article{Liu:WireArt:2017,
  title   = {Image-based Reconstruction of Wire Art,
  author  = {Lingjie Liu and Duygu Ceylan and Cheng Lin and Wenping Wang and Niloy J. Mitra},
  year    = {2017},
  journal = {{ACM SIGGRAPH 2017}}，
}

Correlation-preserving Photo Collage

Lingjie Liu, Hongjie Zhang, Guanmei Jing, Yanwen Guo, Zhonggui Chen, Wenping Wang

TVCG 2017

@article{7927420, 
 author={L. Liu and H. Zhang and G. Jing and Y. Guo and Z. Chen and W. Wang}, 
  journal={IEEE Transactions on Visualization and Computer Graphics},  
 title={Correlation-Preserving Photo Collage},  
  year={2017}, 
  volume={PP}, 
  number={99}, 
  pages={1-1}, 
  keywords={Computer science;Correlation;Feature extraction;Machine learning;Optimization;Semantics;Shape;Photo collage;image classification;image saliency;irregular shaped packing}, 
  doi={10.1109/TVCG.2017.2703853}, 
  ISSN={1077-2626}, 
  month={},}