Matthew O'Toole
Robotics Institute & Computer Science Department
School of Computer Science
Carnegie Mellon University
Email: motoole2 [at] andrew [dot] cmu [dot] edu Office: Smith Hall, Rm. 215, 4800 Forbes Ave. Pittsburgh, Pennsylvania 15213 Publications [Google Scholar]
Automated Design of Compound Lenses with Discrete-continuous Optimization
Arjun Teh, Delio Vicini, Bernd Bickel, Ioannis Gkioulekas*, Matthew O'Toole*. ACM SIGGRAPH Asia, 2025.
Project page
Spatially Varying Autofocus
Yingsi Qin, Aswin C Sankaranarayanan, Matthew O'Toole. International Conference on Computer Vision (ICCV), 2025. (Oral) (Awarded "Marr Prize Honorable Mention")
Project page
Towards Foundational Models for Single-chip Radar
Tianshu Huang, Akarsh Prabhakara, Chuhan Chen, Jay Karhade, Deva Ramanan, Matthew O'Toole, Anthony Rowe. International Conference on Computer Vision (ICCV), 2025. (Oral)
Project page
Neural Inverse Rendering from Propagating Light
Anagh Malik*, Benjamin Attal*, Andrew Xie, Matthew O'Toole+, David B Lindell+. Computer Vision and Pattern Recognition (CVPR), 2025. (Oral) (Awarded "Best Student Paper")
Project page
Time of the Flight of the Gaussians: Optimizing Depth Indirectly in Dynamic Radiance Fields
Runfeng Li, Mikhail Okunev, Zixuan Guo, Anh Ha Duong, Christian Richardt, Matthew O'Toole, James Tompkin. Computer Vision and Pattern Recognition (CVPR), 2025. (Oral)
Project page
Holodepth: Programmable Depth-varying Projection via Computer-generated Holography
Dorian Chan, Matthew O'Toole, Sizhuo Ma, Jian Wang. European Conference on Computer Vision (ECCV), 2024.
Project page
Flash Cache: Reducing Bias in Radiance Cache Based Inverse Rendering
Benjamin Attal, Dor Verbin, Ben Mildenhall, Peter Hedman, Jonathan T Barron, Matthew O'Toole, Pratul P Srinivasan. European Conference on Computer Vision (ECCV), 2024. (Oral)
Project page
Flowed Time-of-flight Radiance Fields
Mikhail Okunev, Marc Mapeke, Benjamin Attal, Christian Richardt, Matthew O'Toole, James Tompkin. European Conference on Computer Vision (ECCV), 2024.
Project page
Aperture-Aware Lens Design
Arjun Teh, Ioannis Gkioulekas, Matthew O'Toole. ACM SIGGRAPH 2024.
Project page
Coherence as Texture — Passive Textureless 3D Reconstruction by Self-Interference
Wei-Yu Chen, Aswin C Sankaranarayanan, Anat Levin, Matthew O'Toole. Computer Vision and Pattern Recognition (CVPR), 2024. (Highlight)
Project page
Light-Efficient Holographic Illumination for Continuous-Wave Time-of-Flight Imaging
Dorian Chan, Matthew O'Toole. ACM SIGGRAPH Asia, 2023.
Paper
Neural Fields for Structured Lighting
Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin, Matthew O'Toole. International Conference on Computer Vision (ICCV), 2023.
Project page
SpinCam: High-Speed Imaging via a Rotating Point-Spread Function
Dorian Chan, Mark Sheinin, Matthew O'Toole. International Conference on Computer Vision (ICCV), 2023.
Project page
Split-Lohmann Multifocal Displays
Yingsi Qin, Wei-yu Chen, Matthew O'Toole, Aswin Sankaranarayanan. ACM SIGGRAPH, 2023.
Project page (Awarded "Best Paper" at SIGGRAPH, and "Best Demo" at ICCP 2023)
ST-MVDNet++: Improve Vehicle Detection with Lidar-Radar Geometrical Augmentation via Self-Training
Yu-Jhe Li, Matthew O'Toole, Kris Kitani. ICASSP, 2023.
Paper
Enhancing speckle statistics for imaging inside scattering tissue
Wei-yu Chen, Matthew O'Toole, Aswin Sankaranarayanan, Anat Levin. Optica, 2022.
Paper
Azimuth Super-Resolution for FMCW Radar in Autonomous Driving
Yu-Jhe Li, Shawn Hunt, Jinhyung Park, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2023.
Paper
Analyzing Physical Impacts using Transient Surface Wave Imaging
Tianyuan Zhang, Mark Sheinin, Dorian Chan, Mark Rau, Matthew O'Toole, Srinivas Narasimhan. Computer Vision and Pattern Recognition (CVPR), 2023.
Project page
Implicit Neural Head Synthesis via Controllable Local Deformation Fields
Chuhan Chen, Matthew O'Toole, Gaurav Bharaj, Pablo Garrido. CVPR, 2023.
Project page
HyperReel: High-fidelity 6-DoF video with ray-conditioned sampling
Benjamin Attal, Jia-Bin Huang, Christian Richardt, Michael Zollhoefer, Johannes Kopf, Matthew O'Toole, Changil Kim. CVPR, 2023. (Highlight)
Project page
Adjoint Nonlinear Ray Tracing
Arjun Teh, Matthew O'Toole, Ioannis Gkioulekas. ACM SIGGRAPH, 2022.
Project page
Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators
Suyeon Choi*, Manu Gopakumar*, Yifan (Evan) Peng, Jonghyun Kim, Matthew O'Toole, Gordon Wetzstein. ACM SIGGRAPH, 2022.
Project page
Towards Mixed-State Coded Diffraction Imaging
Benjamin Attal, Matthew O'Toole. Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
Project page
Holocurtains: Programming Light Curtains via Binary Holography
Dorian Chan, Srinivas Narasimhan, Matthew O'Toole. Computer Vision and Pattern Recognition (CVPR), 2022.
Project page
Dual-Shutter Optical Vibration Sensing
Mark Sheinin, Dorian Chan, Matthew O'Toole, Srinivas Narasimhan. Computer Vision and Pattern Recognition (CVPR), 2022. (Oral) (Awarded "Best Paper Honorable Mention")
Project page
Modality-Agnostic Learning for Radar-Lidar Fusion in Vehicle Detection
Yu-Jhe Li, Jinhyung Park, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2022.
Paper
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole. Advances in Neural Information Processing Systems (NeurIPS), 2021.
Project page
Multi-Echo LiDAR for 3D Object Detection
Yunze Man, Xinshuo Weng, Prasanna Sivakumar, Matthew O'Toole, Kris Kitani. Internal Conference on Computer Vision (ICCV), 2021.
Paper
Deconvolving Diffraction for Fast Imaging of Sparse Scenes
Mark Sheinin, Matthew O'Toole, Srinivasa Narasimhan. International Conference on Computational Photography (ICCP), 2021.
Project page
Reference Wave Design for Wavefront Sensing
Wei-Yu Chen, Anat Levin, Matthew O'Toole, Aswin C. Sankaranarayanan. International Conference on Computational Photography (ICCP), 2021.
Paper
All-In-One Drive: A Comprehensive Perception Dataset with High-Density Long-Range Point Clouds
Xinshuo Weng, Yunze Man, Jinhyung Park, Ye Yuan, Matthew O'Toole, Kris Kitani. arXiv, 2020.
Project page
Diffraction Line Imaging
Mark Sheinin, Dinesh Reddy, Matthew O'Toole, Srinivasa Narasimhan. European Conference on Computer Vision (ECCV), 2020. (Oral)
Project page
Efficient Non-Line-of-Sight Imaging from Transient Sinograms
Mariko Isogawa, Dorian Chan, Ye Yuan, Kris Kitani, Matthew O'Toole. European Conference on Computer Vision (ECCV), 2020.
Project page
Efficient Non-Line-of-Sight Imaging with Computational Single-Photon Imaging
David B. Lindell, Matthew O'Toole, Gordon Wetzstein. SPIE, 2020. (Invited paper)
Paper
An Extensible Multi-Sensor Fusion Framework for 3D Imaging
Talha Ahmad Siddiqui, Rishi Madhok, Matthew O'Toole. CVPR Workshop on Autonomous Driving, 2020.
Paper
Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation
Mariko Isogawa, Ye Yuan, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2020.
Project page
Wave-based Non-Line-of-Sight Imaging using Fast f-k Migration
David B. Lindell, Gordon Wetzstein, Matthew O'Toole. ACM SIGGRAPH, 2019.
Project page
Non-Line-of-Sight Imaging with Partial Occluders and Surface Normals
Felix Heide, Matthew O'Toole, Kai Zang, David B. Lindell, Steven Diamond, Gordon Wetzstein. ACM Trans. on Graphics, 2019.
Project page
Single-Photon 3D Imaging with Deep Sensor Fusion
David B. Lindell, Matthew O'Toole, Gordon Wetzstein. ACM SIGGRAPH, 2018.
Project page
Tracking Multiple Objects Outside the Line of Sight using Speckle Imaging
Brandon M. Smith, Matthew O'Toole, Mohit Gupta. Computer Vision and Pattern Recognition (CVPR), 2018. (Spotlight)
Project page
Towards Transient Imaging at Interactive Rates with Single-Photon Sensors
David B. Lindell, Matthew O'Toole, Gordon Wetzstein. International Conference on Computational Photography (ICCP), 2018.
Project page
Confocal Non-Line-of-Sight Imaging Based on the Light Cone Transform
Matthew O'Toole, David B. Lindell, Gordon Wetzstein. Nature, 2018.
Project page
Reconstructing Transient Images from Single-Photon Sensors
Matthew O'Toole, Felix Heide, David B. Lindell, Kai Zang, Steven Diamond, Gordon Wetzstein. Computer Vision and Pattern Recognition (CVPR), 2017. (Spotlight)
Project page
Primal-Dual-Coding CMOS Image Sensor Architecture
Navid Sarhangnejad, Hyunjoong Lee, Nikola Katic, Matthew O'Toole, Kiriakos N. Kutulakos, Roman Genov. International Image Sensor Workshop (IISW), 2017.
Paper
Ph.D. Thesis: Optical Linear Algebra for Computational Light Transport
Matthew O'Toole. University of Toronto, 2016. (Awarded "ACM SIGGRAPH Outstanding Thesis, Honorable Mention")
Thesis (35.4 MB)
3D Shape and Indirect Appearance by Structured Light Transport
Matthew O'Toole, John Mather, Kiriakos N. Kutulakos. Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016.
Paper
Homogeneous Codes for Energy-Efficient Illumination and Imaging
Matthew O'Toole, Supreeth Achar, Srinivasa G. Narasimhan, Kiriakos N. Kutulakos. ACM SIGGRAPH, 2015. (Awarded "Best Demo" at ICCP 2015 and CVPR 2015)
Project page
Episcan3D
Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras
Lei Xiao, Felix Heide, Matthew O'Toole, Andreas Kolb, Matthias B. Hullin, Kiriakos N. Kutulakos, Wolfgang Heidrich. Computer Vision and Pattern Recognition (CVPR), 2015.
Project page
Transport-aware imaging
Kiriakos N. Kutulakos and Matthew O'Toole. SPIE OPTO, 2015. (Invited paper)
Paper
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Matthew O'Toole, Felix Heide, Lei Xiao, Matthias B. Hullin, Wolfgang Heidrich, Kiriakos N. Kutulakos. ACM SIGGRAPH, 2014.
Project page
Course: Computational Cameras and Displays
Matthew O'Toole and Gordon Wetzstein. ACM SIGGRAPH Course, 2014.
Course page
3D Shape and Indirect Appearance by Structured Light Transport
Matthew O'Toole, John Mather, Kiriakos N. Kutulakos. Computer Vision and Pattern Recognition (CVPR), 2014. (Oral) (Awarded "Best Paper Honorable Mention")
Project page
Decomposing Global Light Transport using Time of Flight Imaging
Di Wu, Andreas Velten, Matthew O'Toole, Belen Masia, Amit Agrawal, Qionghai Dai, Ramesh Raskar. International Journal of Computer Vision (IJCV), 2013.
Paper
Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging
Di Wu, Gordon Wetzstein, Christopher Barsi, Thomas Willwacher, Matthew O'Toole, Nikhil Naik, Qionghai Dai, Kiriakos N. Kutulakos, Ramesh Raskar. European Conference on Computer Vision (ECCV), 2012.
Project page
Primal-Dual Coding to Probe Light Transport
Matthew O'Toole, Ramesh Raskar, and Kiriakos N. Kutulakos. ACM SIGGRAPH, 2012.
Project page
Decomposing Global Light Transport using Time of Flight Imaging
Di Wu, Matthew O'Toole, Andreas Velten, Amit Agrawal, and Ramesh Raskar. Computer Vision and Pattern Recognition (CVPR), 2012. (Oral)
Paper
Optical Computing for Fast Light Transport Analysis
Matthew O'Toole and Kiriakos N. Kutulakos. ACM SIGGRAPH Asia, 2010.
Project page
A Basis Illumination Approach to BRDF Measurement
Abhijeet Ghosh, Shruthi Achutha, Wolfgang Heidrich, and Matthew O'Toole. International Journal of Computer Vision (IJCV), 2010.
Paper
M.Sc. Report: Light Transport Analysis by Krylov Subspace Illumination
Matthew O'Toole. University of Toronto, 2009. (Uploaded on September 2018.)
Report
BRDF Acquisition with Basis Illumination
Abhijeet Ghosh, Shruthi Achutha, Wolfgang Heidrich, and Matthew O'Toole. International Conference on Computer Vision (ICCV), 2007. (Oral) (Awarded "Marr Prize Honorable Mention")
Project page
Undergraduate Honors Thesis: Real-time Rendering of Acquired BRDF Data Sets
Matthew O'Toole. University of British Columbia, 2007.
Paper
