About

I am a Senior Research Scientist at Facebook AI Research (FAIR). I completed my Ph.D. at Georgia Tech, advised by Prof. Patricio A. Vela in IVALab. Prior to that, I received M.S. from EECS at University of Michigan (UM) in 2014, and B.S. from EE at National Taiwan University (NTU) in 2011.
I enjoy working on vision-based robotic manipulation with affordance understanding, which allows intelligent machines to interact with the physical world. My research interest lies at the intersection of robotics, computer vision and machine learning.
News: I am looking for motivated PhD students for summer research interns. Potential topics include 3D vision, vision+LLM, and embodied AI etc. Please drop me an email if you are interested.

Publications

Please see my Google Scholar for complete publication list.
Image
EgoSG: Learning 3D Scene Graphs from Egocentric RGB-D Sequences
Chaoyi Zhang, Xitong Yang, Ji Hou, Kris Kitani, Weidong Cai, Fu-Jen Chu
CVPR workshop 2024
Image Image
Ego-Exo4D: Understanding Skilled Human Activity from First-and Third-Person Perspectives
Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, Fu-Jen Chu* et al.
CVPR 2024
Image
HyperMix: Out-of-Distribution Detection and Classification in Few-Shot Settings
Nikhli Mehta*, Kevin J Liang*, Jing Huang, Fu-Jen Chu, Li Yin, Tal Hassner
WACV 2024
Image
Relational Space-Time Query in Long-Form Videos
Xitong Yang, Fu-Jen Chu, Matt Feiszli, Raghav Goyal, Lorenzo Torresani, Du Tran
CVPR 2023 highlights
Image
Primitive Shape Recognition for Object Grasping
Yunzhi Lin, Chao Tang, Fu-Jen Chu, Patricio A. Vela
submitted to IJRR
Image Image
Recognizing Object Affordances to Support Scene Reasoning for Manipulation Tasks
Fu-Jen Chu, Ruinian Xu, Chao Tang, Patricio A. Vela
submitted to IJRR
Image Image
An Affordance Keypoint Detection Network for Robot Manipulation
Ruinian Xu, Fu-Jen Chu, Chao Tang, Weiyu Liu, Patricio A. Vela
IEEE RA-L 2021 with ICRA 2021
Image
GKNet: Grasp Keypoint Network for Grasp Detection
Ruinian Xu, Fu-Jen Chu, Patricio A. Vela
IJRR 2021
Image
Improving Vision-Based Robotic Manipulation with Affordance Understanding
Fu-Jen Chu
Ph.D. Dissertation at Georgia Institute of Technology 2020
Image Image
Using Synthetic Data and Deep Networks to Recognize Primitive Shapes for Object Grasping
Yunzhi Lin*, Chao Tang*, Fu-Jen Chu, Patricio A. Vela
IEEE ICRA 2020
Image Image
Toward Affordance Detection and Ranking on Novel Objects for Real-world Robotic Manipulation
Fu-Jen Chu, Ruinian Xu, Landan Seguin, Patricio A. Vela
IEEE RA-L 2019 with IROS 2019
Image Image
Learning Affordance Segmentation for Real-world Robotic Manipulation via Synthetic Images
Fu-Jen Chu, Ruinian Xu, Patricio A. Vela
IEEE RA-L 2019 with ICRA 2019
Image
Real-World, Multiobject, Multigrasp Detection
Fu-Jen Chu, Ruinian Xu, Patricio A. Vela
IEEE RA-L 2018 with IROS 2018
Image Image
Hands-Free Control of an Assistive Manipulator Using Augmented Reality and Tongue Drive System
Fu-Jen Chu, Ruinian Xu, Zhenxuan Zhang, Patricio A. Vela, Maysam Ghovanloo
IEEE IROS 2018
Image
The Helping Hand: An Assitive Manipulation Framework Using Augmented Reality and Tongue-Drive Interfaces
Fu-Jen Chu, Ruinian Xu, Zhenxuan Zhang, Patricio A. Vela, Maysam Ghovanloo
IEEE EMBC 2018
Image
When Crowdsourcing Meets Mobile Sensing: A Social Network Perspective
Pin-Yu Chen, Shin-Ming Cheng, Chia-Wei Lien, Pai-Shun Ting, Fu-Jen Chu
IEEE Communication Magazine 2015
Image
When Crowdsourcing Meets Mobile Sensing: A Social Network Perspective
Pin-Yu Chen, Chia-Wei Lien, Fu-Jen Chu, Pai-Shun Ting, Shin-Ming Cheng
IEEE Globecom Workshops 2015

Industry

Image

Facebook AI Research (FAIR)

Research Scientist, Aug. 2020 - present

Image

Texas Instruments

Research Intern, Summer 2016

with Dr. Murtaza Ali

Image

Volvo Group

Research Intern, Spring 2016

with Dr. Fares Beainy

Education

Image

Georgia Institute of Technology

Doctor of Philosophy

Electrical and Computer Engineering

Image

University of Michigan

Master of Science

Electrical Engineering and Computer Science

Image

National Taiwan University

Bachelor of Science

Electrical Engineering