In addition to my academic pursuits, I have gained industry experience as a Research Intern at Amazon Fauna Robotics (Bellevue), mentored by Cheng-Hao Kuo and Sadegh Rabiee, as a Generative AI Researcher at TikTok, and as a Computer Vision Research Engineer at Retrocausal.
MoMaSplat is a demonstration augmentation framework for mobile manipulation that synthesizes full manipulation trajectories, including the moving object, from unseen robot base poses. It reconstructs the scene and manipulated object using 3D Gaussian Splatting and feed-forward 3D foundation models, and retargets actions via kinematics, enabling policies to succeed from base poses beyond 25 cm where all baselines fail.
Video coming soon
COMPASS: Uncertainty-Guided Competence-Aware Base Pose Selection for VLAs via Gaussian Splatting Sateesh Kumar,
Sadegh Rabiee,
Shubham Kumar,
Zheming Zhou,
Yuyin Sun,
Min Sun,
Cheng-Hao Kuo,
Roberto Martín-Martín Under Review, RAL, 2027
COMPASS selects base poses for deploying VLA policies on mobile manipulators by using the policy's own predictive uncertainty as a measure of competence. It renders candidate observations from a 3D Gaussian Splatting reconstruction of the scene and picks the pose where an ensemble of VLA checkpoints agrees most, outperforming the strongest baseline by 35 percentage points on a real-world humanoid without needing training data or execution labels.
COLLAGE is a few-shot imitation learning method that adaptively fuses demonstrations from multiple similarity modalities. It estimates each modality’s usefulness by training a policy on its retrieved data and measuring how probable the target actions are under that policy.
MimicDroid enables humanoid robots to learn manipulation tasks from freely recorded human play videos using in-context learning, achieving nearly twofold higher real-world success rates compared to existing approaches without requiring expensive teleoperated demonstrations.
STAR (SpatioTemporal Active Retrieval) enables service robots to locate objects in dynamic environments by combining non-parametric long-term memory with a working memory, using vision-language models for unified spatial and temporal decision-making.
This paper introduces a method that uses finetuned multimodal language models to filter image–text pairs more accurately than traditional metrics like CLIPScore. It defines multiple specialized quality metrics and builds instruction tuning data guided by stronger models such as GPT-4 to train the models to score data effectively. The result is a reliable and efficient filter that better evaluates image–text alignment.
We introduce a three-stage filtering strategy for enhancing model performance. It focuses on single-modality filtering, cross-modality filtering, and data distribution alignment. The proposed approach significantly surpasses previous methods on the DataComp benchmark.
GraphIRL is a self-supervised method for learning a task reward solely from videos.
We build an object-centric graph abstraction from video demonstrations and then learn an embedding space that captures task progression in a self-supervised manner by exploiting the temporal cue in the videos.
We propose temporal optimal transport for jointly learning representations and performing online clustering in an unsupervised manner.
The approach learns prototype vectors via backpropogation. The prototype vectors are initialized at random and act as cluster centroids.
We propose alignment as pre-text task for self-supervised video representation learning.
The proposed approach leverages differentiable dynamic time warping for learning global alignment across pairs of videos.
We collect a video dataset of road-based anomalies. We propose an object-object interaction reasoning approach for detecting anomalies without additional supervision.
We experiment with reconstruction based and one-class classification based approaches.