Hang Yin is currently a PhD student in the Department of Automation, Tsinghua University, advised by Prof. Jie Zhou and Prof. Jiwen Lu. In 2023, he received his Bachelor's degree in the Department of Automation, Tsinghua University.
I work on embodied AI and robot learning. My research focuses on:
Vision-language-action models that scale a single policy across diverse tasks, environments and robot embodiments, covering both navigation and manipulation.
Reinforcement learning for embodied agents that studies real-world RL and lifelong self-learning, where an agent keeps improving from its own interaction through persistent multimodal memory and without human supervision.
My research also covers:
Training-free navigation that leverages 3D scene graphs and LLM reasoning for object-goal, goal-oriented and vision-and-language navigation.
We propose AllDayNav, a lifelong navigation system via real-world reinforcement learning. The robot autonomously builds a self-evolving multimodal memory, generates self-instructions, and continuously improves its navigation policy without human supervision, achieving near-100% success rates.
We propose a training-free framework for vision-and-language navigation. Our framework formulates navigation guidance as graph constraint optimization by decomposing instructions into explicit spatial constraints, enabling zero-shot adaptation to unseen environments.
We propose UniGoal, a unified graph representation for zero-shot goal-oriented navigation. Based on online 3D scene graph prompting for LLM, our method can be directly applied to different kinds of scenes and goals without training.
We propose a training-free object-goal navigation framework by leveraging LLM and VFMs. We construct an online hierarchical 3D scene graph and prompt LLM to exploit structure information contained in subgraphs for zero-shot decision making.
We propose F2F-AP, a flow-to-future asynchronous policy for real-time dynamic manipulation. It predicts object flow to synthesize future observations and aligns visual features with future states, allowing policies to compensate for latency and interact with moving objects.
We propose AwareVLN, a self-aware reasoning framework for vision-language navigation. It triggers structured reasoning at key navigation nodes to understand scene context, task progress, and next-step plans, improving instruction following in simulation and real-world navigation.
We propose a general framework for mobile manipulation, which can be divided into docking point selection and fixed-base manipulation. We model the docking point selection stage as an optimization process, to let the agent move and touch target keypoint under several constraints.
We propose IGL-Nav, an incremental 3D Gaussian localization framework for image-goal navigation. It supports challenging scenarios where the camera for goal capturing and the agent's camera have very different intrinsics and poses, e.g., a cellphone and a RGB-D camera.