ImageHAOYUAN WU
HomeBlog
Image

Fred (Haoyuan) Wu

Final Year Undergraduate Student

School of Computing and Data Science

The University of Hong Kong

Hi! I'm Fred, a final year undergraduate student at the School of Computing and Data Science, the University of Hong Kong (HKU). I am currently a research assistant and an incoming PhD student at XLANG Lab advised by Prof. Tao Yu, working on computer-use agents and embodied agents. Previously, I also had the honor to work at the University of Illinois Urbana-Champaign with Prof. Hao Peng on reinforcement learning methods for large language models. Feel free to contact me if you are interested in my research or want a chat!

Research Interests

  • Embodied AI Agents
  • Vision-Language-Action (VLA) Models
  • Computer-Use Agents

Education

The University of Hong Kong

Doctor of Philosophy (Institute of Data Science)

Sep 2026 – Jun 2030

(expected)

The University of Hong Kong

Bachelor of Engineering in Computer Science

Sep 2022 – Jun 2026

(expected)

University of Illinois Urbana-Champaign

Exchange

Jan 2025 – May 2025

Publications

VideoAgentTrek: Computer Use Pretraining from Unlabeled Videos

Dunjie Lu*, Yiheng Xu*, Junli Wang*, Haoyuan Wu, Xinyuan Wang, Zekun Wang, Junlin Yang, Hongjin Su, Jixuan Chen, Junda Chen, Yuchen Mao, Jingren Zhou, Junyang Lin, Binyuan Hui, Tao Yu

ICLR 2026
[Paper]

Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis

Tianbao Xie*, Jiaqi Deng*, Xiaochuan Li*, Junlin Yang*, Haoyuan Wu, Jixuan Chen, Wenjing Hu, Xinyuan Wang, Yuhui Xu, Zekun Wang, Yiheng Xu, Junli Wang, Doyen Sahoo, Tao Yu, Caiming Xiong

NeurIPS 2025 Spotlight
[Project][Paper][Code]

Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?

Ruisheng Cao, Fangyu Lei, Haoyuan Wu, Jixuan Chen, Yeqiao Fu, Hongcheng Gao, Xinzhuang Xiong, Hanchong Zhang, Yuchen Mao, Wenjing Hu, Tianbao Xie, Hongshen Xu, Danyang Zhang, Sida Wang, Ruoxi Sun, Pengcheng Yin, Caiming Xiong, Ansong Ni, Qian Liu, Victor Zhong, Lu Chen, Kai Yu, Tao Yu

NeurIPS 2024 Spotlight
[Project][Paper][Code]

EVOR: Evolving Retrieval for Code Generation

Hongjin Su, Shuyang Jiang, Yuhang Lai, Haoyuan Wu, Boao Shi, Che Liu, Qian Liu, Tao Yu

EMNLP 2024 Findings
[Project][Paper][Code]

Experiences

XLANG Lab, The University of Hong Kong

Student Research Assistant (Supervisor: Prof. Tao Yu)

Dec 2023 – Present

University of Illinois Urbana-Champaign

Student Research Assistant (Supervisor: Prof. Hao Peng)

Feb 2025 – May 2025