I’m interested in how frontier models take part in constructing their successors, through environments, algorithms, infrastructure, and harnesses. I view it as a horizontal endeavor, one I hope to realize through the right way of scaling.

I am a third-year Ph.D. student in Machine Learning at Georgia Tech, co-advised by Bo Dai and Chao Zhang. Currently, I am a Student Researcher at Google DeepMind in Mountain View, where I work on agentic MLE for Gemini. I contribute to the Gemini 3.x Flash and Gemini 4 models.

Before Georgia Tech, I received my B.Eng. in Automation from Tsinghua University.

I am open to full-time positions in industry. I welcome conversations about research, collaboration, and opportunities: reach me at rqiang6@gatech.edu.

Research

My research aims at self-improving AI, organized as a stack in which every layer has to hold:

  • Data & Environments. Interactive playgrounds where agents run the real experiment loop, and automated pipelines that manufacture verifiable tasks at scale (MLE-Dojo, MLE-Smith, RLE-Bench).
  • Algorithms. Post-training that stays dense, reliable, and on-policy over long horizons (Agent DAgger).
  • Infrastructure. Modular systems that schedule and scale agentic reinforcement learning (STACX).
  • Harnesses. Hierarchical orchestration that sustains long-horizon optimization and research (Matryoshka Agent), a robotics harness that extends coding agents to any robot (Kinex), and a self-improver built on it that solved all 365 RoboCasa tasks by evolving the robot’s skills and functions from its own trials (Physical RSI).

I wish to find the right way of scaling for Recursive Self-Improvement.

I strive for research and projects that are scalable and have real impact on frontier models.

I contribute to frontier models such as Gemini 3.x Flash and Gemini 4 models.

MLE-Dojo and MLE-Smith have been widely adopted for building MLE/RSI agents and systems, and have proven scalable (e.g., OpenRSI).

Publications & Preprints

* equal contribution  ·  † equal second authorship

Software

  • Kinex An open-source robotics harness for coding agents. Three layers of devices, tools, and skills expose a robot as composable devices, so one agent adapts to arbitrary robots in simulation and on real hardware, including ROS 2. Also available as plugins for Pi, Claude Code, and Codex. Project website.
  • STACX A modular infrastructure for end-to-end agentic reinforcement learning: a sandboxed task-execution engine coupled with a multi-algorithm training engine (GRPO, SFT, DAgger) for scheduling and scaling agent training.
  • MLE-Dojo A Gym-style framework for training, evaluating, and improving LLM agents on iterative machine learning engineering workflows, with interactive sandbox environments built on 200+ real Kaggle competitions.
  • RLE-Bench A benchmark for evaluating coding agents on robot learning engineering tasks through observation, experimentation, and iterative development.

Experience

  • Google DeepMind, Mountain View Student Researcher · agentic MLE for Gemini Feb 2026 – present

Education

  • Georgia Institute of Technology, Atlanta Ph.D. student in Machine Learning · co-advised by Bo Dai and Chao Zhang Aug 2024 – present
  • Tsinghua University, Beijing B.Eng. in Automation Sep 2020 – Jun 2024

Academic Service

Reviewer for NeurIPS, ICLR, ICML, and ACL Rolling Review.

MISC / 01
01 / 08

Visitors

Drag to rotate · scroll to zoom
Visits
—
Countries / regions
—

Countries / regions

VISITS

Connecting to the statistics service…

Connecting
Visitor statistics. Opening this page does not submit a visit.