NeurIPS 2026 Workshop

Towards Test-Time Continual Learning Agents

Toward agents that keep learning after deployment:
uniting test-time, continual, and agentic learning.

December 13, 2026  ·  Atlanta, Georgia, USA  ·  In person

Call for Papers OpenReview

About the Workshop

The rapid progress of foundation models has produced agents with remarkable capabilities in perception, language understanding, reasoning, and tool use, while advances in post-training, reinforcement learning, retrieval-augmented generation, and agentic scaffolding now let both virtual and embodied agents tackle complex tasks in coding, web navigation, scientific discovery, and robotic control. Yet today's agents remain largely static: after costly pre- and post-training, their knowledge, skills, and behaviors are mostly fixed, and once deployed they adapt through prompting, retrieval, or external tools rather than genuine internal learning and memory consolidation.

This contrasts sharply with human intelligence, where people continuously acquire knowledge, refine representations, and reorganize beliefs through interaction. Current agents, whether virtual or embodied, instead cannot continually learn at test time: they struggle to internalize new information after deployment, fail to improve from repeated mistakes, and can forget prior knowledge and skills when updated naively (catastrophic forgetting).

The NeurIPS 2026 Workshop on Towards Test-Time Continual Learning Agents (TTCL) brings together researchers across continual learning, large language models, reinforcement learning, embodied AI, memory systems, cognitive science, robotics, and multimodal learning. We define Test-Time Continual Learning Agents as AI systems that continuously acquire, consolidate, and refine knowledge and capabilities during deployment, without catastrophic forgetting or repeated large-scale retraining. This goes beyond updating facts: it asks how agents improve perception, reasoning, planning, exploration, skill acquisition, and long-term decision-making through ongoing experience in virtual and physical worlds. These capabilities are especially important for robotics, scientific discovery, personalized assistants, education, healthcare, and human–AI collaboration.

Our central vision is to catalyze progress toward next-generation cognitive agents that learn continually at test time, consolidate experience over long horizons, improve through interaction, and remain reliable in dynamic physical and virtual worlds, rethinking the boundaries between training and inference, memory and learning, adaptation and reasoning.

Call for Papers

We invite contributions at the intersection of test-time learning, continual learning, and agentic AI. Relevant topics include (but are not limited to):

Topics

  • Test-time adaptation and learning. Test-time training and adaptation, online and meta-learning, in-context and parameter-efficient fine-tuning, and self-improvement from environment feedback and self-generated supervision.
  • Continual learning without catastrophic forgetting. Regularization-, replay-, optimization-, representation-, and architecture-based approaches to the stability–plasticity trade-off, applied to models and agents that must accumulate knowledge and skills across tasks.
  • Memory and knowledge consolidation. Episodic and semantic memory architectures, retrieval-augmented generation, and consolidation mechanisms that transform interaction trajectories into persistent knowledge and reusable skills.
  • Agents that learn from experience. Language, multimodal, and embodied agents that improve exploration, long-horizon planning, and skill acquisition from experience, including intrinsic motivation and open-ended learning.
  • Evaluation, safety, and robustness. Benchmarks and evaluation protocols for long-horizon test-time continual learning, and the safety, robustness, and alignment of self-improving agents.

Submissions are managed via OpenReview; see the Submission Guidelines below.

Submission Track

General Research Track 4–9 pages

Novel frameworks, empirical studies, algorithmic advances, benchmarks, position papers, or system demonstrations at the test-time × continual × agentic intersection.

Awards

Thanks to the generous sponsorship of Lambda, the workshop will present:

  • Best Paper Award: $3,000 in compute credits, selected from all submitted papers
  • Two Runner-up Awards: $1,500 in compute credits each
  • Every accepted paper: $400 in compute credits

Awards recognize the strongest contributions to the workshop.

Submission Guidelines

Formatting. Submissions must be in English, follow the NeurIPS 2026 LaTeX template, and be submitted as a single PDF via OpenReview. The page limits above apply to the main text; references and appendices are not included in the page limit, but the main text must be self-contained, and reviewers are not required to read beyond it. Submissions exceeding the page limit will be desk-rejected.

Anonymity. The workshop follows a double-blind review process. Submissions must be anonymized by removing author names, affiliations, and acknowledgments. Prior work should be cited in the third person, and identifying information, including in supplementary materials, must be omitted. Reviewing follows the NeurIPS conflict-of-interest guidelines, and organizers will not submit papers to TTCL.

Dual Submission & Non-Archival Policy. The workshop is non-archival: we welcome submissions that are under review at, or have been accepted by, other venues. Papers already accepted to the NeurIPS 2026 main conference will undergo an expedited review process primarily evaluating their relevance to the workshop themes. Accepted papers will be made publicly available on OpenReview, and all accepted papers will be presented in a poster session.

Important Dates

Submission deadlineAugust 29, 2026 September 5, 2026
Notification of acceptanceSeptember 25, 2026
Camera-ready dueOctober 25, 2026
Workshop dayDecember 13, 2026

All deadlines are 11:59 PM, Anywhere on Earth (AoE).

AgentOdyssey Challenge — Cancelled

The AgentOdyssey Challenge has been cancelled due to insufficient participation.

Invited Speakers

CMChristopher MacLellan

Christopher MacLellan

Georgia Tech

MLManling Li

Manling Li

Northwestern University

ZKZsolt Kira

Zsolt Kira

Georgia Tech

YWYu-Xiang Wang

Yu-Xiang Wang

University of California San Diego

KAKelsey Allen

Kelsey Allen

University of British Columbia

CSCansu Sancaktar

Cansu Sancaktar

Max Planck Institute for Intelligent Systems

JDJiafei Duan

Jiafei Duan

National University of Singapore

Schedule

All workshops are expected to run from 8 AM to 5 PM local time, to be confirmed depending on locations. The tentative schedule below assigns a 40-minute slot (including Q&A) to each invited speaker and three 15-minute paper award presentations: one Best Paper Award and two Runner-up Paper Awards. Time is also reserved for poster sessions, a breakout/networking session, and a panel. Times and speaker order are tentative; session topics, talk titles, and the final program will be posted before the workshop.

TimeSession
08:00 – 08:15Welcome & Opening
08:15 – 08:55Invited Talk — Christopher MacLellan
08:55 – 09:35Invited Talk — Manling Li
09:35 – 10:00Poster Session & Coffee A
10:00 – 10:40Invited Talk — Zsolt Kira
10:40 – 11:20Invited Talk — Yu-Xiang Wang
11:20 – 12:00Invited Talk — Kelsey Allen
12:00 – 13:00Lunch Break
13:00 – 13:40Invited Talk — Cansu Sancaktar
13:40 – 14:20Invited Talk — Jiafei Duan
14:20 – 14:45Poster Session & Coffee B
14:45 – 15:00Paper Award Presentation — Best Paper
15:00 – 15:15Paper Award Presentation — Runner-up Paper 1
15:15 – 15:30Paper Award Presentation — Runner-up Paper 2
15:30 – 16:20Panel Discussion
16:20 – 16:45Breakout & Networking
16:45 – 17:00Awards & Closing

Organizers

ZZZheyuan Zhang

Zheyuan "Brian" Zhang

Ph.D. Student
Johns Hopkins University

CJChuanyang Jin

Chuanyang Jin

Ph.D. Student
Johns Hopkins University

JSJacob Sansom

Jacob Sansom

Ph.D. Student
University of Michigan

ZWZekun Wang

Zekun Wang

Ph.D. Candidate
Georgia Institute of Technology

JXJianwen Xie

Jianwen Xie

Research Scientist
Lambda

JCJoyce Chai

Joyce Chai

Professor
University of Michigan

DKDaniel Khashabi

Daniel Khashabi

Assistant Professor
Johns Hopkins University

TSTianmin Shu

Tianmin Shu

Assistant Professor
Johns Hopkins University

Contact

For questions about the workshop or the call for papers, please email the organizers.