Papers
arxiv:2609.36012

In-Context Learning for Robots: Methods and Applications

Published on Sep 28
· Submitted by
Haojian Huang
on Sep 30
#2 Paper of the day
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

General-purpose robots must infer what a new task requires and translate that understanding into appropriate physical action. In-context learning (ICL) for robots supports this process by using demonstrations and interaction to direct existing competence with neural parameters held fixed during deployment. We organize this literature review around the interfaces connecting contextual evidence to execution, distinguishing four families: context-conditioned policies, geometric demonstration transfer, world-model-based control, and skill- and agent-based execution. Comparing these interfaces clarifies their transfer assumptions and the roles of training, correspondence, and memory in making context useful. Across manipulation and navigation, we examine how these mechanisms preserve taught requirements as objects, environments, and execution conditions change. This analysis links method design to evaluation practices that distinguish responsiveness to teaching, physical transfer, and benefits from retained experience. The resulting agenda connects compositional task acquisition and faithful transfer with physical recursive self-improvement, in which experience improves the ability to learn subsequent tasks.

Community

Paper author Paper submitter

Co-author note: I contributed to this survey.

A robot can finish a task and still miss what the demonstration taught. This survey follows context all the way to execution: through action distributions, motion references, predicted futures, and skills or programs.

That separates two questions: did the robot infer the requirement supplied by the teaching, and can its executor realize that requirement after the objects or environment change?

The survey covers manipulation and navigation, with correspondence, memory, recovery and experience reuse. It distinguishes fixed-weight contextual adaptation from related fast-weight methods. Readers designing experiments may find the evaluation chapter a useful starting point.

The paper has 100 pages and 412 references. The companion repository organizes a growing reading list by taxonomy and first public release date.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2609.36012
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2609.36012 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2609.36012 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2609.36012 in a Space README.md to link it from this page.

Collections including this paper 1