Soochan Lee, Gunhee Kim, Jaehyeon Son
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Recent studies have shown that Transformers can perform in-context reinforcement learning (RL) by imitating existing RL algorithms, enabling sample-efficient adaptation to unseen tasks without parameter updates. However, these models also inherit the suboptimal behaviors of the RL algorithms they imitate. This issue primarily arises due to the gradual update rule employed by those algorithms. Modelbased planning offers a promising solution to this limitation by allowing the models to simulate potential outcomes before taking action, providing an additional mechanism to deviate from the suboptimal behavior. Rather than learning a separate dynamics model, we propose Distillation for In-Context Planning (DICP), an in-context model-based RL framework where Transformers simultaneously learn environment dynamics and improve policy in-context. We evaluate DICP across a range of discrete and continuous environments, including Darkroom variants and Meta-World. Our results show that DICP achieves state-of-the-art performance while requiring significantly fewer environment interactions than baselines, which include both model-free counterparts and existing meta-RL methods. The code is available at https://github.com/jaehyeon-son/dicp.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2502.19009")
get_code_for_paper("2502.19009")
have("2502.19009")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2502.19009.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2502.19009)
Connect an agent — have() is free.