Pieter Abbeel, Kimin Lee, Stephen James, Younggyo Seo
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Recent unsupervised pre-training methods have shown to be effective on language and vision domains by learning useful representations for multiple downstream tasks. In this paper, we investigate if such unsupervised pre-training methods can also be effective for vision-based reinforcement learning (RL). To this end, we introduce a framework that learns representations useful for understanding the dynamics via generative pretraining on videos. Our framework consists of two phases: we pre-train an action-free latent video prediction model, and then utilize the pre-trained representations for efficiently learning actionconditional world models on unseen environments. To incorporate additional action inputs during fine-tuning, we introduce a new architecture that stacks an action-conditional latent prediction model on top of the pre-trained action-free prediction model. Moreover, for better exploration, we propose a video-based intrinsic bonus that leverages pre-trained representations. We demonstrate that our framework significantly improves both final performances and sample-efficiency of vision-based RL in a variety of manipulation and locomotion tasks. Code is available at https: //github.com/younggyoseo/apv.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2203.13880")
get_code_for_paper("2203.13880")
have("2203.13880")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2203.13880.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2203.13880)
Connect an agent — have() is free.