Sergey Levine, Igor Mordatch, Oleh Rybkin, Kostas Daniilidis, Chuning Zhu, Anusha Nagabandi
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The ability to plan into the future while utilizing only raw high-dimensional observations, such as images, can provide autonomous agents with broad capabilities. Visual model-based reinforcement learning (RL) methods that plan future actions directly have shown impressive results on tasks that require only short-horizon reasoning, however, these methods struggle on temporally extended tasks. We argue that it is easier to solve long-horizon tasks by planning sequences of states rather than just actions, as the effects of actions greatly compound over time and are harder to optimize. To achieve this, we draw on the idea of collocation, which has shown good results on long-horizon tasks in optimal control literature, and adapt it to the image-based setting by utilizing learned latent state space models. The resulting latent collocation method (LatCo) optimizes trajectories of latent states, which improves over previously proposed shooting methods for visual model-based RL on tasks with sparse rewards and long-term goals. Videos and code: https://orybkin.github.io/latco/.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2106.13229")
get_code_for_paper("2106.13229")
have("2106.13229")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2106.13229.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2106.13229)
Connect an agent — have() is free.