Zhiao Huang, Hao Su, Tongzhou Mu, Stone Tao, Xiaochen Li, Yuzhe Qin
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Training long-horizon robotic policies in complex physical environments is essential for many applications, such as robotic manipulation. However, learning a policy that can generalize to unseen tasks is challenging. In this work, we propose to achieve one-shot task generalization by decoupling plan generation and plan execution. Specifically, our method solves complex longhorizon tasks in three steps: build a paired abstract environment by simplifying geometry and physics, generate abstract trajectories, and solve the original task by an abstract-to-executable trajectory translator. In the abstract environment, complex dynamics such as physical manipulation are removed, making abstract trajectories easier to generate. However, this introduces a large domain gap between abstract trajectories and the actual executed trajectories as abstract trajectories lack low-level details and are not aligned frame-to-frame with the executed trajectory. In a manner reminiscent of language translation, our approach leverages a seq-to-seq model to overcome the large domain gap between the abstract and executable trajectories, enabling the low-level policy to follow the abstract trajectory. Experimental results on various unseen longhorizon tasks with different robot embodiments demonstrate the practicability of our methods to achieve one-shot task generalization. Videos and more details can be found on the project page: https://trajectorytranslation.github.io/.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2210.07658")
get_code_for_paper("2210.07658")
have("2210.07658")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2210.07658.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2210.07658)
Connect an agent — have() is free.