Tianhe Yu, Sergey Levine, Karol Hausman, Robotics At Google, Igor Mordatch, T Berlin, Wenlong Huang, Klaus Greff, Aakanksha Chowdhery, Marc Toussaint, Andy Zeng, Brian Ichter, and 12 more
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Figure 1: PaLM-E is a single general-purpose multimodal language model for embodied reasoning tasks, visual-language tasks, and language tasks. PaLM-E transfers knowledge from visual-language domains into embodied reasoning -from robot planning in environments with complex dynamics and physical constraints, to answering questions about the observable world. PaLM-E operates on multimodal sentences, i.e. sequences of tokens where inputs from arbitrary modalities (e.g. images, neural 3D representations, or states, in green and blue) are inserted alongside text tokens (in orange) as input to an LLM, trained end-to-end.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2303.03378")
get_code_for_paper("2303.03378")
have("2303.03378")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2303.03378.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2303.03378)
Connect an agent — have() is free.