SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2303.03378 · 2023

PaLM-E: An Embodied Multimodal Language Model

Tianhe Yu, Sergey Levine, Karol Hausman, Robotics At Google, Igor Mordatch, T Berlin, Wenlong Huang, Klaus Greff, Aakanksha Chowdhery, Marc Toussaint, Andy Zeng, Brian Ichter, and 12 more

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Figure 1: PaLM-E is a single general-purpose multimodal language model for embodied reasoning tasks, visual-language tasks, and language tasks. PaLM-E transfers knowledge from visual-language domains into embodied reasoning -from robot planning in environments with complex dynamics and physical constraints, to answering questions about the observable world. PaLM-E operates on multimodal sentences, i.e. sequences of tokens where inputs from arbitrary modalities (e.g. images, neural 3D representations, or states, in green and blue) are inserted alongside text tokens (in orange) as input to an LLM, trained end-to-end.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2303.03378")
get_code_for_paper("2303.03378")
have("2303.03378")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2303.03378.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2303.03378.svg)](https://syntology.ai/paper/2303.03378)

Connect an agent — have() is free.