We lifted 3 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| amazon-research/multimodal-neuralslam | canonical | 3 of 3 |
| Function | Status | Where it lives |
|---|---|---|
| convert_target_cls | Ran | amazon-research/multimodal-neuralslam/et_train/dataset_parser.py code served (permissive licence) · get_code("d83f0c8587201690") |
| shift_down | Ran | amazon-research/multimodal-neuralslam/et_train/dataset_sg_exp_et.py code served (permissive licence) · get_code("ea1d887700083f8a") |
| update_map | Ran | amazon-research/multimodal-neuralslam/et_train/dataset_sg_exp_et.py code served (permissive licence) · get_code("09b9cdf0099e7379") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Recent years have witnessed an emerging paradigm shift toward embodied artificial intelligence, in which an agent must learn to solve challenging tasks by interacting with its environment. There are several challenges in solving embodied multimodal tasks, including long-horizon planning, vision-and-language grounding, and efficient exploration. We focus on a critical bottleneck, namely the performance of planning and navigation. To tackle this challenge, we propose a Neural SLAM approach that, for the first time, utilizes several modalities for exploration, predicts an affordance-aware semantic map, and plans over it at the same time. This significantly improves exploration efficiency, leads to robust long-horizon planning, and enables effective vision-and-language grounding. With the proposed Affordance-aware Multimodal Neural SLAM (AMSLAM) approach, we obtain more than 40% improvement over prior published work on the ALFRED benchmark and set a new state-of-the-art generalization performance at a success rate of 23.48% on the test unseen scenes.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2201.09862")
get_code_for_paper("2201.09862")
have("2201.09862")
Connect an agent — have() is free.