SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2211.09960 · NeurIPS · 2022

Ask4Help: Learning to Leverage an Expert for Embodied Tasks

Aniruddha Kembhavi, Kunal Singh, Alvaro Herrasti, Jonghyun Choi

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 1 functions out of this paper's own repositories and ran 1 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
allenai/ask4help canonical 1 of 1
FunctionStatusWhere it lives
grad_norm Ran allenai/ask4help/allenact/utils/model_utils.py
code served (permissive licence) · get_code("939725942599a874")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Embodied AI agents continue to become more capable every year with the advent of new models, environments, and benchmarks, but are still far away from being performant and reliable enough to be deployed in real, user-facing, applications. In this paper, we ask: can we bridge this gap by enabling agents to ask for assistance from an expert such as a human being? To this end, we propose the ASK4HELP policy that augments agents with the ability to request, and then use expert assistance. ASK4HELP policies can be efficiently trained without modifying the original agent's parameters and learn a desirable trade-off between task performance and the amount of requested help, thereby reducing the cost of querying the expert. We evaluate ASK4HELP on two different tasks -object goal navigation and room rearrangement and see substantial improvements in performance using minimal help. On object navigation, an agent that achieves a 52% success rate is raised to 86% with 13% help and for rearrangement, the state-of-the-art model with a 7% success rate is dramatically improved to 90.4% using 39% help. Human trials with ASK4HELP demonstrate the efficacy of our approach in practical scenarios. We release the code for Ask4Help here: https: //github.com/allenai/ask4help.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2211.09960")
get_code_for_paper("2211.09960")
have("2211.09960")

Connect an agent — have() is free.