Joshua Tenenbaum, Shuang Li, Antonio Torralba, Sanja Fidler, Xavier Puig, Tianmin Shu, Zilin Wang, Yuan-Hong Liao
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In this paper, we introduce Watch-And-Help (WAH), a challenge for testing social intelligence in agents. In WAH, an AI agent needs to help a human-like agent perform a complex household task efficiently. To succeed, the AI agent needs to i) understand the underlying goal of the task by watching a single demonstration of the human-like agent performing the same task (social perception), and ii) coordinate with the human-like agent to solve the task in an unseen environment as fast as possible (human-AI collaboration). For this challenge, we build VirtualHome-Social, a multi-agent household environment, and provide a benchmark including both planning and learning based baselines. We evaluate the performance of AI agents with the human-like agent as well as with real humans using objective metrics and subjective user ratings. Experimental results demonstrate that the proposed challenge and virtual environment enable a systematic evaluation on the important aspects of machine social intelligence at scale. 1 This 2-stage framework poses unique challenges for human-AI collaboration. Unlike prior work which provides a common goal a priori or considers a small goal space (Goodrich & Schultz, 2007;Carroll et al., 2019), our AI agent has to reason about what the human-like agent is trying to achieve by watching a single demonstration. Furthermore, the AI agent has to generalize its acquired knowl-
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2010.09890")
get_code_for_paper("2010.09890")
have("2010.09890")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2010.09890.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2010.09890)
Connect an agent — have() is free.