SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2405.16247 · NeurIPS · 2024

AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learning

Minghao Chen, Xiaofei He, Yihang Li, Yanting Yang, Shiyu Yu, Binbin Lin

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
minghchen/automanual canonical 4 of 4
FunctionStatusWhere it lives
find_object Ran minghchen/automanual/automanual_alfworld/env_history.py
pointer only (licence: NONE) · get_code("20280b7abdbaf9ff")
get_object_with_id Ran minghchen/automanual/automanual_alfworld/env_history.py
pointer only (licence: NONE) · get_code("10dbd22d58898b23")
get_result_dict Ran minghchen/automanual/automanual_alfworld/main_build.py
pointer only (licence: NONE) · get_code("17d4780cd5e4e65f")
go_to_put_object Ran minghchen/automanual/automanual_alfworld/env_history.py
pointer only (licence: NONE) · get_code("814f8a57a34fddb2")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Large Language Models (LLM) based agents have shown promise in autonomously completing tasks across various domains, e.g., robotics, games, and web navigation. However, these agents typically require elaborate design and expert prompts to solve tasks in specific domains, which limits their adaptability. We introduce AutoManual, a framework enabling LLM agents to autonomously build their understanding through interaction and adapt to new environments. AutoManual categorizes environmental knowledge into diverse rules and optimizes them in an online fashion by two agents: 1) The Planner codes actionable plans based on current rules for interacting with the environment. 2) The Builder updates the rules through a well-structured rule system that facilitates online rule management and essential detail retention. To mitigate hallucinations in managing rules, we introduce a case-conditioned prompting strategy for the Builder. Finally, the Formulator agent compiles these rules into a comprehensive manual. The self-generated manual can not only improve the adaptability but also guide the planning of smaller LLMs while being human-readable. Given only one simple demonstration, AutoManual significantly improves task success rates, achieving 97.4% with GPT-4-turbo and 86.2% with GPT-3.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2405.16247")
get_code_for_paper("2405.16247")
have("2405.16247")

Connect an agent — have() is free.