SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2104.07972 · EMNLP · 2021

Language Models are Few-Shot Butlers

Vincent Micheli, François Fleuret

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Pretrained language models demonstrate strong performance in most NLP tasks when fine-tuned on small task-specific datasets. Hence, these autoregressive models constitute ideal agents to operate in text-based environments where language understanding and generative capabilities are essential. Nonetheless, collecting expert demonstrations in such environments is a time-consuming endeavour. We introduce a two-stage procedure to learn from a small set of demonstrations and further improve by interacting with an environment. We show that language models fine-tuned with only 1.2% of the expert demonstrations and a simple reinforcement learning algorithm achieve a 51% absolute improvement in success rate over existing methods in the ALFWorld environment. Goal: Rinse the egg to put it in the microwave. Obs: Looking quickly around you, you see a cabinet, a garbagecan, a coffeemachine, [...], a stoveburner, a sinkbasin and a microwave. Action: go to sinkbasin Obs: You arrive at sinkbasin. You see a butterknife, a potato, a spoon and a tomato. Action: go to garbagecan Obs: You arrive at garbagecan. You see an egg. Action: take egg from garbagecan Obs: You pick up the egg from the garbagecan. Action: go to sinkbasin Obs: You arrive at sinkbasin. You see a butterknife, a potato, a spoon and a tomato. Action: clean egg with sinkbasin Obs: You clean the egg using the sinkbasin. Action: go to microwave Obs: You arrive at microwave. The microwave is closed. Action: open microwave Obs: You open the microwave.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2104.07972")
get_code_for_paper("2104.07972")
have("2104.07972")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2104.07972.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2104.07972.svg)](https://syntology.ai/paper/2104.07972)

Connect an agent — have() is free.