Barret Zoph, V Le, Adam Roberts, Jason Wei, Albert Webson, Le Hou, Shayne Longpre, Tu Vu, Hyung Won, Denny Zhou Quoc, Chung Tay
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We study the design decisions of publicly available instruction tuning methods, and break down the development of Flan 2022 models (Chung et al., 2022). Through careful ablation studies on the Flan Collection of instruction tuning tasks and methods, we tease apart the effect of design decisions that enable Flan-T5 to outperform prior work by 3-17%+ across evaluation settings. We find task balancing and enrichment techniques are overlooked but critical to effective instruction tuning, and in particular, training with mixed prompt settings (zero-shot, few-shot, and chain-of-thought) actually yields stronger (2%+) performance in all settings. In further experiments, we show Flan-T5 requires less finetuning to converge higher and faster than T5 on single downstream tasks-motivating instruction-tuned models as more computationallyefficient starting checkpoints for new tasks. Finally, to accelerate research on instruction tuning, we make the Flan 2022 collection of datasets, templates, and methods publicly available. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2301.13688")
get_code_for_paper("2301.13688")
have("2301.13688")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2301.13688.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2301.13688)
Connect an agent — have() is free.