Teven Le Scao, Alexander Rush
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
When fine-tuning pretrained models for classification, researchers either use a generic model head or a task-specific prompt for prediction. Proponents of prompting have argued that prompts provide a method for injecting taskspecific guidance, which is beneficial in lowdata regimes. We aim to quantify this benefit through rigorous testing of prompts in a fair setting: comparing prompted and head-based fine-tuning in equal conditions across many tasks and data sizes. By controlling for many sources of advantage, we find that prompting does indeed provide a benefit, and that this benefit can be quantified per task. Results show that prompting is often worth 100s of data points on average across classification tasks.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2103.08493")
get_code_for_paper("2103.08493")
have("2103.08493")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2103.08493.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2103.08493)
Connect an agent — have() is free.