Kuan-Chieh Wang, Frank Rudzicz, Jixuan Wang, Michael Brudno
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Large pretrained language models (LMs) like BERT have improved performance in many disparate natural language processing (NLP) tasks. However, fine tuning such models requires a large number of training examples for each target task. Simultaneously, many realistic NLP problems are "few shot", without a sufficiently large training set. In this work, we propose a novel conditional neural process-based approach for few-shot text classification that learns to transfer from other diverse tasks with rich annotation. Our key idea is to represent each task using gradient information from a base model and to train an adaptation network that modulates a text classifier conditioned on the task representation. While previous task-aware few-shot learners represent tasks by input encoding, our novel task representation is more powerful, as the gradient captures input-output relationships of a task. Experimental results show that our approach outperforms traditional fine-tuning, sequential transfer learning, and state-of-the-art meta learning approaches on a collection of diverse few-shot tasks. We further conducted analysis and ablations to justify our design choices.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2201.11576")
get_code_for_paper("2201.11576")
have("2201.11576")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2201.11576.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2201.11576)
Connect an agent — have() is free.