Jiatao Gu, Hang Le, Changhan Wang, Juan Pino, Didier Schwab, Laurent Besacier
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Adapter modules were recently introduced as an efficient alternative to fine-tuning in NLP. Adapter tuning consists in freezing pretrained parameters of a model and injecting lightweight modules between layers, resulting in the addition of only a small number of taskspecific trainable parameters. While adapter tuning was investigated for multilingual neural machine translation, this paper proposes a comprehensive analysis of adapters for multilingual speech translation (ST). Starting from different pre-trained models (a multilingual ST trained on parallel data or a multilingual BART (mBART) trained on non-parallel multilingual data), we show that adapters can be used to: (a) efficiently specialize ST to specific language pairs with a low extra cost in terms of parameters, and (b) transfer from an automatic speech recognition (ASR) task and an mBART pretrained model to a multilingual ST task. Experiments show that adapter tuning offer competitive results to full fine-tuning, while being much more parameter-efficient.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2106.01463")
get_code_for_paper("2106.01463")
have("2106.01463")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2106.01463.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2106.01463)
Connect an agent — have() is free.