We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Modular deep learning has been proposed for the efficient adaption of pre-trained models to new tasks, domains and languages. In particular, combining language adapters with task adapters has shown potential where no supervised data exists for a language. In this paper, we explore the role of language adapters in zero-shot cross-lingual transfer for natural language understanding (NLU) benchmarks. We study the effect of including a target-language adapter in detailed ablation studies with two multilingual models and three multilingual datasets. Our results show that the effect of target-language adapters is highly inconsistent across tasks, languages and models. Retaining the source-language adapter instead often leads to an equivalent, and sometimes to a better, performance. Removing the language adapter after training has only a weak negative effect, indicating that the language adapters do not have a strong impact on the predictions.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2402.00149")
get_code_for_paper("2402.00149")
have("2402.00149")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2402.00149.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2402.00149)
Connect an agent — have() is free.