Trung Bui, Doo Kim, Xiang Ren, Jonathan May, Franck Dernoncourt, Meryem M'hamdi
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Multilingual models, such as M-BERT and XLM-R, have gained increasing popularity, due to their zero-shot cross-lingual transfer learning capabilities. However, their generalization ability is still inconsistent for typologically diverse languages and across different benchmarks. Recently, meta-learning has garnered attention as a promising technique for enhancing transfer learning under low-resource scenarios: particularly for crosslingual transfer in Natural Language Understanding (NLU). In this work, we propose X-METRA-ADA, a cross-lingual MEta-TRAnsfer learning ADAptation approach for NLU. Our approach adapts MAML, an optimization-based meta-learning approach, to learn to adapt to new languages. We extensively evaluate our framework on two challenging cross-lingual NLU tasks: multilingual task-oriented dialog and typologically diverse question answering. We show that our approach outperforms naive fine-tuning, reaching competitive performance on both tasks for most languages. Our analysis reveals that X-METRA-ADA can leverage limited data for faster adaptation.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2104.09696")
get_code_for_paper("2104.09696")
have("2104.09696")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2104.09696.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2104.09696)
Connect an agent — have() is free.