Milan Gritta, Ignacio Iacobacci
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The introduction of transformer-based crosslingual language models brought decisive improvements to multilingual NLP tasks. However, the lack of labelled data has necessitated a variety of methods that aim to close the gap to high-resource languages. Zero-shot methods in particular, often use translated task data as a training signal to bridge the performance gap between the source and target language(s). We introduce XeroAlign, a simple method for taskspecific alignment of cross-lingual pretrained transformers such as XLM-R. XeroAlign uses translated task data to encourage the model to generate similar sentence embeddings for different languages. The XeroAligned XLM-R, called XLM-RA, shows strong improvements over the baseline models to achieve state-ofthe-art zero-shot results on three multilingual natural language understanding tasks. XLM-RA performs on par with state-of-the-art models on a cross-lingual adversarial paraphrasing task and its text classification accuracy exceeds that of XLM-R trained with labelled data.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2105.02472")
get_code_for_paper("2105.02472")
have("2105.02472")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2105.02472.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2105.02472)
Connect an agent — have() is free.