We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Multilingual pre-trained models have achieved remarkable performance on cross-lingual transfer learning. Some multilingual models such as mBERT, have been pre-trained on unlabeled corpora, therefore the embeddings of different languages in the models may not be aligned very well. In this paper, we aim to improve the zero-shot cross-lingual transfer performance by proposing a pre-training task named Word-Exchange Aligning Model (WEAM), which uses the statistical alignment information as the prior knowledge to guide cross-lingual word prediction. We evaluate our model on multilingual machine reading comprehension task MLQA and natural language interface task XNLI. The results show that WEAM can significantly improve the zero-shot performance.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2106.01732")
get_code_for_paper("2106.01732")
have("2106.01732")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2106.01732.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2106.01732)
Connect an agent — have() is free.