We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Multilingual pretrained models are effective for machine translation and cross-lingual processing because they contain multiple languages in one model. However, they are pretrained after their tokenizers are fixed; therefore it is difficult to change the vocabulary after pretraining. When we extend the pretrained models to new languages, we must modify the tokenizers simultaneously. In this paper, we add new subwords to the SentencePiece tokenizer to apply a multilingual pretrained model to new languages (Inuktitut in this paper). In our experiments, we segmented Inuktitut sentences into subwords without changing the segmentation of already pretrained languages, and applied the mBART-50 pretrained model to English-Inuktitut translation.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2211.15965")
get_code_for_paper("2211.15965")
have("2211.15965")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2211.15965.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2211.15965)
Connect an agent — have() is free.