Chenglong Wang, Tong Xiao, Bei Li, Jingbo Zhu, Yongyu Mu, Chunliang Zhang, Tongran Liu, Kai Song, Zhiquan Cao, Peinan Feng, Yuzhang Wu
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Large language models (LLMs) can handle multilingual and cross-lingual text within a single input; however, previous works leveraging multilingualism in LLMs primarily focus on using English as the pivot language to enhance language understanding and reasoning. Given that multiple languages are a compensation for the losses caused by a single language's limitations, it's a natural next step to enrich the model's learning context through the integration of the original input with its multiple translations. In this paper, we start by revealing that LLMs learn from Parallel Multilingual Input (PMI). Our comprehensive evaluation shows that PMI enhances the model's comprehension of the input, achieving superior performance than conventional in-context learning (ICL). Furthermore, to explore how multilingual processing affects prediction, we examine the activated neurons in LLMs. Surprisingly, involving more languages in the input activates fewer neurons, leading to more focused and effective neural activation patterns. This neural reaction coincidently mirrors the neuroscience insight about synaptic pruning, highlighting a similarity between artificial and biological 'brains'. Our parallel multilingual data and code could be found at https://github.com/takagi97/ LLMs-are-parallel-multilingual-learners. Translate into English. German: Die Ware hat unter 20 Euro gekostet.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2403.09073")
get_code_for_paper("2403.09073")
have("2403.09073")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2403.09073.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2403.09073)
Connect an agent — have() is free.