Muhammad Abdul-Mageed, Ife Adebara, ⋆ Elmadany, Alcides Inciarte
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Language identification (LID) is a crucial precursor for NLP, especially for mining web data. Problematically, most of the world's 7000+ languages today are not covered by LID technologies. We address this pressing issue for Africa by introducing AfroLID, a neural LID toolkit for 517 African languages and varieties. AfroLID exploits a multi-domain web dataset manually curated from across 14 language families utilizing five orthographic systems. When evaluated on our blind Test set, AfroLID achieves 95.89 F 1 -score. We also compare AfroLID to five existing LID tools that each cover a small number of African languages, finding it to outperform them on most languages. We further show the utility of AfroLID in the wild by testing it on the acutely under-served Twitter domain. Finally, we offer a number of controlled case studies and perform a linguistically-motivated error analysis that allow us to both showcase AfroLID's powerful capabilities and limitations. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2210.11744")
get_code_for_paper("2210.11744")
have("2210.11744")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2210.11744.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2210.11744)
Connect an agent — have() is free.