Sampo Pyysalo, Stefan Dumitrescu, Andrei-Marius Avram
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Large-scale pretrained language models have become ubiquitous in Natural Language Processing. However, most of these models are available either in high-resource languages, in particular English, or as multilingual models that compromise performance on individual languages for coverage. This paper introduces Romanian BERT, the first purely Romanian transformer-based language model, pretrained on a large text corpus. We discuss corpus composition and cleaning, the model training process, as well as an extensive evaluation of the model on various Romanian datasets. We open source not only the model itself, but also a repository that contains information on how to obtain the corpus, fine-tune and use this model in production (with practical examples), and how to fully replicate the evaluation process.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2009.08712")
get_code_for_paper("2009.08712")
have("2009.08712")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2009.08712.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2009.08712)
Connect an agent — have() is free.