Jan Deriu, Mark Cieliebak, Manuela Hürlimann, Katsiaryna Mlynchyk, Janick Michot, Luzia Sauer
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
One of the central skills that language learners need to practice is speaking the language. Currently, students in school do not get enough speaking opportunities and lack conversational practice. Recent advances in speech technology and natural language processing allow for the creation of novel tools to practice their speaking skills. In this work, we tackle the first component of such a pipeline, namely, the automated speech recognition module (ASR), which faces a number of challenges: first, stateof-the-art ASR models are often trained on adult read-aloud data by native speakers and do not transfer well to young language learners' speech. Second, most ASR systems contain a powerful language model, which smooths out errors made by the speakers. To give corrective feedback, which is a crucial part of language learning, the ASR systems in our setting need to preserve the errors made by the language learners. In this work, we build an ASR system that satisfies these requirements: it works on spontaneous speech by young language learners and preserves their errors. For this, we collected a corpus containing around 85 hours of English audio spoken by learners in Switzerland from grades 4 to 6 on different language learning tasks, which we used to train an ASR model. Our experiments show that our model benefits from direct fine-tuning on children's voices and has a much higher error preservation rate than other models.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2406.03235")
get_code_for_paper("2406.03235")
have("2406.03235")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2406.03235.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2406.03235)
Connect an agent — have() is free.