We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We introduce Generative Spoken Language Modeling, the task of learning the acoustic and linguistic characteristics of a language from raw audio (no text, no labels), and a set of metrics to automatically evaluate the learned representations at acoustic and linguistic levels for both encoding and generation. We set up baseline systems consisting of a discrete speech encoder (returning pseudo-text units), a generative language model (trained on pseudo-text), and a speech decoder (generating a waveform from pseudo-text) all trained without supervision and validate the proposed metrics with human evaluation. Across 3 speech encoders (CPC, wav2vec 2.0, HuBERT), we find that the number of discrete units (50, 100, or 200) matters in a task-dependent and encoder-dependent way, and that some combinations approach text-based systems.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2102.01192")
get_code_for_paper("2102.01192")
have("2102.01192")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2102.01192.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2102.01192)
Connect an agent — have() is free.