We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Many NLP models operate over sequences of subword tokens produced by hand-crafted tokenization rules and heuristic subword induction algorithms. A simple universal alternative is to represent every computerized text as a sequence of bytes via UTF-8, obviating the need for an embedding layer since there are fewer token types (256) than dimensions. Surprisingly, replacing the ubiquitous embedding layer with one-hot representations of each byte does not hurt performance; experiments on byte-to-byte machine translation from English to 10 different languages show a consistent improvement in BLEU, rivaling character-level and even standard subword-level models. A deeper investigation reveals that the combination of embeddingless models with decoder-input dropout amounts to token dropout, which benefits byte-to-byte models in particular.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2008.09396")
get_code_for_paper("2008.09396")
have("2008.09396")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2008.09396.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2008.09396)
Connect an agent — have() is free.