SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2010.11148 · 2020

FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 3 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
victor45664/espnet pwc_unofficial 0 of 3
FunctionStatusWhere it lives
adadelta_eps_decay Not yet run victor45664/espnet/espnet/asr/asr_utils.py
code served (permissive licence) · get_code("bb3665ddb6b8dd2d")
adam_lr_decay Not yet run victor45664/espnet/espnet/asr/asr_utils.py
code served (permissive licence) · get_code("1fa5ca494ed9750a")
restore_snapshot Not yet run victor45664/espnet/espnet/asr/asr_utils.py
code served (permissive licence) · get_code("96081a60369c59e0")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Streaming automatic speech recognition (ASR) aims to emit each hypothesized word as quickly and accurately as possible. However, emitting fast without degrading quality, as measured by word error rate (WER), is highly challenging. Existing approaches including Early and Late Penalties and Constrained Alignments penalize emission delay by manipulating per-token or per-frame probability prediction in sequence transducer models. While being successful in reducing delay, these approaches suffer from significant accuracy regression and also require additional word alignment information from an existing model. In this work, we propose a sequence-level emission regularization method, named FastEmit, that applies latency regularization directly on per-sequence probability in training transducer models, and does not require any alignment. We demonstrate that FastEmit is more suitable to the sequence-level optimization of transducer models for streaming ASR by applying it on various end-to-end streaming ASR networks including RNN-Transducer, Transformer-Transducer, ConvNet-Transducer and Conformer-Transducer. We achieve 150-300 ms latency reduction with significantly better accuracy over previous techniques on a Voice Search test set. FastEmit also improves streaming ASR accuracy from 4.4%/8.9% to 3.1%/7.5% WER, meanwhile reduces 90th percentile latency from 210 ms to only 30 ms on LibriSpeech.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2010.11148")
get_code_for_paper("2010.11148")
have("2010.11148")

Connect an agent — have() is free.