SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2010.12013 · NeurIPS · 2020

Listening to Sounds of Silence for Speech Denoising

Ruilin Xu, Rundi Wu, Yuko Ishiwaka, Carl Vondrick, Changxi Zheng

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

FunctionStatusWhere it lives
ContextAggNet Ran henryxrl/Listening-to-Sound-of-Silence-for-Speech-Denoising/model_2_audio_denoising/audio_denoising_model/networks.py
pointer only (licence: NONE) · get_code("dec4df67c232d10c")
ConvBlock Ran henryxrl/Listening-to-Sound-of-Silence-for-Speech-Denoising/model_2_audio_denoising/audio_denoising_model/networks.py
pointer only (licence: NONE) · get_code("5d6655c1e096c560")
DownConvBlock Ran henryxrl/Listening-to-Sound-of-Silence-for-Speech-Denoising/model_2_audio_denoising/audio_denoising_model/networks.py
pointer only (licence: NONE) · get_code("eedac963eca1f715")
UpConvBlock Ran henryxrl/Listening-to-Sound-of-Silence-for-Speech-Denoising/model_2_audio_denoising/audio_denoising_model/networks.py
pointer only (licence: NONE) · get_code("abb93377d49ef2a2")
InpaintNet Not yet run henryxrl/Listening-to-Sound-of-Silence-for-Speech-Denoising/model_2_audio_denoising/audio_denoising_model/networks.py
pointer only (licence: NONE) · get_code("d37ec58c5d0b7d93")
JointModel Not yet run henryxrl/Listening-to-Sound-of-Silence-for-Speech-Denoising/model_2_audio_denoising/audio_denoising_model/networks.py
pointer only (licence: NONE) · get_code("6c2ed6d029f15474")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We introduce a deep learning model for speech denoising, a long-standing challenge in audio analysis arising in numerous applications. Our approach is based on a key observation about human speech: there is often a short pause between each sentence or word. In a recorded speech signal, those pauses introduce a series of time periods during which only noise is present. We leverage these incidental silent intervals to learn a model for automatic speech denoising given only mono-channel audio. Detected silent intervals over time expose not just pure noise but its timevarying features, allowing the model to learn noise dynamics and suppress it from the speech signal. Experiments on multiple datasets confirm the pivotal role of silent interval detection for speech denoising, and our method outperforms several state-of-the-art denoising methods, including those that accept only audio input (like ours) and those that denoise based on audiovisual input (and hence require more information). We also show that our method enjoys excellent generalization properties, such as denoising spoken languages not seen during training.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2010.12013")
get_code_for_paper("2010.12013")
have("2010.12013")

Connect an agent — have() is free.