SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2202.08862 · 2022

RemixIT: Continual self-training of speech enhancement models via bootstrapped remixing

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
etzinis/unsup_speech_enh_adaptation canonical 3 of 3
udase-chime2023/baseline pwc_unofficial 1 of 1
FunctionStatusWhere it lives
compute_sisdr Ran udase-chime2023/baseline/baseline/metrics/sisdr_metric.py
code served (permissive licence) · get_code("59bcee2a1aec4892")
normalize_waveform Ran etzinis/unsup_speech_enh_adaptation/baseline/run_remixit.py
code served (permissive licence) · get_code("b05bd1c49be2b5a5")
report_losses_mean_and_std Ran etzinis/unsup_speech_enh_adaptation/baseline/utils/cometml_logger.py
code served (permissive licence) · get_code("105a42f915805d8c")
tuple_availavle_speech Ran etzinis/unsup_speech_enh_adaptation/baseline/utils/cmd_parser.py
code served (permissive licence) · get_code("6cb3ac65f741ebb5")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We present RemixIT, a simple yet effective self-supervised method for training speech enhancement without the need of a single isolated in-domain speech nor a noise waveform. Our approach overcomes limitations of previous methods which make them dependent on clean in-domain target signals and thus, sensitive to any domain mismatch between train and test samples. RemixIT is based on a continuous self-training scheme in which a pre-trained teacher model on out-of-domain data infers estimated pseudo-target signals for in-domain mixtures. Then, by permuting the estimated clean and noise signals and remixing them together, we generate a new set of bootstrapped mixtures and corresponding pseudo-targets which are used to train the student network. Vice-versa, the teacher periodically refines its estimates using the updated parameters of the latest student models. Experimental results on multiple speech enhancement datasets and tasks not only show the superiority of our method over prior approaches but also showcase that RemixIT can be combined with any separation model as well as be applied towards any semi-supervised and unsupervised domain adaptation task. Our analysis, paired with empirical evidence, sheds light on the inside functioning of our self-training scheme wherein the student model keeps obtaining better performance while observing severely degraded pseudo-targets.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2202.08862")
get_code_for_paper("2202.08862")
have("2202.08862")

Connect an agent — have() is free.