SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2307.06292 · 2023

Global birdsong embeddings enable superior transfer learning for bioacoustic classification

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 7 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
google-research/chirp canonical 4 of 7
FunctionStatusWhere it lives
build_optimizer Ran google-research/chirp/chirp/birb_sep_paper/model_utils.py
code served (permissive licence) · get_code("3640e50e988d5748")
either Ran google-research/chirp/chirp/config_utils.py
code served (permissive licence) · get_code("c6db305be9ff35aa")
get_hyper Ran google-research/chirp/chirp/configs/baseline_effnet_v2.py
code served (permissive licence) · get_code("f90af822a7b5954b")
get_hyper Ran google-research/chirp/chirp/configs/hubert_base_pq_semisupervised_finetuning.py
code served (permissive licence) · get_code("0d707b8aeb33083f")
gabor_filter Not yet run google-research/chirp/chirp/models/cwt.py
code served (permissive licence) · get_code("a0b07d513950c658")
morlet_wavelet Not yet run google-research/chirp/chirp/models/cwt.py
code served (permissive licence) · get_code("925bc0f907122c9d")
sinc_filter Not yet run google-research/chirp/chirp/models/cwt.py
code served (permissive licence) · get_code("9d04e3c091161214")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Automated bioacoustic analysis aids understanding and protection of both marine and terrestrial animals and their habitats across extensive spatiotemporal scales, and typically involves analyzing vast collections of acoustic data. With the advent of deep learning models, classification of important signals from these datasets has markedly improved. These models power critical data analyses for research and decision-making in biodiversity monitoring, animal behaviour studies, and natural resource management. However, deep learning models are often data-hungry and require a significant amount of labeled training data to perform well. While sufficient training data is available for certain taxonomic groups (e.g., common bird species), many classes (such as rare and endangered species, many non-bird taxa, and call-type) lack enough data to train a robust model from scratch. This study investigates the utility of feature embeddings extracted from audio classification models to identify bioacoustic classes other than the ones these models were originally trained on. We evaluate models on diverse datasets, including different bird calls and dialect types, bat calls, marine mammals calls, and amphibians calls. The embeddings extracted from the models trained on bird vocalization data consistently allowed higher quality classification than the embeddings trained on general audio datasets. The results of this study indicate that high-quality feature embeddings from large-scale acoustic bird classifiers can be harnessed for few-shot transfer learning, enabling the learning of new classes from a limited quantity of training data. Our findings reveal the potential for efficient analyses of novel bioacoustic tasks, even in scenarios where available training data is limited to a few samples.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2307.06292")
get_code_for_paper("2307.06292")
have("2307.06292")

Connect an agent — have() is free.