We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Learning to localize the sound source in videos without explicit annotations is a novel area of audio-visual research. Existing work in this area focuses on creating attention maps to capture the correlation between the two modalities to localize the source of the sound. In a video, oftentimes, the objects exhibiting movement are the ones generating the sound. In this work, we capture this characteristic by modeling the optical flow in a video as a prior to better aid in localizing the sound source. We further demonstrate that the addition of flow-based attention substantially improves visual sound source localization. Finally, we benchmark our method on standard sound source localization datasets and achieve state-of-the-art performance on the Soundnet Flickr and VGG Sound Source datasets. Code: https://github.com/denfed/heartheflow.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2211.03019")
get_code_for_paper("2211.03019")
have("2211.03019")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2211.03019.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2211.03019)
Connect an agent — have() is free.