Gaurav Mittal, Jialin Yuan, Ye Yu, Mei Chen, Fuxin Li
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.
Video Object Segmentation (VOS) is fundamental to video understanding. Transformer-based methods show significant performance improvement on semi-supervised VOS. However, existing work faces challenges segmenting visually similar objects in close proximity of each other. In this paper, we propose a novel Bilateral Attention Transformer in Motion-Appearance Neighboring space (BATMAN) for semi-supervised VOS. It captures object motion in the video via a novel optical flow calibration module that fuses the segmentation mask with optical flow estimation to improve within-object optical flow smoothness and reduce noise at object boundaries. This calibrated optical flow is then employed in our novel bilateral attention, which computes the correspondence between the query and reference frames in the neighboring bilateral space considering both motion and appearance. Extensive experiments validate the effectiveness of BATMAN architecture by outperforming all existing state-of-the-art on all four popular VOS benchmarks: Youtube-VOS 2019 (85.0%), Youtube-VOS 2018 (85.3%), DAVIS 2017Val/Testdev (86.2%/82.2%), and DAVIS 2016 (92.5%).
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2208.01159")
get_code_for_paper("2208.01159")
have("2208.01159")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2208.01159.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2208.01159)
Connect an agent — have() is free.