Xiang Wang, Yingya Zhang, Shiwei Zhang, Zhiwu Qing, Deli Zhao, Nong Sang, Changxin Gao
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Current state-of-the-art approaches for few-shot action recognition achieve promising performance by conducting frame-level matching on learned visual features. However, they generally suffer from two limitations: i) the matching procedure between local frames tends to be inaccurate due to the lack of guidance to force long-range temporal perception; ii) explicit motion learning is usually ignored, leading to partial information loss. To address these issues, we develop a Motion-augmented Long-short Contrastive Learning (MoLo) method that contains two crucial components, including a long-short contrastive objective and a motion autodecoder. Specifically, the long-short contrastive objective is to endow local frame features with long-form temporal awareness by maximizing their agreement with the global token of videos belonging to the same class. The motion autodecoder is a lightweight architecture to reconstruct pixel motions from the differential features, which explicitly embeds the network with motion dynamics. By this means, MoLo can simultaneously learn long-range temporal context and motion cues for comprehensive few-shot matching. To demonstrate the effectiveness, we evaluate MoLo on five standard benchmarks, and the results show that MoLo favorably outperforms recent advanced methods. The source code is available at https://github. com/alibaba-mmai-research/MoLo.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2304.00946")
get_code_for_paper("2304.00946")
have("2304.00946")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2304.00946.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2304.00946)
Connect an agent — have() is free.