Cees Snoek, Hazel Doughty
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We aim to understand how actions are performed and identify subtle differences, such as 'fold firmly' vs. 'fold gently'. To this end, we propose a method which recognizes adverbs across different actions. However, such finegrained annotations are difficult to obtain and their longtailed nature makes it challenging to recognize adverbs in rare action-adverb compositions. Our approach therefore uses semi-supervised learning with multiple adverb pseudolabels to leverage videos with only action labels. Combined with adaptive thresholding of these pseudo-adverbs we are able to make efficient use of the available data while tackling the long-tailed distribution. Additionally, we gather adverb annotations for three existing video retrieval datasets, which allows us to introduce the new tasks of recognizing adverbs in unseen action-adverb compositions and unseen domains. Experiments demonstrate the effectiveness of our method, which outperforms prior work in recognizing adverbs and semi-supervised works adapted for adverb recognition. We also show how adverbs can relate fine-grained actions.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2203.12344")
get_code_for_paper("2203.12344")
have("2203.12344")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2203.12344.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2203.12344)
Connect an agent — have() is free.