U Berkeley, Korea, Jonghyun Choi, Dongyeop Kang, Daechul Ahn, Jinwoo Nam, Seong Ha, South Gist
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Understanding videos to localize moments with natural language often requires large expensive annotated video regions paired with language queries. To eliminate the annotation costs, we make a first attempt to train a natural language video localization model in zero-shot manner. Inspired by unsupervised image captioning setup, we merely require random text corpora, unlabeled video collections, and an off-the-shelf object detector to train a model. With the unpaired data, we propose to generate pseudosupervision of candidate temporal regions and corresponding query sentences, and develop a simple NLVL model to train with the pseudo-supervision. Our empirical validations show that the proposed pseudo-supervised method outperforms several baseline approaches and a number of methods using stronger supervision on Charades-STA and ActivityNet-Captions.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2110.00428")
get_code_for_paper("2110.00428")
have("2110.00428")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2110.00428.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2110.00428)
Connect an agent — have() is free.