SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2109.14084 · EMNLP · 2021

VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding

Luke Zettlemoyer, Po-Yao Huang, Florian Metze, Dmytro Okhonko, Armen Aghajanyan, Hu Xu, Christoph Feichtenhofer, Gargi Ghosh

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We present VideoCLIP, a contrastive approach to pre-train a unified model for zeroshot video and text understanding, without using any labels on downstream tasks. VideoCLIP trains a transformer for video and text by contrasting temporally overlapping positive video-text pairs with hard negatives from nearest neighbor retrieval. Our experiments on a diverse series of downstream tasks, including sequence-level text-video retrieval, VideoQA, token-level action localization, and action segmentation reveal state-ofthe-art performance, surpassing prior work, and in some cases even outperforming supervised approaches. Code is made available at https://github.com/pytorch/ fairseq/tree/main/examples/MMPT.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2109.14084")
get_code_for_paper("2109.14084")
have("2109.14084")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2109.14084.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2109.14084.svg)](https://syntology.ai/paper/2109.14084)

Connect an agent — have() is free.