SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2201.05078 · CVPR · 2022

CLIP-Event: Connecting Text and Images with Event Structures

Chenguang Zhu, Michael Zeng, Shuohang Wang, Luowei Zhou, Heng Ji, Xudong Lin, Shih-Fu Chang, Manling Li, Ruochen Xu

arXiv · PDF · Open in the Atlas

Code that ran

3 of 4 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 0 honoured the contract we drafted, 0 violated it and 0 have no contract verdict; 3 failures of our instrument; 1 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2201.05078.json · badge: /api/ran/2201.05078.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
limanling/clip-event marked official in Papers with Code
Papers with Code archive
3 ran · 1 no recorded run
FunctionStatusWhere it lives
cost_matrix_cosine Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
limanling/clip-event/src/clip-event/model_ot.py
pointer only (licence: NONE) · get_code("9c9d2823696faa43")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, limanling/clip-event when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

optimal_transport_dist Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
limanling/clip-event/src/clip-event/model_ot.py
pointer only (licence: NONE) · get_code("4c0a5849eef55a00")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, limanling/clip-event when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

trace Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
limanling/clip-event/src/clip-event/model_ot.py
pointer only (licence: NONE) · get_code("11728587f6b887ba")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, limanling/clip-event when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

ipot Not yet run
unverified (harvested, no recorded run)
limanling/clip-event/src/clip-event/model_ot.py
pointer only (licence: NONE) · get_code("cbf43203110456f0")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, limanling/clip-event when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 4 samples lifted from this paper's linked repositories, 4 carry a function identity and 0 do not. Of the 4 distinct functions with an identity, 2 are also present in other papers whose code we hold (2 with at least one paper dated earlier, 0 the same month, 0 later) and 2 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
cost_matrix_cosine
brick of this paper's assembly: helper
2 other papers
2 dated earlier · 1 only as an assembly brick
2004.06165 (2020-04)
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
2006.06195 (2020-06)
Large-Scale Adversarial Training for Vision-and-Language Representation Learning
ipot
brick of this paper's assembly: helper
2 other papers
2 dated earlier · 1 only as an assembly brick
2004.06165 (2020-04)
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
2006.06195 (2020-06)
Large-Scale Adversarial Training for Vision-and-Language Representation Learning

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Vision-language (V+L) pretraining models have achieved great success in supporting multimedia applications by understanding the alignments between images and text. While existing vision-language pretraining models primarily focus on understanding objects in images or entities in text, they often ignore the alignment at the level of events and their argument structures. In this work, we propose a contrastive learning framework to enforce vision-language pretraining models to comprehend events and associated argument (participant) roles. To achieve this, we take advantage of text information extraction technologies to obtain event structural knowledge, and utilize multiple prompt functions to contrast difficult negative descriptions by manipulating event structures. We also design an event graph alignment loss based on optimal transport to capture event argument structures. In addition, we collect a large event-rich dataset (106,875 images) for pretraining, which provides a more challenging image retrieval benchmark to assess the understanding of complicated lengthy sentences 1 . Experiments show that our zero-shot CLIP-Event outperforms the state-of-the-art supervised model in argument extraction on Multimedia Event Extraction, achieving more than 5% absolute F-score gain in event extraction, as well as significant improvements on a variety of downstream tasks under zero-shot settings.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2201.05078")
get_code_for_paper("2201.05078")
have("2201.05078")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2201.05078.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2201.05078.svg)](https://syntology.ai/paper/2201.05078)

Connect an agent — have() is free.