Hakan Bilen, Basura Fernando, Arushi Goel, Frank Keller
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In this paper, we study multimodal coreference resolution, specifically where a longer descriptive text, i.e., a narration is paired with an image. This poses significant challenges due to fine-grained image-text alignment, inherent ambiguity present in narrative language, and unavailability of large annotated training sets. To tackle these challenges, we present a data efficient semi-supervised approach that utilizes image-narration pairs to resolve coreferences and narrative grounding in a multimodal context. Our approach incorporates losses for both labeled and unlabeled data within a crossmodal framework. Our evaluation shows that the proposed approach outperforms strong baselines both quantitatively and qualitatively, for the tasks of coreference resolution and narrative grounding.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2310.13619")
get_code_for_paper("2310.13619")
have("2310.13619")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2310.13619.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2310.13619)
Connect an agent — have() is free.