Sandro Pezzelle, Raquel Fernández, Aditya Surikuchi
We lifted 3 functions out of this paper's own repositories and ran 2 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| akskuchi/groovist | canonical | 2 of 3 |
| Function | Status | Where it lives |
|---|---|---|
| get_image_ids | Ran | akskuchi/groovist/utils.py pointer only (licence: NONE) · get_code("25d418a0168d4ac7") |
| get_max_alignment_scores | Ran | akskuchi/groovist/utils.py pointer only (licence: NONE) · get_code("8d8605fe096f3eaf") |
| get_concreteness_ratings | Not yet run | akskuchi/groovist/utils.py pointer only (licence: NONE) · get_code("d167d86aa785dd4d") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
A proper evaluation of stories generated for a sequence of images-the task commonly referred to as visual storytelling-must consider multiple aspects, such as coherence, grammatical correctness, and visual grounding. In this work, we focus on evaluating the degree of grounding, that is, the extent to which a story is about the entities shown in the images. We analyze current metrics, both designed for this purpose and for general vision-text alignment. Given their observed shortcomings, we propose a novel evaluation tool, GROOViST, that accounts for cross-modal dependencies, temporal misalignments (the fact that the order in which entities appear in the story and the image sequence may not match), and human intuitions on visual grounding. An additional advantage of GROOViST is its modular design, where the contribution of each component can be assessed and interpreted individually.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2310.17770")
get_code_for_paper("2310.17770")
have("2310.17770")
Connect an agent — have() is free.