We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Popular metrics used for evaluating image captioning systems, such as BLEU and CIDEr, provide a single score to gauge the system's overall effectiveness. This score is often not informative enough to indicate what specific errors are made by a given system. In this study, we present a fine-grained evaluation method REO for automatically measuring the performance of image captioning systems. REO assesses the quality of captions from three perspectives: 1) Relevance to the ground truth, 2) Extraness of the content that is irrelevant to the ground truth, and 3) Omission of the elements in the images and human references. Experiments on three benchmark datasets demonstrate that our method achieves a higher consistency with human judgments and provides more intuitive evaluation results than alternative metrics.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1909.02217")
get_code_for_paper("1909.02217")
have("1909.02217")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1909.02217.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1909.02217)
Connect an agent — have() is free.