SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2010.06000 · EMNLP Findings · 2020

MedICaT: A Dataset of Medical Images, Captions, and Textual References

Sachin Mehta, Hannaneh Hajishirzi, Sameer Singh, Ben Bogin, Matt Gardner, Sanjay Subramanian, Lucy Wang, Madeleine Van Zuylen, Sravanthi Parasa

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Understanding the relationship between figures and text is key to scientific document understanding. Medical figures in particular are quite complex, often consisting of several subfigures (75% of figures in our dataset), with detailed text describing their content. Previous work studying figures in scientific papers focused on classifying figure content rather than understanding how images relate to the text. To address challenges in figure retrieval and figure-to-text alignment, we introduce MED-ICAT, a dataset of medical images in context. MEDICAT consists of 217K images from 131K open access biomedical papers, and includes captions, inline references for 74% of figures, and manually annotated subfigures and subcaptions for a subset of figures. Using MEDICAT, we introduce the task of subfigure to subcaption alignment in compound figures and demonstrate the utility of inline references in image-text matching. Our data and code can be accessed at https://github.com/allenai/medicat.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2010.06000")
get_code_for_paper("2010.06000")
have("2010.06000")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2010.06000.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2010.06000.svg)](https://syntology.ai/paper/2010.06000)

Connect an agent — have() is free.