SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2003.10286 · 2020

PathVQA: 30000+ Questions for Medical Visual Question Answering

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
KaveeshaSIlva/PathVQA reimplementation 4 of 4
FunctionStatusWhere it lives
answer_filter Ran KaveeshaSIlva/PathVQA/baselines/method2/dataset.py
pointer only (licence: NONE) · get_code("cf2efa825f4afaf0")
convert_sents_to_features Ran KaveeshaSIlva/PathVQA/baselines/method1/src/lxrt/entry.py
pointer only (licence: NONE) · get_code("5961b5a00aea8ba7")
is_ans_valid Ran KaveeshaSIlva/PathVQA/baselines/method2/dataset.py
pointer only (licence: NONE) · get_code("1b70f5e68e66f70c")
is_howmany Ran KaveeshaSIlva/PathVQA/baselines/method2/dataset.py
pointer only (licence: NONE) · get_code("ac9f54e37ab206e4")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Is it possible to develop an "AI Pathologist" to pass the board-certified examination of the American Board of Pathology? To achieve this goal, the first step is to create a visual question answering (VQA) dataset where the AI agent is presented with a pathology image together with a question and is asked to give the correct answer. Our work makes the first attempt to build such a dataset. Different from creating general-domain VQA datasets where the images are widely accessible and there are many crowdsourcing workers available and capable of generating question-answer pairs, developing a medical VQA dataset is much more challenging. First, due to privacy concerns, pathology images are usually not publicly available. Second, only well-trained pathologists can understand pathology images, but they barely have time to help create datasets for AI research. To address these challenges, we resort to pathology textbooks and online digital libraries. We develop a semi-automated pipeline to extract pathology images and captions from textbooks and generate question-answer pairs from captions using natural language processing. We collect 32,799 open-ended questions from 4,998 pathology images where each question is manually checked to ensure correctness. To our best knowledge, this is the first dataset for pathology VQA. Our dataset will be released publicly to promote research in medical VQA.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2003.10286")
get_code_for_paper("2003.10286")
have("2003.10286")

Connect an agent — have() is free.