SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2305.17100 · 2023

BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 8 functions out of this paper's own repositories and ran 1 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
taokz/biomedgpt canonical 1 of 8
FunctionStatusWhere it lives
apply_half Ran taokz/biomedgpt/evaluate.py
code served (permissive licence) · get_code("357d3a4f0be679d9")
construct_rdrop_sample Not yet run taokz/biomedgpt/criterions/label_smoothed_encouraging_loss.py
pointer only (licence: Apache-2.0) · get_code("e1397e09cb4c249d")
custom_to_pil Not yet run taokz/biomedgpt/criterions/clip_scst_loss.py
pointer only (licence: Apache-2.0) · get_code("01478032e19f9e68")
kl_loss Not yet run taokz/biomedgpt/criterions/label_smoothed_encouraging_loss.py
pointer only (licence: Apache-2.0) · get_code("e7939f8552fd8729")
label_smoothed_nll_loss Not yet run taokz/biomedgpt/criterions/label_smoothed_encouraging_loss.py
pointer only (licence: Apache-2.0) · get_code("cbd8615e3eba731b")
label_smoothed_nll_loss Not yet run taokz/biomedgpt/criterions/label_smoothed_cross_entropy.py
pointer only (licence: Apache-2.0) · get_code("cdbc222d0057fb31")
load Not yet run taokz/biomedgpt/models/clip/clip.py
pointer only (licence: Apache-2.0) · get_code("db64af1ba3479e8d")
scst_loss Not yet run taokz/biomedgpt/criterions/clip_scst_loss.py
pointer only (licence: Apache-2.0) · get_code("b0d5d75f27b8ce4f")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Traditional biomedical artificial intelligence (AI) models, designed for specific tasks or modalities, often exhibit limited flexibility in real-world deployment and struggle to utilize holistic information. Generalist AI holds the potential to address these limitations due to its versatility in interpreting different data types and generating tailored outputs for diverse needs. However, existing biomedical generalist AI solutions are typically heavyweight and closed source to researchers, practitioners, and patients. Here, we propose BiomedGPT, the first open-source and lightweight vision-language foundation model, designed as a generalist capable of performing various biomedical tasks. BiomedGPT achieved state-of-the-art results in 16 out of 25 experiments while maintaining a computing-friendly model scale. We also conducted human evaluations to assess the capabilities of BiomedGPT in radiology visual question answering, report generation, and summarization. BiomedGPT exhibits robust prediction ability with a low error rate of 3.8% in question answering, satisfactory performance with an error rate of 8.3% in writing complex radiology reports, and competitive summarization ability with a nearly equivalent preference score to human experts. Our method demonstrates that effective training with diverse data can lead to more practical biomedical AI for improving diagnosis and workflow efficiency.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2305.17100")
get_code_for_paper("2305.17100")
have("2305.17100")

Connect an agent — have() is free.