SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2410.16038 · 2024

Benchmarking Pathology Foundation Models: Adaptation Strategies and Scenarios

arXiv · PDF · Open in the Atlas

Code that ran

11 of 15 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 4 honoured the contract we drafted, 0 violated it and 0 have no contract verdict; 7 failures of our instrument; 4 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2410.16038.json · badge: /api/ran/2410.16038.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
quiil/benchmarkingpathologyfoundationmodels canonical (classifier label)
classifier basis: census
11 ran · 4 no recorded run
FunctionStatusWhere it lives
compute_num_query Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
quiil/benchmarkingpathologyfoundationmodels/fewshot_lib/sampler.py
pointer only (licence: NONE) · get_code("8c0b3170f408a736")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

decode_feat_dic Ran
ran; our contract draft was wrong, not the code
quiil/benchmarkingpathologyfoundationmodels/fewshot_lib/pipeline.py
pointer only (licence: NONE) · get_code("3483e7a0c8e301d3")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_total_images_per_class Ran
ran, honoured the contract we drafted
quiil/benchmarkingpathologyfoundationmodels/fewshot_lib/dataspec.py
pointer only (licence: NONE) · get_code("3caaf54905853f3c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

make_example Ran
ran; our contract draft was wrong, not the code
quiil/benchmarkingpathologyfoundationmodels/create_records.py
pointer only (licence: NONE) · get_code("89dbf27840cb4de5")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

pil_loader Ran
ran, honoured the contract we drafted
quiil/benchmarkingpathologyfoundationmodels/data_lib/dataloader.py
pointer only (licence: NONE); the stored copy get_code serves, from zhentingwang/diagnosis, is pointer only (licence: NONE) · get_code("f6be833ba409926f")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

prepare_breast_bach_data Ran
ran; our contract draft was wrong, not the code
quiil/benchmarkingpathologyfoundationmodels/data_lib/datalist.py
pointer only (licence: NONE) · get_code("95bcf00d83279fc1")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

prepare_breast_pcam_data Ran
ran; our contract draft was wrong, not the code
quiil/benchmarkingpathologyfoundationmodels/data_lib/datalist.py
pointer only (licence: NONE) · get_code("5f9ac6422877f315")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

sample_class_ids_uniformly Ran
ran; our contract draft was wrong, not the code
quiil/benchmarkingpathologyfoundationmodels/fewshot_lib/sampler.py
pointer only (licence: NONE) · get_code("0996d1bd5f1e8161")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

sample_num_ways_uniformly Ran
ran, honoured the contract we drafted
quiil/benchmarkingpathologyfoundationmodels/fewshot_lib/sampler.py
pointer only (licence: NONE) · get_code("e37c004be181ceb9")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

translate_x_rel Ran
ran; our contract draft was wrong, not the code
quiil/benchmarkingpathologyfoundationmodels/data_lib/RandAugment.py
pointer only (licence: NONE); the stored copy get_code serves, from tongzixin716716/Inverse-Loss-Reweighting, is pointer only (licence: NONE) · get_code("a4b471197204b414")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

write_tfrecord_from_image_files Ran
ran, honoured the contract we drafted
quiil/benchmarkingpathologyfoundationmodels/create_records.py
pointer only (licence: NONE) · get_code("00921c7ebc20690b")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

print_number_of_sample Not yet run
unverified (harvested, no recorded run)
quiil/benchmarkingpathologyfoundationmodels/data_lib/datalist.py
pointer only (licence: NONE) · get_code("f8aa8a413156d734")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

shear_x Not yet run
unverified (harvested, no recorded run)
quiil/benchmarkingpathologyfoundationmodels/data_lib/RandAugment.py
pointer only (licence: NONE); the stored copy get_code serves, from tongzixin716716/Inverse-Loss-Reweighting, is pointer only (licence: NONE) · get_code("7b4e3d0bd192b677")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

shear_y Not yet run
unverified (harvested, no recorded run)
quiil/benchmarkingpathologyfoundationmodels/data_lib/RandAugment.py
pointer only (licence: NONE); the stored copy get_code serves, from tongzixin716716/Inverse-Loss-Reweighting, is pointer only (licence: NONE) · get_code("e31c4b500a240e69")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

write_tfrecord_from_directory Not yet run
unverified (harvested, no recorded run)
quiil/benchmarkingpathologyfoundationmodels/create_records.py
pointer only (licence: NONE) · get_code("1f55b7ee23028a91")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, quiil/benchmarkingpathologyfoundationmodels when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 15 samples lifted from this paper's linked repositories, 15 carry a function identity and 0 do not. Of the 15 distinct functions with an identity, 5 are also present in other papers whose code we hold (5 with at least one paper dated earlier, 0 the same month, 4 later) and 10 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
shear_x 27 other papers
25 dated earlier, 2 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 24 more not named here
shear_y 27 other papers
25 dated earlier, 2 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 24 more not named here
translate_x_rel 26 other papers
24 dated earlier, 2 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 23 more not named here
pil_loader 11 other papers
10 dated earlier, 1 later
1502.03044 (2015-02)
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
2111.15667 (2021-11)
Adaptive Token Sampling For Efficient Vision Transformers
2206.02967 (2022-06)
Masked Unsupervised Self-training for Label-free Image Classification
and 8 more not named here
get_total_images_per_class 1 other paper
1 dated earlier
2403.08477 (2024-03)
Unleashing the Power of Meta-tuning for Few-shot Generalization Through Sparse Interpolated Experts

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In computational pathology, several foundation models have recently emerged and demonstrated enhanced learning capability for analyzing pathology images. However, adapting these models to various downstream tasks remains challenging, particularly when faced with datasets from different sources and acquisition conditions, as well as limited data availability. In this study, we benchmark four pathology-specific foundation models across 14 datasets and two scenarios-consistency assessment and flexibility assessment-addressing diverse adaptation scenarios and downstream tasks. In the consistency assessment scenario, involving five fine-tuning methods, we found that the parameter-efficient fine-tuning approach was both efficient and effective for adapting pathology-specific foundation models to diverse datasets within the same downstream task. In the flexibility assessment scenario under data-limited environments, utilizing five few-shot learning methods, we observed that the foundation models benefited more from the few-shot learning methods that involve modification during the testing phase only. These findings provide insights that could guide the deployment of pathology-specific foundation models in real clinical settings, potentially improving the accuracy and reliability of pathology image analysis. The code for this study is available at: https://github.com/QuIIL/BenchmarkingPathologyFoundationModels.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2410.16038")
get_code_for_paper("2410.16038")
have("2410.16038")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2410.16038.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2410.16038.svg)](https://syntology.ai/paper/2410.16038)

Connect an agent — have() is free.