SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2406.12384 · 2024

VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding

arXiv · PDF · Open in the Atlas

Code that ran

11 of 13 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 0 honoured the contract we drafted, 2 violated it and 0 have no contract verdict; 9 failures of our instrument; 2 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2406.12384.json · badge: /api/ran/2406.12384.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
lavender105/rsgpt canonical (classifier label)
classifier basis not recorded on the link
7 ran · 2 no recorded run
lx709/vrsbench canonical (classifier label)
classifier basis: census
4 ran · 0 no recorded run
FunctionStatusWhere it lives
apply_rotary_pos_emb Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
lavender105/rsgpt/rsgpt/models/modeling_llama.py
pointer only (licence: NONE) · get_code("9b4dff79d5e6102c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

box_close Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
lx709/vrsbench/extract_patch_json.py
pointer only (licence: NONE) · get_code("1d21cbb7073a7927")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lx709/vrsbench when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

computeIoU Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
lx709/vrsbench/eval_fianl/eval_utils.py
pointer only (licence: NONE) · get_code("4e38f9c809377d07")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lx709/vrsbench when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

disabled_train Ran
ran, violated the contract we drafted
lavender105/rsgpt/rsgpt/models/blip2.py
pointer only (licence: NONE) · get_code("4cb732f513d69dfd")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

getAttMap Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
lavender105/rsgpt/rsgpt/common/gradcam.py
pointer only (licence: NONE) · get_code("7d214655954e2bc6")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_size_from_points Ran
ran, violated the contract we drafted
lx709/vrsbench/extract_patch_json.py
pointer only (licence: NONE) · get_code("978557bbaf2eb146")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lx709/vrsbench when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

main_process Ran
ran; our contract draft was wrong, not the code
lavender105/rsgpt/rsgpt/common/dist_utils.py
pointer only (licence: NONE) · get_code("98589643273920ba")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

node_to_dict Ran
ran; our contract draft was wrong, not the code
lavender105/rsgpt/rsgpt/common/config.py
pointer only (licence: NONE) · get_code("791c72070c0b1cfb")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

read_file Ran
ran; our contract draft was wrong, not the code
lx709/vrsbench/extract_patch_json.py
pointer only (licence: NONE) · get_code("990ff33e4c206334")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lx709/vrsbench when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

rotate_half Ran
ran; our contract draft was wrong, not the code
lavender105/rsgpt/rsgpt/models/modeling_llama.py
pointer only (licence: NONE) · get_code("b99eea6376d1e212")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

tile Ran
ran; our contract draft was wrong, not the code
lavender105/rsgpt/rsgpt/models/base_model.py
pointer only (licence: NONE); the stored copy get_code serves, from MengzhouLu/RetroMPA, is pointer only (licence: NONE) · get_code("cb33571427334815")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

all_gather_with_grad Not yet run
unverified (harvested, no recorded run)
lavender105/rsgpt/rsgpt/models/base_model.py
pointer only (licence: NONE) · get_code("0ec9fc2025c16f65")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

download_cached_file Not yet run
unverified (harvested, no recorded run)
lavender105/rsgpt/rsgpt/common/dist_utils.py
pointer only (licence: NONE) · get_code("643539116e049080")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, lavender105/rsgpt when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 13 samples lifted from this paper's linked repositories, 13 carry a function identity and 0 do not. Of the 13 distinct functions with an identity, 10 are also present in other papers whose code we hold (9 with at least one paper dated earlier, 5 the same month, 10 later) and 3 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
rotate_half 360 other papers
135 dated earlier, 21 the same month, 195 later, 6 same year, order not determinable, 3 undated · 30 only as an assembly brick
1901.02860 (2019-01)
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
2203.08913 (2022-03)
Memorizing Transformers
2302.13971 (2023-02)
LLaMA: Open and Efficient Foundation Language Models
and 357 more not named here
disabled_train 173 other papers
117 dated earlier, 9 the same month, 39 later, 8 same year, order not determinable · 5 only as an assembly brick
2012.09841 (2020-12)
Taming Transformers for High-Resolution Image Synthesis
2102.05379 (2021-02)
Argmax Flows and Multinomial Diffusion: Learning Categorical Distributions
2104.07652 (2021-04)
Geometry-Free View Synthesis: Transformers and no 3D Priors
and 170 more not named here
all_gather_with_grad 91 other papers
64 dated earlier, 3 the same month, 20 later, 4 same year, order not determinable · 2 only as an assembly brick
2206.02967 (2022-06)
Masked Unsupervised Self-training for Label-free Image Classification
2210.08773 (2022-10)
Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Training
2302.06605 (2023-02)
UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling
and 88 more not named here
tile 84 other papers
62 dated earlier, 3 the same month, 14 later, 5 same year, order not determinable
2206.07699 (2022-06)
Write and Paint: Generative Vision-Language Models are Unified Modal Learners
2210.07795 (2022-10)
EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning
2210.08773 (2022-10)
Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Training
and 81 more not named here
apply_rotary_pos_emb 47 other papers
36 dated earlier, 2 the same month, 6 later, 3 same year, order not determinable
2305.14167 (2023-05)
DetGPT: Detect What You Need via Reasoning
2305.16103 (2023-05)
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
2305.16355 (2023-05)
PandaGPT: One Model To Instruction-Follow Them All
and 44 more not named here
node_to_dict 39 other papers
28 dated earlier, 9 later, 2 same year, order not determinable
2305.04160 (2023-05)
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
2305.14167 (2023-05)
DetGPT: Detect What You Need via Reasoning
2305.16103 (2023-05)
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
and 36 more not named here
download_cached_file 37 other papers
27 dated earlier, 8 later, 2 same year, order not determinable
2305.04160 (2023-05)
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
2305.14167 (2023-05)
DetGPT: Detect What You Need via Reasoning
2305.16103 (2023-05)
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
and 34 more not named here
main_process 35 other papers
25 dated earlier, 8 later, 2 same year, order not determinable
2305.04160 (2023-05)
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
2305.14167 (2023-05)
DetGPT: Detect What You Need via Reasoning
2305.16103 (2023-05)
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
and 32 more not named here
getAttMap 28 other papers
20 dated earlier, 6 later, 2 same year, order not determinable
2305.04160 (2023-05)
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
2305.07558 (2023-05)
Measuring Progress in Fine-grained Vision-and-Language Understanding
2305.16103 (2023-05)
ChatBridge: Bridging Modalities with Large Language Model as a Language Catalyst
and 25 more not named here
read_file 1 other paper
1 later
2025.acl-long.562 (2025 (year only))
PwnGPT: Automatic Exploit Generation Based on Large Language Models

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We introduce a new benchmark designed to advance the development of general-purpose, large-scale vision-language models for remote sensing images. Although several vision-language datasets in remote sensing have been proposed to pursue this goal, existing datasets are typically tailored to single tasks, lack detailed object information, or suffer from inadequate quality control. Exploring these improvement opportunities, we present a Versatile vision-language Benchmark for Remote Sensing image understanding, termed VRSBench. This benchmark comprises 29,614 images, with 29,614 human-verified detailed captions, 52,472 object references, and 123,221 question-answer pairs. It facilitates the training and evaluation of vision-language models across a broad spectrum of remote sensing image understanding tasks. We further evaluated state-of-the-art models on this benchmark for three vision-language tasks: image captioning, visual grounding, and visual question answering. Our work aims to significantly contribute to the development of advanced vision-language models in the field of remote sensing. The data and code can be accessed at https://github.com/lx709/VRSBench.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2406.12384")
get_code_for_paper("2406.12384")
have("2406.12384")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2406.12384.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2406.12384.svg)](https://syntology.ai/paper/2406.12384)

Connect an agent — have() is free.