SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2005.00687 · 2020

Open Graph Benchmark: Datasets for Machine Learning on Graphs

Michael Bronstein, Yoshua Bengio, Matthias Fey, Regina Barzilay, Tommi Jaakkola, Hongyu Ren, Weihua Hu, Jure Leskovec, Peter Battaglia, Stephan Günnemann, Yuxiao Dong, Marinka Zitnik, and 4 more

arXiv · PDF · Open in the Atlas

Code that ran

12 of 17 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 0 honoured the contract we drafted, 0 violated it and 9 have no contract verdict; 3 failures of our instrument; 5 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2005.00687.json · badge: /api/ran/2005.00687.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
anonymous20221001/sieg_ogb community (classifier label)
classifier basis not recorded on the link
11 ran · 2 no recorded run
jingsonglv/CFG community (classifier label)
classifier basis not recorded on the link
1 ran · 1 no recorded run
destwang/InterHT community (classifier label)
classifier basis not recorded on the link
0 ran · 2 no recorded run
FunctionStatusWhere it lives
drnl_node_labeling Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
anonymous20221001/sieg_ogb/ngnn_utils.py
pointer only (licence: MIT) · get_code("d1a0846503b56bd7")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

drnl_node_labeling Ran
ran on a synthesized input
jingsonglv/CFG/wp_utils.py
pointer only (licence: MIT) · get_code("a81a597c36c92dc0")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, jingsonglv/CFG, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

enclose_index Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/utils.py
pointer only (licence: MIT) · get_code("2518c094ff98f96c")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

floor Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/wp_utils.py
pointer only (licence: MIT) · get_code("c18e1c9d4ef4e57c")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

k_hop_subgraph Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/ngnn_utils.py
pointer only (licence: MIT) · get_code("d6eab7a81b327efe")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

k_hop_subgraph Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/wp_utils.py
pointer only (licence: MIT) · get_code("770b5cbf6561c96c")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

neighbors Ran
ran; our contract draft was wrong, not the code
anonymous20221001/sieg_ogb/utils.py
pointer only (licence: MIT); the stored copy get_code serves, from arianemarandon/linkpredconf, is pointer only (licence: NONE) · get_code("fe208db98a8e47fb")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

pad_1d_unsqueeze Ran
ran; our contract draft was wrong, not the code
anonymous20221001/sieg_ogb/graphormer/collator.py
pointer only (licence: MIT); the stored copy get_code serves, from Graph-and-Geometric-Learning/MolGroup, is pointer only (licence: NONE) · get_code("ed9c8a17fdb3d49c")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

pad_2d_unsqueeze Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/graphormer/collator.py
pointer only (licence: MIT) · get_code("f09b8946bf7c5474")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

pad_attn_bias_unsqueeze Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/graphormer/collator.py
pointer only (licence: MIT); the stored copy get_code serves, from ytchx1999/Graphormer, is pointer only (licence: MIT) · get_code("b5df9592a75e3bb9")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

sample_neg Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/seal18_utils.py
pointer only (licence: MIT) · get_code("5b8467a71c8cbd27")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

split_edges Ran
ran on a synthesized input
anonymous20221001/sieg_ogb/wp_utils.py
pointer only (licence: MIT) · get_code("259bcb25965c6298")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

abstract_pair_data Not yet run
unverified (harvested, no recorded run)
anonymous20221001/sieg_ogb/models.py
pointer only (licence: MIT) · get_code("03e4d4cd729f24a0")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

global_uniform_negative_sampling Not yet run
unverified (harvested, no recorded run)
jingsonglv/CFG/negative.py
pointer only (licence: MIT) · get_code("3aad0d6c07efc2a6")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, jingsonglv/CFG, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

parse_args Not yet run
unverified (harvested, no recorded run)
destwang/InterHT/run_ogb.py
code served (permissive licence) · get_code("4f32f9316fe7d295")
How it ran

no invocation recorded.

parse_args Not yet run
unverified (harvested, no recorded run)
destwang/InterHT/run_ogb_plus.py
code served (permissive licence) · get_code("1323ce13cc1cef4a")
How it ran

no invocation recorded.

seal18_prepare_data Not yet run
unverified (harvested, no recorded run)
anonymous20221001/sieg_ogb/seal18_utils.py
pointer only (licence: MIT) · get_code("758c1447ce5630ea")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, anonymous20221001/sieg_ogb, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 17 samples lifted from this paper's linked repositories, 17 carry a function identity and 0 do not. Of the 17 distinct functions with an identity, 5 are also present in other papers whose code we hold (0 with at least one paper dated earlier, 0 the same month, 5 later) and 12 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
neighbors 2 other papers
2 later
2010.16103 (2020-10)
Labeling Trick: A Theory of Using Graph Neural Networks for Multi-Node Representation Learning
2306.14693 (2023-06)
Conformal link prediction for false discovery rate control
pad_1d_unsqueeze 2 other papers
2 later
2106.08279 (2021-06)
First Place Solution of KDD Cup 2021 & OGB Large-Scale Challenge Graph Prediction Track
2307.04052 (2023-07)
Learning to Group Auxiliary Datasets for Molecule
drnl_node_labeling 1 other paper
1 later
2106.06935 (2021-06)
Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Prediction
pad_attn_bias_unsqueeze 1 other paper
1 later
2106.08279 (2021-06)
First Place Solution of KDD Cup 2021 & OGB Large-Scale Challenge Graph Prediction Track
parse_args 1 other paper
1 later
2022.findings-emnlp.86 (2022 (year only))
TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation Representation

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We present the OPEN GRAPH BENCHMARK (OGB), a diverse set of challenging and realistic benchmark datasets to facilitate scalable, robust, and reproducible graph machine learning (ML) research. OGB datasets are large-scale, encompass multiple important graph ML tasks, and cover a diverse range of domains, ranging from social and information networks to biological networks, molecular graphs, source code ASTs, and knowledge graphs. For each dataset, we provide a unified evaluation protocol using meaningful application-specific data splits and evaluation metrics. In addition to building the datasets, we also perform extensive benchmark experiments for each dataset. Our experiments suggest that OGB datasets present significant challenges of scalability to large-scale graphs and out-of-distribution generalization under realistic data splits, indicating fruitful opportunities for future research. Finally, OGB provides an automated end-to-end graph ML pipeline that simplifies and standardizes the process of graph data loading, experimental setup, and model evaluation. OGB will be regularly updated and welcomes inputs from the community. OGB datasets as well as data loaders, evaluation scripts, baseline code, and leaderboards are publicly available at https://ogb.stanford.edu.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2005.00687")
get_code_for_paper("2005.00687")
have("2005.00687")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2005.00687.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2005.00687.svg)](https://syntology.ai/paper/2005.00687)

Connect an agent — have() is free.