SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2206.09144 · NeurIPS · 2022

Beyond Real-world Benchmark Datasets: An Empirical Study of Node Classification with GNNs

Makoto Onizuka, Seiji Maekawa, Yuya Sasaki, Koki Noda

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 8 functions out of this paper's own repositories and ran 7 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
seijimaekawa/empirical-study-of-gnns canonical 7 of 8
FunctionStatusWhere it lives
dense2sparseTensor Ran seijimaekawa/empirical-study-of-gnns/models/utils.py
code served (permissive licence) · get_code("30b3432cea6fd419")
get_data_dir Ran seijimaekawa/empirical-study-of-gnns/models/train_model.py
code served (permissive licence) · get_code("1188867287351db7")
index_to_mask Ran seijimaekawa/empirical-study-of-gnns/models/utils.py
code served (permissive licence) · get_code("da80a2b9fd449bd2")
normalize_string Ran seijimaekawa/empirical-study-of-gnns/models/layers.py
code served (permissive licence) · get_code("ff7d55c8c0dd7dde")
random_planetoid_splits Ran seijimaekawa/empirical-study-of-gnns/models/utils.py
code served (permissive licence) · get_code("319940b150558f96")
read_file Ran seijimaekawa/empirical-study-of-gnns/models/dataset_utils.py
code served (permissive licence) · get_code("623066b29237a22e")
swish Ran seijimaekawa/empirical-study-of-gnns/models/layers.py
code served (permissive licence) · get_code("3a4a478be185334b")
resolver Not yet run seijimaekawa/empirical-study-of-gnns/models/layers.py
code served (permissive licence) · get_code("a24b6d4b9d32db82")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Graph Neural Networks (GNNs) have achieved great success on a node classification task. Despite the broad interest in developing and evaluating GNNs, they have been assessed with limited benchmark datasets. As a result, the existing evaluation of GNNs lacks fine-grained analysis from various characteristics of graphs. Motivated by this, we conduct extensive experiments with a synthetic graph generator that can generate graphs having controlled characteristics for fine-grained analysis. Our empirical studies clarify the strengths and weaknesses of GNNs from four major characteristics of real-world graphs with class labels of nodes, i.e., 1) class size distributions (balanced vs. imbalanced), 2) edge connection proportions between classes (homophilic vs. heterophilic), 3) attribute values (biased vs. random), and 4) graph sizes (small vs. large). In addition, to foster future research on GNNs, we publicly release our codebase that allows users to evaluate various GNNs with various graphs. We hope this work offers interesting insights for future research.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2206.09144")
get_code_for_paper("2206.09144")
have("2206.09144")

Connect an agent — have() is free.