Joan Bruna, Tom Tirer, Vignesh Kothapalli
We lifted 7 functions out of this paper's own repositories and ran 1 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| kvignesh1420/gnn_collapse | canonical | 1 of 7 |
| Function | Status | Where it lives |
|---|---|---|
| count_parameters | Ran | kvignesh1420/gnn_collapse/gnn_collapse/train/online.py code served (permissive licence) · get_code("f6b944f50d3f15ae") |
| compute_ce_loss_multiclass | Not yet run | kvignesh1420/gnn_collapse/gnn_collapse/utils/losses.py code served (permissive licence) · get_code("c710048f60b7c37e") |
| compute_loss_multiclass | Not yet run | kvignesh1420/gnn_collapse/gnn_collapse/utils/losses.py code served (permissive licence) · get_code("d6d60ec6a591b434") |
| loss_func | Not yet run | kvignesh1420/gnn_collapse/gufm.py code served (permissive licence) · get_code("16d68f9aa5f47c6b") |
| nc_helper | Not yet run | kvignesh1420/gnn_collapse/gufm.py code served (permissive licence) · get_code("922fe3132cabc303") |
| permuteposs | Not yet run | kvignesh1420/gnn_collapse/gnn_collapse/utils/losses.py code served (permissive licence) · get_code("4324228a09d8b6d9") |
| prepare_config_hash | Not yet run | kvignesh1420/gnn_collapse/gufm.py code served (permissive licence) · get_code("96ba8b109f40eb6a") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Graph neural networks (GNNs) have become increasingly popular for classification tasks on graph-structured data. Yet, the interplay between graph topology and feature evolution in GNNs is not well understood. In this paper, we focus on nodewise classification, illustrated with community detection on stochastic block model graphs, and explore the feature evolution through the lens of the "Neural Collapse" (NC) phenomenon. When training instance-wise deep classifiers (e.g. for image classification) beyond the zero training error point, NC demonstrates a reduction in the deepest features' within-class variability and an increased alignment of their class means to certain symmetric structures. We start with an empirical study that shows that a decrease in within-class variability is also prevalent in the node-wise classification setting, however, not to the extent observed in the instance-wise case. Then, we theoretically study this distinction. Specifically, we show that even an "optimistic" mathematical model requires that the graphs obey a strict structural condition in order to possess a minimizer with exact collapse. Interestingly, this condition is viable also for heterophilic graphs and relates to recent empirical studies on settings with improved GNNs' generalization. Furthermore, by studying the gradient dynamics of the theoretical model, we provide reasoning for the partial collapse observed empirically. Finally, we present a study on the evolution of within-and between-class feature variability across layers of a well-trained GNN and contrast the behavior with spectral methods.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2307.01951")
get_code_for_paper("2307.01951")
have("2307.01951")
Connect an agent — have() is free.