SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2405.05808 · AAAI · 2024

Fast and Controllable Post-training Sparsity: Learning Optimal Sparsity Allocation with Global Constraint in Minutes

Ruihao Gong, Xiuying Wei, Xianglong Liu, Jinyang Guo, Yuqing Ma, Zining Wang, Yang Yong

arXiv · PDF · Open in the Atlas

Code that ran

16 of 21 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 2 honoured the contract we drafted, 2 violated it and 0 have no contract verdict; 12 failures of our instrument; 5 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/2405.05808.json · badge: /api/ran/2405.05808.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
ModelTC/FCPTS canonical (classifier label)
classifier basis: census
16 ran · 5 no recorded run
FunctionStatusWhere it lives
accuracy Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
ModelTC/FCPTS/utils.py
pointer only (licence: NONE) · get_code("b0f936d4d6ae3b8c")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

build_norm_layer Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/models/mobilenet_v2.py
pointer only (licence: NONE) · get_code("c632289fded31a56")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

build_optimizer Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/train/optimizer.py
pointer only (licence: NONE) · get_code("705619bc4a3a35a8")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

build_scheduler Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/train/lr_scheduler.py
pointer only (licence: NONE); the stored copy get_code serves, from leaplabthu/inline, is pointer only (licence: NONE) · get_code("07e8b4b487c0abb6")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

check_keywords_in_name Ran
ran, violated the contract we drafted
ModelTC/FCPTS/train/optimizer.py
pointer only (licence: NONE); the stored copy get_code serves, from leaplabthu/inline, is pointer only (licence: NONE) · get_code("b0a5beb34716d5a6")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

conv1x1 Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/models/resnet.py
pointer only (licence: NONE); the stored copy get_code serves, from medaitech/scrd4ad, is pointer only (licence: NONE) · get_code("2a80220dabcb742a")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

conv3x3 Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/models/resnet.py
pointer only (licence: NONE); the stored copy get_code serves, from medaitech/scrd4ad, is pointer only (licence: NONE) · get_code("600ff2c45e0de056")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

create_logger Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/train/logger.py
pointer only (licence: NONE); the stored copy get_code serves, from ghrua/seqpe, is pointer only (licence: NONE) · get_code("80450600f7f09b0a")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

extract_block Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/get_block_node_names.py
pointer only (licence: NONE) · get_code("a4f820f669b1e450")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

extract_layer Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/get_block_node_names.py
pointer only (licence: NONE) · get_code("84d02ec15ff2aff3")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

find_num_nodes Ran
ran, honoured the contract we drafted
ModelTC/FCPTS/get_block_node_names.py
pointer only (licence: NONE) · get_code("e140f4a58da9adb4")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_resnet_cifar_func_by_name Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/models/resnet_cifar.py
pointer only (licence: NONE) · get_code("4722136a6a5bb904")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

load_checkpoint_simple Ran
ran, honoured the contract we drafted
ModelTC/FCPTS/utils.py
pointer only (licence: NONE) · get_code("5b54be7e3ef057b8")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

shear_x Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/train/randaug.py
pointer only (licence: NONE) · get_code("e866e1196986f728")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

shear_y Ran
ran; our contract draft was wrong, not the code
ModelTC/FCPTS/train/randaug.py
pointer only (licence: NONE) · get_code("7b2503c99c9447fb")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

unwrap_model Ran
ran, violated the contract we drafted
ModelTC/FCPTS/utils.py
pointer only (licence: NONE) · get_code("8ba24560996e7d76")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

get_config Not yet run
unverified (harvested, no recorded run)
ModelTC/FCPTS/train/config.py
pointer only (licence: NONE) · get_code("8720cb02339df51e")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

modify_state_dict Not yet run
unverified (harvested, no recorded run)
ModelTC/FCPTS/models/mobilenet_v2.py
pointer only (licence: NONE) · get_code("efb93a9be20060a5")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

resnet18 Not yet run
unverified (harvested, no recorded run)
ModelTC/FCPTS/models/resnet.py
pointer only (licence: NONE) · get_code("926cc8236c31bb61")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

set_weight_decay Not yet run
unverified (harvested, no recorded run)
ModelTC/FCPTS/train/optimizer.py
pointer only (licence: NONE) · get_code("284f23322c9df1e7")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

trunc_normal Not yet run
unverified (harvested, no recorded run)
ModelTC/FCPTS/models/mobilenet_v2.py
pointer only (licence: NONE) · get_code("a65695fdc3ab22ca")
How it ran

The body of this sample is withheld: GitHub detected no licence in this paper's repository, ModelTC/FCPTS when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 21 samples lifted from this paper's linked repositories, 21 carry a function identity and 0 do not. Of the 21 distinct functions with an identity, 11 are also present in other papers whose code we hold (11 with at least one paper dated earlier, 7 the same month, 11 later) and 10 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
accuracy 116 other papers
101 dated earlier, 1 the same month, 13 later, 1 same year, order not determinable · 8 only as an assembly brick
1502.03044 (2015-02)
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
1610.05820 (2016-10)
Membership Inference Attacks Against Machine Learning Models
1905.03696 (2019-05)
HAWQ: Hessian AWare Quantization of Neural Networks with Mixed-Precision
and 113 more not named here
conv1x1 112 other papers
78 dated earlier, 3 the same month, 27 later, 4 same year, order not determinable · 6 only as an assembly brick
1512.03385 (2015-12)
Deep Residual Learning for Image Recognition
1806.01531 (2018-06)
Deep Mixture of Experts via Shallow Embedding
1905.12794 (2019-05)
Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback
and 109 more not named here
conv3x3 111 other papers
78 dated earlier, 3 the same month, 26 later, 4 same year, order not determinable · 6 only as an assembly brick
1512.03385 (2015-12)
Deep Residual Learning for Image Recognition
1806.01531 (2018-06)
Deep Mixture of Experts via Shallow Embedding
1905.12794 (2019-05)
Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback
and 108 more not named here
get_config 51 other papers
31 dated earlier, 4 the same month, 12 later, 4 same year, order not determinable
2103.14030 (2021-03)
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
2106.03650 (2021-06)
Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer
2106.03746 (2021-06)
Efficient Training of Visual Transformers with Small Datasets
and 48 more not named here
resnet18 36 other papers
30 dated earlier, 5 later, 1 same year, order not determinable
1905.12794 (2019-05)
Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedback
2002.09564 (2020-02)
Towards Robust and Reproducible Active Learning Using Neural Networks
2003.04297 (2020-03)
Improved Baselines with Momentum Contrastive Learning
and 33 more not named here
create_logger 35 other papers
23 dated earlier, 3 the same month, 7 later, 2 same year, order not determinable
2104.13840 (2021-04)
Twins: Revisiting the Design of Spatial Attention in Vision Transformers
2106.03650 (2021-06)
Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer
2106.03746 (2021-06)
Efficient Training of Visual Transformers with Small Datasets
and 32 more not named here
check_keywords_in_name 31 other papers
19 dated earlier, 2 the same month, 8 later, 2 same year, order not determinable
2103.14030 (2021-03)
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
2106.03650 (2021-06)
Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformer
2106.03746 (2021-06)
Efficient Training of Visual Transformers with Small Datasets
and 28 more not named here
shear_x 27 other papers
21 dated earlier, 6 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 24 more not named here
shear_y 27 other papers
21 dated earlier, 6 later
1811.12814 (2018-11)
Graph-Based Global Reasoning Networks
2109.03508 (2021-09)
RepNAS: Searching for Efficient Re-parameterizing Blocks
2109.06165 (2021-09)
CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptation
and 24 more not named here
build_scheduler 13 other papers
7 dated earlier, 1 the same month, 3 later, 2 same year, order not determinable
2103.14030 (2021-03)
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
2307.06947 (2023-07)
Video-FocalNets: Spatio-Temporal Focal Modulation for Video Action Recognition
2309.01430 (2023-09)
DAT++: Spatially Dynamic Vision Transformer with Deformable Attention
and 10 more not named here
unwrap_model 3 other papers
2 dated earlier, 1 later
1905.13214 (2019-05)
On Network Design Spaces for Visual Recognition
2002.09564 (2020-02)
Towards Robust and Reproducible Active Learning Using Neural Networks
2607.06982 (2026-07)
EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Neural network sparsity has attracted many research interests due to its similarity to biological schemes and high energy efficiency. However, existing methods depend on long-time training or fine-tuning, which prevents large-scale applications. Recently, some works focusing on post-training sparsity (PTS) have emerged. They get rid of the high training cost but usually suffer from distinct accuracy degradation due to neglect of the reasonable sparsity rate at each layer. Previous methods for finding sparsity rates mainly focus on the training-aware scenario, which usually fails to converge stably under the PTS setting with limited data and much less training cost. In this paper, we propose a fast and controllable post-training sparsity (FCPTS) framework. By incorporating a differentiable bridge function and a controllable optimization objective, our method allows for rapid and accurate sparsity allocation learning in minutes, with the added assurance of convergence to a predetermined global sparsity rate. Equipped with these techniques, we can surpass the state-ofthe-art methods by a large margin, e.g., over 30% improvement for ResNet-50 on ImageNet under the sparsity rate of 80%. Our plug-and-play code and supplementary materials are open-sourced at https://github.com/ModelTC/FCPTS.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2405.05808")
get_code_for_paper("2405.05808")
have("2405.05808")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2405.05808.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2405.05808.svg)](https://syntology.ai/paper/2405.05808)

Connect an agent — have() is free.