SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1810.00162 · 2018

NICE: Noise Injection and Clamping Estimation for Neural Network Quantization

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 8 functions out of this paper's own repositories and ran 6 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
Lancer555/NICE canonical 6 of 8
FunctionStatusWhere it lives
act_quant Ran Lancer555/NICE/actquant.py
code served (permissive licence) · get_code("dc2219edf51bea05")
conv_bn Ran Lancer555/NICE/models/inception_resnet_v2.py
code served (permissive licence) · get_code("36d164db20c45f6d")
conv_bn Ran Lancer555/NICE/models/inception_v2.py
code served (permissive licence) · get_code("c852fbd4f3361928")
mosaic_then_demosaic Ran Lancer555/NICE/deep_isp_utils.py
code served (permissive licence) · get_code("2f9e3c652b97a3a1")
mse2psnr Ran Lancer555/NICE/deep_isp_utils.py
code served (permissive licence) · get_code("fb3fa2601281d3fa")
to_tensor Ran Lancer555/NICE/deep_isp_utils.py
code served (permissive licence) · get_code("f3f332849e3331fa")
calc_loss Not yet run Lancer555/NICE/loss.py
code served (permissive licence) · get_code("528eda19fa60bac0")
get_dataset Not yet run Lancer555/NICE/data.py
code served (permissive licence) · get_code("05f6e3f087c87014")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Convolutional Neural Networks (CNN) are very popular in many fields including computer vision, speech recognition, natural language processing, to name a few. Though deep learning leads to groundbreaking performance in these domains, the networks used are very demanding computationally and are far from real-time even on a GPU, which is not power efficient and therefore does not suit low power systems such as mobile devices. To overcome this challenge, some solutions have been proposed for quantizing the weights and activations of these networks, which accelerate the runtime significantly. Yet, this acceleration comes at the cost of a larger error. The \uniqname method proposed in this work trains quantized neural networks by noise injection and a learned clamping, which improve the accuracy. This leads to state-of-the-art results on various regression and classification tasks, e.g., ImageNet classification with architectures such as ResNet-18/34/50 with low as 3-bit weights and activations. We implement the proposed solution on an FPGA to demonstrate its applicability for low power real-time applications. The implementation of the paper is available at https://github.com/Lancer555/NICE

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1810.00162")
get_code_for_paper("1810.00162")
have("1810.00162")

Connect an agent — have() is free.