We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Quantizing weights and activations of deep neural networks results in significant improvement in inference efficiency at the cost of lower accuracy. A source of the accuracy gap between full precision and quantized models is the quantization error. In this work, we focus on the binary quantization, in which values are mapped to -1 and 1. We provide a unified framework to analyze different scaling strategies. Inspired by the pareto-optimality of 2-bits versus 1-bit quantization, we introduce a novel 2-bits quantization with provably least squares error. Our quantization algorithms can be implemented efficiently on the hardware using bitwise operations. We present proofs to show that our proposed methods are optimal, and also provide empirical error analysis. We conduct experiments on the ImageNet dataset and show a reduced accuracy gap when using the proposed least squares quantization algorithms.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2001.02786")
get_code_for_paper("2001.02786")
have("2001.02786")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2001.02786.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2001.02786)
Connect an agent — have() is free.