Christian Perone, Roberto Pereira Silveira, Thomas Paula
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.
Uncertainty quantification for deep neural networks has recently evolved through many techniques. In this work, we revisit Laplace approximation, a classical approach for posterior approximation that is computationally attractive. However, instead of computing the curvature matrix, we show that, under some regularity conditions, the Laplace approximation can be easily constructed using the gradient second moment. This quantity is already estimated by many exponential moving average variants of Adagrad such as Adam and RMSprop, but is traditionally discarded after training. We show that our method (L2M) does not require changes in models or optimization, can be implemented in a few lines of code to yield reasonable results, and it does not require any extra computational steps besides what is already being computed by optimizers, without introducing any new hyperparameter. We hope our method can open new research directions on using quantities already computed by optimizers for uncertainty estimation in deep neural networks.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2107.04695")
get_code_for_paper("2107.04695")
have("2107.04695")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2107.04695.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2107.04695)
Connect an agent — have() is free.