We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Recently, flat-minima optimizers, which seek to find parameters in low-loss neighborhoods, have been shown to improve a neural network's generalization performance over stochastic and adaptive gradient-based optimizers. Two methods have received significant attention due to their scalability: 1. Stochastic Weight Averaging (SWA), and 2. Sharpness-Aware Minimization (SAM). However, there has been limited investigation into their properties and no systematic benchmarking of them across different domains. We fill this gap here by comparing the loss surfaces of the models trained with each method and through broad benchmarking across computer vision, natural language processing, and graph representation learning tasks. We discover several surprising findings from these results, which we hope will help researchers further improve deep learning optimizers, and practitioners identify the right optimizer for their problem.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2202.00661")
get_code_for_paper("2202.00661")
have("2202.00661")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2202.00661.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2202.00661)
Connect an agent — have() is free.