We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We propose a statistical adaptive procedure called SALSA for automatically scheduling the learning rate (step size) in stochastic gradient methods. SALSA first uses a smoothed stochastic line-search procedure to gradually increase the learning rate, then automatically switches to a statistical method to decrease the learning rate. The line search procedure ``warms up'' the optimization process, reducing the need for expensive trial and error in setting an initial learning rate. The method for decreasing the learning rate is based on a new statistical test for detecting stationarity when using a constant step size. Unlike in prior work, our test applies to a broad class of stochastic gradient algorithms without modification. The combined method is highly robust and autonomous, and it matches the performance of the best hand-tuned learning rate schedules in our experiments on several deep learning tasks.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2002.10597")
get_code_for_paper("2002.10597")
have("2002.10597")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2002.10597.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2002.10597)
Connect an agent — have() is free.