SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2102.12016 · 2021

Scalable Subspace Methods for Derivative-Free Nonlinear Least-Squares Optimization

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
numericalalgorithmsgroup/dfbgn canonical 3 of 4
FunctionStatusWhere it lives
done_with_current_rho Ran numericalalgorithmsgroup/dfbgn/dfbgn/solver.py
pointer only (licence: GPL-3.0) · get_code("cce77e8f7d9f0e76")
nonlinear_system Ran numericalalgorithmsgroup/dfbgn/examples/nonlinear_system.py
pointer only (licence: GPL-3.0) · get_code("a1292b120dea6d1e")
reduce_rho Ran numericalalgorithmsgroup/dfbgn/dfbgn/solver.py
pointer only (licence: GPL-3.0) · get_code("0ee5e2c4af0f9d23")
update_tr Not yet run numericalalgorithmsgroup/dfbgn/dfbgn/solver.py
pointer only (licence: GPL-3.0) · get_code("1de771f02ce9e6f1")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We introduce a general framework for large-scale model-based derivative-free optimization based on iterative minimization within random subspaces. We present a probabilistic worst-case complexity analysis for our method, where in particular we prove high-probability bounds on the number of iterations before a given optimality is achieved. This framework is specialized to nonlinear least-squares problems, with a model-based framework based on the Gauss-Newton method. This method achieves scalability by constructing local linear interpolation models to approximate the Jacobian, and computes new steps at each iteration in a subspace with user-determined dimension. We then describe a practical implementation of this framework, which we call DFBGN. We outline efficient techniques for selecting the interpolation points and search subspace, yielding an implementation that has a low per-iteration linear algebra cost (linear in the problem dimension) while also achieving fast objective decrease as measured by evaluations. Extensive numerical results demonstrate that DFBGN has improved scalability, yielding strong performance on large-scale nonlinear least-squares problems.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2102.12016")
get_code_for_paper("2102.12016")
have("2102.12016")

Connect an agent — have() is free.