SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2104.14672 · 2021

Analytical bounds on the local Lipschitz constants of ReLU networks

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 5 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
uwaa-ndcl/local_lipschitz canonical 5 of 6
FunctionStatusWhere it lives
block_diag Ran uwaa-ndcl/local_lipschitz/other_methods/lipsdp_python/lipschitz_multi_layer.py
code served (permissive licence) · get_code("35719ece9c58199b")
get_input_size Ran uwaa-ndcl/local_lipschitz/other_methods/lipestimation/lipschitz_utils.py
code served (permissive licence) · get_code("95e3a4ac36517e22")
parse_result_line Ran uwaa-ndcl/local_lipschitz/other_methods/RecurJac-and-CROWN/parse_lipschitz.py
code served (permissive licence) · get_code("30d41f92926b944b")
parse_single Ran uwaa-ndcl/local_lipschitz/other_methods/RecurJac-and-CROWN/parse_lipschitz.py
code served (permissive licence) · get_code("d2497eea1d5d4148")
relu Ran uwaa-ndcl/local_lipschitz/network_bound.py
code served (permissive licence) · get_code("7bc22741366e8140")
jacobian Not yet run uwaa-ndcl/local_lipschitz/other_methods/lipestimation/lipschitz_utils.py
code served (permissive licence) · get_code("8b9f49cd279dbfa1")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In this paper, we determine analytical upper bounds on the local Lipschitz constants of feedforward neural networks with ReLU activation functions. We do so by deriving Lipschitz constants and bounds for ReLU, affine-ReLU, and max pooling functions, and combining the results to determine a network-wide bound. Our method uses several insights to obtain tight bounds, such as keeping track of the zero elements of each layer, and analyzing the composition of affine and ReLU functions. Furthermore, we employ a careful computational approach which allows us to apply our method to large networks such as AlexNet and VGG-16. We present several examples using different networks, which show how our local Lipschitz bounds are tighter than the global Lipschitz bounds. We also show how our method can be applied to provide adversarial bounds for classification networks. These results show that our method produces the largest known bounds on minimum adversarial perturbations for large networks such as AlexNet and VGG-16.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2104.14672")
get_code_for_paper("2104.14672")
have("2104.14672")

Connect an agent — have() is free.