We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Neural architecture search (NAS) searches architectures automatically for given tasks, e.g., image classification and language modeling. Improving the search efficiency and effectiveness have attracted increasing attention in recent years. However, few efforts have been devoted to understanding the generated architectures. In this paper, we first reveal that existing NAS algorithms (e.g., DARTS, ENAS) tend to favor architectures with wide and shallow cell structures. These favorable architectures consistently achieve fast convergence and are consequently selected by NAS algorithms. Our empirical and theoretical study further confirms that their fast convergence derives from their smooth loss landscape and accurate gradient information. Nonetheless, these architectures may not necessarily lead to better generalization performance compared with other candidate architectures in the same search space, and therefore further improvement is possible by revising existing NAS algorithms.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1909.09569")
get_code_for_paper("1909.09569")
have("1909.09569")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1909.09569.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1909.09569)
Connect an agent — have() is free.