We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Neural networks can be trained to solve regression problems by using gradient-based methods to minimize the square loss. However, practitioners often prefer to reformulate regression as a classification problem, observing that training on the cross entropy loss results in better performance. By focusing on two-layer ReLU networks, which can be fully characterized by measures over their feature space, we explore how the implicit bias induced by gradient-based optimization could partly explain the above phenomenon. We provide theoretical evidence that the regression formulation yields a measure whose support can differ greatly from that for classification, in the case of one-dimensional data. Our proposed optimal supports correspond directly to the features learned by the input layer of the network. The different nature of these supports sheds light on possible optimization difficulties the square loss could encounter during training, and we present empirical results illustrating this phenomenon.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2211.05641")
get_code_for_paper("2211.05641")
have("2211.05641")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2211.05641.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2211.05641)
Connect an agent — have() is free.