We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Rectified linear units (ReLU) are commonly used in deep neural networks. So far ReLU and its generalizations (non-parametric or parametric) are static, performing identically for all input samples. In this paper, we propose dynamic ReLU (DY-ReLU), a dynamic rectifier of which parameters are generated by a hyper function over all in-put elements. The key insight is that DY-ReLU encodes the global context into the hyper function, and adapts the piecewise linear activation function accordingly. Compared to its static counterpart, DY-ReLU has negligible extra computational cost, but significantly more representation capability, especially for light-weight neural networks. By simply using DY-ReLU for MobileNetV2, the top-1 accuracy on ImageNet classification is boosted from 72.0% to 76.2% with only 5% additional FLOPs.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2003.10027")
get_code_for_paper("2003.10027")
have("2003.10027")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2003.10027.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2003.10027)
Connect an agent — have() is free.