We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We stabilize the activations of Recurrent Neural Networks (RNNs) by penalizing the squared distance between successive hidden states' norms. This penalty term is an effective regularizer for RNNs including LSTMs and IRNNs, improving performance on character-level language modeling and phoneme recognition, and outperforming weight noise and dropout. We achieve competitive performance (18.6\% PER) on the TIMIT phoneme recognition task for RNNs evaluated without beam search or an RNN transducer. With this penalty term, IRNN can achieve similar performance to LSTM on language modeling, although adding the penalty term to the LSTM results in superior performance. Our penalty term also prevents the exponential growth of IRNN's activations outside of their training horizon, allowing them to generalize to much longer sequences.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1511.08400")
get_code_for_paper("1511.08400")
have("1511.08400")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1511.08400.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1511.08400)
Connect an agent — have() is free.