We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Pretraining sentence encoders with language modeling and related unsupervised tasks has recently been shown to be very effective for language understanding tasks. By supplementing language model-style pretraining with further training on data-rich supervised tasks, such as natural language inference, we obtain additional performance improvements on the GLUE benchmark. Applying supplementary training on BERT (Devlin et al., 2018), we attain a GLUE score of 81.8---the state of the art (as of 02/24/2019) and a 1.4 point improvement over BERT. We also observe reduced variance across random restarts in this setting. Our approach yields similar improvements when applied to ELMo (Peters et al., 2018a) and Radford et al. (2018)'s model. In addition, the benefits of supplementary training are particularly pronounced in data-constrained regimes, as we show in experiments with artificially limited training data.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1811.01088")
get_code_for_paper("1811.01088")
have("1811.01088")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1811.01088.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1811.01088)
Connect an agent — have() is free.