We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Pre-training on larger datasets with ever increasing model size is now a proven recipe for increased performance across almost all NLP tasks. A notable exception is information retrieval, where additional pre-training has so far failed to produce convincing results. We show that, with the right pre-training setup, this barrier can be overcome. We demonstrate this by pre-training large bi-encoder models on 1) a recently released set of 65 million synthetically generated questions, and 2) 200 million post-comment pairs from a preexisting dataset of Reddit conversations made available by pushshift.io. We evaluate on a set of information retrieval and dialogue retrieval benchmarks, showing substantial improvements over supervised baselines.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2107.13602")
get_code_for_paper("2107.13602")
have("2107.13602")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2107.13602.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2107.13602)
Connect an agent — have() is free.