Canwen Xu, Julian Mcauley, Nan Duan, Daya Guo
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In this paper, we propose LaPraDoR, a pretrained dual-tower dense retriever that does not require any supervised data for training. Specifically, we first present Iterative Contrastive Learning (ICoL) that iteratively trains the query and document encoders with a cache mechanism. ICoL not only enlarges the number of negative instances but also keeps representations of cached examples in the same hidden space. We then propose Lexicon-Enhanced Dense Retrieval (LEDR) as a simple yet effective way to enhance dense retrieval with lexical matching. We evaluate LaPraDoR on the recently proposed BEIR benchmark, including 18 datasets of 9 zeroshot text retrieval tasks. Experimental results show that LaPraDoR achieves state-of-the-art performance compared with supervised dense retrieval models, and further analysis reveals the effectiveness of our training strategy and objectives. Compared to re-ranking, our lexiconenhanced approach can be run in milliseconds (22.5× faster) while achieving superior performance. 1 * Equal contribution. 1 Code and pretrained weights can be found at https: //github.com/JetRunner/LaPraDoR.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2203.06169")
get_code_for_paper("2203.06169")
have("2203.06169")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2203.06169.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2203.06169)
Connect an agent — have() is free.