SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2110.07367 · EMNLP · 2021

RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking

Jing Liu, Ji-Rong Wen, Wayne Zhao, Qiaoqiao She, Hua Wu, Ruiyang Ren, Haifeng Wang, Yingqi Qu

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In various natural language processing tasks, passage retrieval and passage re-ranking are two key procedures in finding and ranking relevant information. Since both the two procedures contribute to the final performance, it is important to jointly optimize them in order to achieve mutual improvement. In this paper, we propose a novel joint training approach for dense passage retrieval and passage reranking. A major contribution is that we introduce the dynamic listwise distillation, where we design a unified listwise training approach for both the retriever and the re-ranker. During the dynamic distillation, the retriever and the re-ranker can be adaptively improved according to each other's relevance information. We also propose a hybrid data augmentation strategy to construct diverse training instances for listwise training approach. Extensive experiments show the effectiveness of our approach on both MSMARCO and Natural Questions datasets. Our code is available at https:// github.com/PaddlePaddle/RocketQA. * Equal contribution. The work was done when Ruiyang Ren was doing internship at Baidu.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2110.07367")
get_code_for_paper("2110.07367")
have("2110.07367")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2110.07367.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2110.07367.svg)](https://syntology.ai/paper/2110.07367)

Connect an agent — have() is free.