We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We study few-shot reranking for multi-hop QA with open-domain questions. To alleviate the need for a large number of labeled question-document pairs for retriever training, we propose PromptRank, which relies on large language models prompting for multi-hop path reranking. PromptRank first constructs an instruction-based prompt that includes a candidate document path and then computes the relevance score between a given question and the path based on the conditional likelihood of the question given the path prompt according to a language model. PromptRank yields strong retrieval performance on HotpotQA with only 128 training examples compared to state-of-the-art methods trained on thousands of examples -- 73.6 recall@10 by PromptRank vs. 77.8 by PathRetriever and 77.5 by multi-hop dense retrieval. Code available at https://github.com/mukhal/PromptRank
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2205.12650")
get_code_for_paper("2205.12650")
have("2205.12650")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2205.12650.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2205.12650)
Connect an agent — have() is free.