Luca Liello, Siddhant Garg, Alessandro Moschitti, Luca Soldaini
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Inference tasks such as answer sentence selection (AS2) or fact verification are typically solved by fine-tuning transformer-based models as individual sentence-pair classifiers. Recent studies show that these tasks benefit from modeling dependencies across multiple candidate sentences jointly. In this paper, we first show that popular pre-trained transformers perform poorly when used for fine-tuning on multi-candidate inference tasks. We then propose a new pre-training objective that models the paragraph-level semantics across multiple input sentences. Our evaluation on three AS2 and one fact verification datasets demonstrates the superiority of our pre-training technique over the traditional ones for transformers used as joint models for multi-candidate inference tasks, as well as when used as cross-encoders for sentence-pair formulations of these tasks.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2205.01228")
get_code_for_paper("2205.01228")
have("2205.01228")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2205.01228.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2205.01228)
Connect an agent — have() is free.