Jiacheng Xu, Aditya Gupta, Shyam Upadhyay, ♠ Diyi, Yang Manaal, Google Assistant
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Disfluencies is an under-studied topic in NLP, even though it is ubiquitous in human conversation. This is largely due to the lack of datasets containing disfluencies. In this paper, we present a new challenge question answering dataset, DISFL-QA, a derivative of SQUAD, where humans introduce contextual disfluencies in previously fluent questions. DISFL-QA contains a variety of challenging disfluencies that require a more comprehensive understanding of the text than what was necessary in prior datasets. Experiments show that the performance of existing state-of-the-art question answering models degrades significantly when tested on DISFL-QA in a zero-shot setting. We show data augmentation methods partially recover the loss in performance and also demonstrate the efficacy of using gold data for fine-tuning. We argue that we need large-scale disfluency datasets in order for NLP models to be robust to them. The dataset is publicly available at: https://github.com/ google-research-datasets/disfl-qa. * Work done during an internship at Google. When is Eas ugh Easter this year? Correction When is Lent I meant Easter this year? Restarts How much no wait when is Easter this year? (a) Conventional categories of Disfluencies. The reparandum (words intended to be corrected or ignored), interregnum (optional discourse cues) and repair are marked.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2106.04016")
get_code_for_paper("2106.04016")
have("2106.04016")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2106.04016.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2106.04016)
Connect an agent — have() is free.