Yang Liu, Karthik Gopalakrishnan, Behnam Hedayatnia, Longshaokan Wang, Dilek Hakkani-Tür
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Large end-to-end neural open-domain chatbots are becoming increasingly popular. However, research on building such chatbots has typically assumed that the user input is written in nature and it is not clear whether these chatbots would seamlessly integrate with automatic speech recognition (ASR) models to serve the speech modality. We aim to bring attention to this important question by empirically studying the effects of various types of synthetic and actual ASR hypotheses in the dialog history on TransferTransfo, a state-of-the-art Generative Pretrained Transformer (GPT) based neural open-domain dialog system from the NeurIPS ConvAI2 challenge. We observe that TransferTransfo trained on written data is very sensitive to such hypotheses introduced to the dialog history during inference time. As a baseline mitigation strategy, we introduce synthetic ASR hypotheses to the dialog history during training and observe marginal improvements, demonstrating the need for further research into techniques to make end-to-end open-domain chatbots fully speech-robust. To the best of our knowledge, this is the first study to evaluate the effects of synthetic and actual ASR hypotheses on a state-of-the-art neural open-domain dialog system and we hope it promotes speech-robustness as an evaluation criterion in open-domain dialog.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2008.07683")
get_code_for_paper("2008.07683")
have("2008.07683")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2008.07683.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2008.07683)
Connect an agent — have() is free.