SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2303.08954 · EMNLP · 2023

PRESTO: A Multilingual Dataset for Parsing Realistic Task-Oriented Dialogs

Gupta, Yu, Siddharth Vashishtha, Rushin Shah, Motoki Sano, Rahul Goel, Waleed Ammar, Aditya †♡, Faiz Surani, Max ‡♢, Hyunjeong Chang, David Choe, and 6 more

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Research interest in task-oriented dialogs has increased as systems such as Google Assistant, Alexa and Siri have become ubiquitous in everyday life. However, the impact of academic research in this area has been limited by the lack of datasets that realistically capture the wide array of user pain points. To enable research on some of the more challenging aspects of parsing realistic conversations, we introduce PRESTO 1 , a public dataset of over 550K contextual multilingual conversations between humans and virtual assistants. PRESTO contains a diverse array of challenges that occur in realworld NLU tasks such as disfluencies, codeswitching, and revisions. It is the only largescale human generated conversational parsing dataset that provides structured context such as a user's contacts and lists for each example. Our mT5 model-based baselines demonstrate that the conversational phenomena present in PRESTO are challenging to model, which is further pronounced in a low-resource setup.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2303.08954")
get_code_for_paper("2303.08954")
have("2303.08954")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2303.08954.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2303.08954.svg)](https://syntology.ai/paper/2303.08954)

Connect an agent — have() is free.