SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1902.00098 · 2019

The Second Conversational Intelligence Challenge (ConvAI2)

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We describe the setting and results of the ConvAI2 NeurIPS competition that aims to further the state-of-the-art in open-domain chatbots. Some key takeaways from the competition are: (i) pretrained Transformer variants are currently the best performing models on this task, (ii) but to improve performance on multi-turn conversations with humans, future systems must go beyond single word metrics like perplexity to measure the performance across sequences of utterances (conversations) -- in terms of repetition, consistency and balance of dialogue acts (e.g. how many questions asked vs. answered).

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1902.00098")
get_code_for_paper("1902.00098")
have("1902.00098")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/1902.00098.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/1902.00098.svg)](https://syntology.ai/paper/1902.00098)

Connect an agent — have() is free.