SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2009.12102 · EMNLP Findings · 2020

Focus-Constrained Attention Mechanism for CVAE-based Response Generation

Bin Wang, Jiayi Zhang, Chen Wei, Zhi Cui, Yanran Li, Jianwei Cui

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

To model diverse responses for a given post, one promising way is to introduce a latent variable into Seq2Seq models. The latent variable is supposed to capture the discourse-level information and encourage the informativeness of target responses. However, such discourselevel information is often too coarse for the decoder to be utilized. To tackle it, our idea is to transform the coarse-grained discourselevel information into fine-grained word-level information. Specifically, we firstly measure the semantic concentration of corresponding target response on the post words by introducing a fine-grained focus signal. Then, we propose a focus-constrained attention mechanism to take full advantage of focus in well aligning the input to the target response. The experimental results demonstrate that by exploiting the fine-grained signal, our model can generate more diverse and informative responses compared with several state-of-the-art models. 1

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2009.12102")
get_code_for_paper("2009.12102")
have("2009.12102")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2009.12102.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2009.12102.svg)](https://syntology.ai/paper/2009.12102)

Connect an agent — have() is free.