SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2010.05090 · EMNLP Findings · 2020

Semi-supervised Formality Style Transfer using Language Model Discriminator and Mutual Information Maximization

Diyi Yang, Kunal Chawla

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Formality style transfer is the task of converting informal sentences to grammaticallycorrect formal sentences, which can be used to improve performance of many downstream NLP tasks. In this work, we propose a semisupervised formality style transfer model that utilizes a language model-based discriminator to maximize the likelihood of the output sentence being formal, which allows us to use maximization of token-level conditional probabilities for training. We further propose to maximize mutual information between source and target styles as our training objective instead of maximizing the regular likelihood that often leads to repetitive and trivial generated responses. Experiments showed that our model outperformed previous state-of-theart baselines significantly in terms of both automated metrics and human judgement. We further generalized our model to unsupervised text style transfer task, and achieved significant improvements on two benchmark sentiment style transfer datasets.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2010.05090")
get_code_for_paper("2010.05090")
have("2010.05090")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2010.05090.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2010.05090.svg)](https://syntology.ai/paper/2010.05090)

Connect an agent — have() is free.