BERTian Poetics: Constrained Composition with Masked LMs

Christopher Akiki, Martin Potthast

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. If it links a repository, it is listed below.

Repositories linked to this paper

webis-de/ml4cd-21 — marked official in Papers with Code; named in the paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Masked language models have recently been interpreted as energy-based sequence models that can be generated from using a Metropolis-Hastings sampler. This short paper demonstrates how this can be instrumentalized for constrained composition and explores the poetics implied by such a usage. Our focus on constraints makes it especially apt to understand the generated text through the poetics of the OuLiPo movement.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2110.15181")
get_code_for_paper("2110.15181")
have("2110.15181")

Connect an agent — have() is free.