SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2203.08517 · ACL Findings · 2022

TEGTOK: Augmenting Text Generation via Task-specific and Open-world Knowledge

Chongyang Tao, Can Xu, Chao-Hong Tan, Zhen-Hua Ling, Xiubo Geng, Daxin Jiang, Jia-Chen Gu, Huang Hu

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Generating natural and informative texts has been a long-standing problem in NLP. Much effort has been dedicated into incorporating pretrained language models (PLMs) with various open-world knowledge, such as knowledge graphs or wiki pages. However, their ability to access and manipulate the task-specific knowledge is still limited on downstream tasks, as this type of knowledge is usually not well covered in PLMs and is hard to acquire. To address the problem, we propose augmenting TExt Generation via Task-specific and Open-world Knowledge (TEGTOK) in a unified framework. Our model selects knowledge entries from two types of knowledge sources through dense retrieval and then injects them into the input encoding and output decoding stages respectively on the basis of PLMs. With the help of these two types of knowledge, our model can learn what and how to generate. Experiments on two text generation tasks of dialogue generation and question generation, and on two datasets show that our method achieves better performance than various baseline models.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2203.08517")
get_code_for_paper("2203.08517")
have("2203.08517")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2203.08517.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2203.08517.svg)](https://syntology.ai/paper/2203.08517)

Connect an agent — have() is free.