SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2205.01941 · ACL · 2022

Lexical Knowledge Internalization for Neural Dialog Generation

Lingpeng Kong, Xiang Li, Zhiyong Wu, Wei Bi, Ben Kao

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We propose knowledge internalization (KI), which aims to complement the lexical knowledge into neural dialog models. Instead of further conditioning the knowledge-grounded dialog (KGD) models on externally retrieved knowledge, we seek to integrate knowledge about each input token internally into the model's parameters. To tackle the challenge due to the large scale of lexical knowledge, we adopt the contrastive learning approach and create an effective token-level lexical knowledge retriever that requires only weak supervision mined from Wikipedia. We demonstrate the effectiveness and general applicability of our approach on various datasets and diversified model structures. * The majority of this work was done while the first author was interning at Tencent AI Lab. † Corresponding author J.K Rowling donates a lot of money for COVID-19 relief work in India. Yes. Khalsa Aid received the donation. JK Rowling donated a six-figure amount to Khalsa Aid for their COVID-19 relief work in India. (a) An utterance-response-knowledge triple. J.K Rowling is a British author and philanthropist. Really? J.K Rowling is my favorite British writer. I now respect her even more. Donate is to give (money or goods) for a good cause, for example to a charity. Wow. It's so good of her. COVID-19, also known as the coronavirus, is a contagious disease caused severe acute …. Hope this will help stop the coronavirus in India.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2205.01941")
get_code_for_paper("2205.01941")
have("2205.01941")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2205.01941.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2205.01941.svg)](https://syntology.ai/paper/2205.01941)

Connect an agent — have() is free.