Yang Liu, Dilek Hakkani-Tür, Yan Xu, Devamanyu Hazarika, Aishwarya Padmakumar, Mahdi Namazifar
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Large pre-trained language models (PLMs) have been shown to retain implicit knowledge within their parameters. To enhance this implicit knowledge, we propose Knowledge Injection into Language Models (KILM), a novel approach that injects entity-related knowledge into encoder-decoder PLMs, via a generative knowledge infilling objective through continued pre-training. This is done without architectural modifications to the PLMs or adding additional parameters. Experimental results over a suite of knowledge-intensive tasks spanning numerous datasets show that KILM enables models to retain more knowledge and hallucinate less while preserving their original performance on general NLU and NLG tasks. KILM also demonstrates improved zero-shot performances on tasks such as entity disambiguation, outperforming state-of-the-art models having 30x more parameters. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2302.09170")
get_code_for_paper("2302.09170")
have("2302.09170")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2302.09170.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2302.09170)
Connect an agent — have() is free.