Yuan Li, Chunyuan Li, Jianfeng Gao, Yizhe Zhang, Xiang Gao, Baolin Peng, Xiujun Li
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
When trained effectively, the Variational Autoencoder (VAE) (Kingma and Welling, 2013;Bowman et al., 2016) can be both a powerful generative model and an effective representation learning framework for natural language. In this paper, we propose the first large-scale language VAE model OPTIMUS 1 . A universal latent embedding space for sentences is first pre-trained on large text corpus, and then fine-tuned for various language generation and understanding tasks. Compared with GPT-2, OPTIMUS enables guided language generation from an abstract level using the latent vectors. Compared with BERT, OPTIMUS can generalize better on low-resource language understanding tasks due to the smooth latent space structure. Extensive experimental results on a wide range of language tasks demonstrate the effectiveness of OPTIMUS. It achieves new state-of-the-art on VAE language modeling benchmarks. Encoder z x Decoder x h [CLS]
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2004.04092")
get_code_for_paper("2004.04092")
have("2004.04092")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2004.04092.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2004.04092)
Connect an agent — have() is free.