Xu Tan, Jianfeng Lu, Kaitao Song
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Neural machine translation (NMT) generates the next target token given as input the previous ground truth target tokens during training while the previous generated target tokens during inference, which causes discrepancy between training and inference as well as error propagation, and affects the translation accuracy. In this paper, we introduce an error correction mechanism into NMT, which corrects the error information in the previous generated tokens to better predict the next token. Specifically, we introduce two-stream self-attention from XLNet into NMT decoder, where the query stream is used to predict the next token, and meanwhile the content stream is used to correct the error information from the previous predicted tokens. We leverage scheduled sampling to simulate the prediction errors during training. Experiments on three IWSLT translation datasets and two WMT translation datasets demonstrate that our method achieves improvements over Transformer baseline and scheduled sampling. Further experimental analyses also verify the effectiveness of our proposed error correction mechanism to improve the translation quality.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2007.10681")
get_code_for_paper("2007.10681")
have("2007.10681")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2007.10681.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2007.10681)
Connect an agent — have() is free.