Ricardo Rei, Alon Lavie, Ana Farinha, Craig Stewart
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We present COMET, a neural framework for training multilingual machine translation evaluation models which obtains new state-of-theart levels of correlation with human judgements. Our framework leverages recent breakthroughs in cross-lingual pretrained language modeling resulting in highly multilingual and adaptable MT evaluation models that exploit information from both the source input and a target-language reference translation in order to more accurately predict MT quality. To showcase our framework, we train three models with different types of human judgements: Direct Assessments, Human-mediated Translation Edit Rate and Multidimensional Quality Metrics. Our models achieve new state-ofthe-art performance on the WMT 2019 Metrics shared task and demonstrate robustness to high-performing systems.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2009.09025")
get_code_for_paper("2009.09025")
have("2009.09025")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2009.09025.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2009.09025)
Connect an agent — have() is free.