We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We present NUBIA, a methodology to build automatic evaluation metrics for text generation using only machine learning models as core components. A typical NUBIA model is composed of three modules: a neural feature extractor, an aggregator and a calibrator. We demonstrate an implementation of NUBIA which outperforms metrics currently used to evaluate machine translation, summaries and slightly exceeds/matches state of the art metrics on correlation with human judgement on the WMT segment-level Direct Assessment task, sentence-level ranking and image captioning evaluation. The model implemented is modular, explainable and set to continuously improve over time.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2004.14667")
get_code_for_paper("2004.14667")
have("2004.14667")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2004.14667.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2004.14667)
Connect an agent — have() is free.