We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Metric validation in Grammatical Error Correction (GEC) is currently done by observing the correlation between human and metric-induced rankings. However, such correlation studies are costly, methodologically troublesome, and suffer from low inter-rater agreement. We propose MAEGE, an automatic methodology for GEC metric validation, that overcomes many of the difficulties with existing practices. Experiments with \maege\ shed a new light on metric quality, showing for example that the standard $M^2$ metric fares poorly on corpus-level ranking. Moreover, we use MAEGE to perform a detailed analysis of metric behavior, showing that correcting some types of errors is consistently penalized by existing metrics.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1804.11225")
get_code_for_paper("1804.11225")
have("1804.11225")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1804.11225.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1804.11225)
Connect an agent — have() is free.