SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2203.12815 · ACL Findings · 2022

Revisiting the Effects of Leakage on Dependency Parsing

Antonios Anastasopoulos, Miriam Wanner, Nathaniel Krasner

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

showed that, treebank size aside, overlap between training and test graphs (termed leakage) explains more of the observed variation in dependency parsing performance than other explanations. In this work we revisit this claim, testing it on more models and languages. We find that it only holds for zero-shot cross-lingual settings. We then propose a more fine-grained measure of such leakage which, unlike the original measure, not only explains but also correlates with observed performance variation. 1 * Equal contribution. Work performed at GMU. 1 Code and data are available here: https://github.com/

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2203.12815")
get_code_for_paper("2203.12815")
have("2203.12815")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2203.12815.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2203.12815.svg)](https://syntology.ai/paper/2203.12815)

Connect an agent — have() is free.