Yonatan Belinkov, Kerem Zaman
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Most evaluations of attribution methods focus on the English language. In this work, we present a multilingual approach for evaluating attribution methods for the Natural Language Inference (NLI) task in terms of faithfulness and plausibility. First, we introduce a novel cross-lingual strategy to measure faithfulness based on word alignments, which eliminates the drawbacks of erasure-based evaluations. We then perform a comprehensive evaluation of attribution methods, considering different output mechanisms and aggregation methods. Finally, we augment the XNLI dataset with highlight-based explanations, providing a multilingual NLI dataset with highlights, to support future exNLP studies. Our results show that attribution methods performing best for plausibility and faithfulness are different. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2204.05428")
get_code_for_paper("2204.05428")
have("2204.05428")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2204.05428.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2204.05428)
Connect an agent — have() is free.