Philipp Koehn, Shuoyang Ding
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Saliency methods are widely used to interpret neural network predictions, but different variants of saliency methods often disagree even on the interpretations of the same prediction made by the same model. In these cases, how do we identify when are these interpretations trustworthy enough to be used in analyses? To address this question, we conduct a comprehensive and quantitative evaluation of saliency methods on a fundamental category of NLP models: neural language models. We evaluate the quality of prediction interpretations from two perspectives that each represents a desirable property of these interpretations: plausibility and faithfulness. Our evaluation is conducted on four different datasets constructed from the existing human annotation of syntactic and semantic agreements, on both sentencelevel and document-level. Through our evaluation, we identified various ways saliency methods could yield interpretations of low quality. We recommend that future work deploying such methods to neural language models should carefully validate their interpretations before drawing insights.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2104.05824")
get_code_for_paper("2104.05824")
have("2104.05824")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2104.05824.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2104.05824)
Connect an agent — have() is free.