Leon Sixt, Tim Landgraf, T Berlin, Martin Schuessler, Philipp Weiß, Oana-Iuliana Popescu, Freie Berlin, Weizenbaum Berlin
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
A variety of methods exist to explain image classification models. However, it remains unclear whether they provide any benefit to users over simply comparing various inputs and the model's respective predictions. We conducted a user study (N=240) to test how such a baseline explanation technique performs against concept-based and counterfactual explanations. To this end, we contribute a synthetic dataset generator capable of biasing individual attributes and quantifying their relevance to the model. In a study, we assess if participants can identify the relevant set of attributes compared to the ground-truth. Our results show that the baseline outperformed concept-based explanations. Counterfactual explanations from an invertible neural network performed similarly as the baseline. Still, they allowed users to identify some attributes more accurately. Our results highlight the importance of measuring how well users can reason about biases of a model, rather than solely relying on technical evaluations or proxy tasks. We open-source our study and dataset so it can serve as a blue-print for future studies.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2204.11642")
get_code_for_paper("2204.11642")
have("2204.11642")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2204.11642.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2204.11642)
Connect an agent — have() is free.