"Why Should I Trust You?": Explaining the Predictions of Any Classifier

Carlos Guestrin, Sameer Singh, Marco Ribeiro

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 19 functions out of this paper's own repositories and ran 6 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

Repositories linked to this paper

• marcotcr/lime-experiments — marked official in Papers with Code; named in the paper
• AlexIoannides/lime-interpretable-ml
• Cherrydomini/Effects-of-feature-dropping-on-COMPAS-with-the-influence-of-LIME-
• GISH123/Cathay-Holdings-CIP-Projects-for-Interpretable-Machine-Learning
• Kungbohan/EECSMed
• LaurentLava/Lime
• MachineLearningJournalClub/LearningNLP
• Mahdidrm/Emotion-Recognition
• Nadhila/Explainble-AI
• TooTouch/WhiteBox-Part2
• adrhill/explainableai.jl
• aildnont/HIFIS-model
• blazecolby/PyTorch-LIME
• dailab/maxi-xai-lib
• emanuel-metzenthin/lime-for-time
• galdeia/iirsbenchmark
• hieu2906090/deep-learning-in-js
• janhavi-giri/Explainable_ML_Classifier_LIME
• marcotcr/lime
• nyuvis/explanation_explorer
• priyamtejaswin/devise-keras
• quantabox/literature
• rashidrao-pk/lime_stratified
• stiasta/fraud_detection_notes
• thomasp85/lime
• yeefan1999/Explainable-Health-Prediction-with-Transfer-Learning
• pytorch/captum

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Despite widespread adoption, machine learning models remain mostly black boxes. Understanding the reasons behind predictions is, however, quite important in assessing trust, which is fundamental if one plans to take action based on a prediction, or when choosing whether to deploy a new model. Such understanding also provides insights into the model, which can be used to transform an untrustworthy model or prediction into a trustworthy one. In this work, we propose LIME, a novel explanation technique that explains the predictions of any classifier in an interpretable and faithful manner, by learning an interpretable model locally around the prediction. We also propose a method to explain models by presenting representative individual predictions and their explanations in a non-redundant way, framing the task as a submodular optimization problem. We demonstrate the flexibility of these methods by explaining different models for text (e.g. random forests) and image classification (e.g. neural networks). We show the utility of explanations via novel experiments, both simulated and with human subjects, on various scenarios that require trust: deciding if one should trust a prediction, choosing between models, improving an untrustworthy classifier, and identifying why a classifier should not be trusted.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1602.04938")
get_code_for_paper("1602.04938")
have("1602.04938")

Connect an agent — have() is free.