SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1612.08468 · 2016

Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Models

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 9 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
givasile/effector pwc_unofficial 0 of 8
blent-ai/ALEPython pwc_unofficial 0 of 1
FunctionStatusWhere it lives
ale_plot Not yet run blent-ai/ALEPython/src/alepython/ale.py
code served (permissive licence) · get_code("aa0359dc6ff3556c")
classifier_proba Not yet run givasile/effector/effector/adapters.py
code served (permissive licence) · get_code("81e73cd71ac037a6")
from_sklearn Not yet run givasile/effector/effector/adapters.py
code served (permissive licence) · get_code("f3ab687b3868ff9c")
from_torch Not yet run givasile/effector/effector/adapters.py
code served (permissive licence) · get_code("9f28ce2c3c05ac85")
ice_non_vectorized Not yet run givasile/effector/effector/global_effect_pdp.py
code served (permissive licence) · get_code("bcd5f779bda1a394")
ice_vectorized Not yet run givasile/effector/effector/global_effect_pdp.py
code served (permissive licence) · get_code("73672b811b2a909a")
select Not yet run givasile/effector/effector/explained_variance.py
code served (permissive licence) · get_code("fae16fbe958f1615")
supports Not yet run givasile/effector/effector/explained_variance.py
code served (permissive licence) · get_code("dce61d58bfada672")
surrogate_r2 Not yet run givasile/effector/effector/explained_variance.py
code served (permissive licence) · get_code("ff4ed7fdf7f5990a")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

When fitting black box supervised learning models (e.g., complex trees, neural networks, boosted trees, random forests, nearest neighbors, local kernel-weighted methods, etc.), visualizing the main effects of the individual predictor variables and their low-order interaction effects is often important, and partial dependence (PD) plots are the most popular approach for accomplishing this. However, PD plots involve a serious pitfall if the predictor variables are far from independent, which is quite common with large observational data sets. Namely, PD plots require extrapolation of the response at predictor values that are far outside the multivariate envelope of the training data, which can render the PD plots unreliable. Although marginal plots (M plots) do not require such extrapolation, they produce substantially biased and misleading results when the predictors are dependent, analogous to the omitted variable bias in regression. We present a new visualization approach that we term accumulated local effects (ALE) plots, which inherits the desirable characteristics of PD and M plots, without inheriting their preceding shortcomings. Like M plots, ALE plots do not require extrapolation; and like PD plots, they are not biased by the omitted variable phenomenon. Moreover, ALE plots are far less computationally expensive than PD plots.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1612.08468")
get_code_for_paper("1612.08468")
have("1612.08468")

Connect an agent — have() is free.