SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2402.04906 · 2024

Conformal Convolution and Monte Carlo Meta-learners for Predictive Inference of Individual Treatment Effects

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 9 functions out of this paper's own repositories and ran 3 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
predict-idlab/cct-cmc canonical 3 of 6
predict-idlab/cmc-learner canonical 0 of 3
FunctionStatusWhere it lives
crps Ran predict-idlab/cct-cmc/src/metrics.py
code served (permissive licence) · get_code("c4031ef6f42dd7ae")
crps_normal Ran predict-idlab/cct-cmc/src/metrics.py
code served (permissive licence) · get_code("0088d1f91995c38f")
generate_data Ran predict-idlab/cct-cmc/src/datasets/alaa_synthetic.py
code served (permissive licence) · get_code("484ffc15894a9366")
conformal_metalearner_experiment Not yet run predict-idlab/cmc-learner/src/conformal_metalearners/metalearners.py
code served (permissive licence) · get_code("d6946ed91855a8cb")
dr_cqr_random_forests Not yet run predict-idlab/cmc-learner/src/conformal_metalearners/metalearners.py
code served (permissive licence) · get_code("a4678045ed82d4d6")
get_data Not yet run predict-idlab/cct-cmc/src/datasets/alaa_synthetic.py
code served (permissive licence) · get_code("0aa55dc3bd824b3a")
init_qz Not yet run predict-idlab/cct-cmc/src/benchmarks/cevae.py
code served (permissive licence) · get_code("26a81ab1995b6d43")
ipw_cqr_random_forests Not yet run predict-idlab/cmc-learner/src/conformal_metalearners/metalearners.py
code served (permissive licence) · get_code("7a68930c5d6ddef0")
loglikelihood Not yet run predict-idlab/cct-cmc/src/metrics.py
code served (permissive licence) · get_code("3c9f993df38745e9")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Generating probabilistic forecasts of potential outcomes and individual treatment effects (ITE) is essential for risk-aware decision-making in domains such as healthcare, policy, marketing, and finance. We propose two novel methods: the conformal convolution T-learner (CCT) and the conformal Monte Carlo (CMC) meta-learner, that generate full predictive distributions of both potential outcomes and ITEs. Our approaches combine weighted conformal predictive systems with either analytic convolution of potential outcome distributions or Monte Carlo sampling, addressing covariate shift through propensity score weighting. In contrast to other approaches that allow the generation of potential outcome predictive distributions, our approaches are model agnostic, universal, and come with finite-sample guarantees of probabilistic calibration under knowledge of the propensity score. Regarding estimating the ITE distribution, we formally characterize how assumptions about potential outcomes' noise dependency impact distribution validity and establish universal consistency under independence noise assumptions. Experiments on synthetic and semi-synthetic datasets demonstrate that the proposed methods achieve probabilistically calibrated predictive distributions while maintaining narrow prediction intervals and having performant continuous ranked probability scores. Besides probabilistic forecasting performance, we observe significant efficiency gains for the CCT- and CMC meta-learners compared to other conformal approaches that produce prediction intervals for ITE with coverage guarantees.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2402.04906")
get_code_for_paper("2402.04906")
have("2402.04906")

Connect an agent — have() is free.