CS Paper Radar

Explaining Heterogeneous Treatment Effects with Causal Forests and the Hoeffding Functional Decomposition

Gaëtan Patinier, Clément Bénard, Margaux Törnqvist

cs.LG stat.ML ·submitted 2026-10-12 09:14 UTC · v1

Abstract

The estimation of heterogeneous treatment effects is a central objective of causal inference. However, state-of-the-art algorithms to solve this task are based on machine learning principles, and thus behave as black boxes. Consequently, the identification of covariates driving heterogeneity remains a challenging and open problem. To address this limitation, we introduce CausalTreeHFD, an interpretable extension of causal forests, based on the Hoeffding functional decomposition adapted to tree ensembles. Our approach decomposes predictions of conditional average treatment effects (CATE) into contributions from individual covariates and pairwise interactions, providing a direct characterization of the factors driving treatment effect heterogeneity. We establish the consistency of CausalTreeHFD, which converges towards the Hoeffding decomposition of the underlying CATE function, under standard assumptions for the analysis of causal forests. Experiments on simulated and real datasets show that CausalTreeHFD accurately identifies relevant covariates and interactions, and precisely recovers their contributions to heterogeneous treatment effects.

Closest papers

Nearest neighbours by meaning across the whole index.

Splitting the Difference: Interpretable Causal Forests for Treatment Effect Heterogeneity and Bias

cs.LG stat.ML ·2026-09-15 ·Nicolas Alexander Ihlo, Merle Behr
similarity 0.76
Abstract

In various fields, such as medicine and marketing, accurately predicting individual treatment effects holds significant promise. However, achieving reliable predictions alone is often insufficient for making informed decisions; it is equally important to understand why the treatment effect is higher for some individuals than for others. To address this two-fold challenge of prediction and interpretation, we introduce an algorithm based on decision trees and random forests for estimating individual treatment effects. Our algorithm is simple: it operates exactly like a standard random forest, but with a different splitting criterion, and requires no additional workarounds such as double machine learning or orthogonalization as used in Generalized random forests. It handles observational studies with varying treatment propensities without requiring separate estimation of the full propensity function. This is achieved by combining two splitting criteria---one targeting heterogeneity in the treatment effect, the other targeting bias correction for the average treatment effect---which together improve split point selection and automatically distinguish confounders from features responsible for heterogeneity. As a result, interpretation follows directly from the fitted tree structure itself, that is, from which features the trees split on and with which split statistics, without requiring separate post-hoc analysis. For the theoretical analysis of this algorithm, we consider a change point model with step functions for potential outcomes and treatment propensity and provide insights into the theoretical underpinnings of our approach. Simulation studies show that our simple algorithm achieves comparable, and often better, prediction accuracy than existing methods, while substantially improving interpretability.

0.31

Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomes

cs.LG ·2026-09-05 ·Maitreyi Swaroop, Shikha Bhat, Samantha Rodriguez, Tamar Krishnamurti, Bryan Wilder
theory similarity 0.69
Abstract

Estimating conditional average treatment effects (CATE) enables efficient targeting of interventions, but many applications have limited experimental samples, making it difficult to estimate heterogeneous effects from high-dimensional covariates. In such settings, policymakers and medical practitioners often succumb to the curse of dimensionality or apply off-the-shelf dimension reduction methods that may not preserve treatment heterogeneity. Yet these domains often come with large historical datasets measuring a wide range of outcomes -- a source of supervision that is rarely exploited in practice. Following causal representation learning, we hypothesize that such domains with high-dimensional covariates have lower-dimensional underlying dynamics. We can thus leverage the diverse outcomes measured in historical data to learn a lower-dimensional representation of the covariates. Theoretically, we prove that when the auxiliary outcomes satisfy a set of surrogacy conditions and the representation retains relevant covariate information, the original CATE is identified when the high-dimensional covariates are replaced by the learned representation. Combined with existing dimension-dependent rates for CATE estimation, the result implies greater sample-efficiency on the same experimental sample. Additionally, we characterize the bias-variance tradeoff when the assumptions do not hold perfectly, and show that the representation-based estimator can still achieve lower error when the reduction in estimator variance outweighs the bias due to compression. Empirically, we evaluate the method on synthetic data and semi-synthetic medical data.

0.21

Conditional Average Treatment Effect Distillation for Hypothetical State-Intervention Targeting Under Budget Constraints

cs.LG ·2026-10-19 ·Vasundhara Acharya, Bülent Yener
similarity 0.66
Abstract · Under review at PLOS ONE

Personalized public-health targeting must capture heterogeneous intervention benefits while remaining interpretable under resource constraints. Flexible causal-effect models can be hard to operationalize, while coarse subgroup policies may lose individualized effect information. We study budget-constrained hypothetical state interventions in observational data without a logged historical decision policy. For obesity, elevated glucose, and lifetime smoking-history states, causal-structure-informed pretreatment covariates are prespecified, with capacity capped at 70% of those observed in the adverse state. We evaluate causal distillation where Causal Forest and Bayesian Causal Forest teachers estimate conditional average treatment effects (CATEs), which decision tree and random forest students approximate. We compare individualized policies with unsupervised K-means subgroup policies and supervised causal-tree policies with leaf counts matched to K-means cluster counts. Observational policies are assessed on held-out data using a doubly robust estimator, bootstrap uncertainty, and decision-focused teacher-student fidelity measures. Across PIMA obesity and glucose and NHANES smoking-history experiments, each distilled student was within 0.011 absolute utility of its teacher, with allocation Jaccard similarities of 0.738-0.937. K-means and causal-tree policies were also competitive, with the highest point-estimate policy varying by application. Prespecified paired comparisons were nonsignificant after Holm adjustment, while near-budget-boundary agreement was less stable than global fidelity for some teacher-student pairs. Findings support causal distillation for translating flexible effect models into simpler budgeted targeting rules, although observational estimates depend on causal-identification assumptions and require longitudinal or prospective validation.

0.19

Proximal Causal Learning under Unmeasured Confounding

cs.LG ·2026-10-03 ·Ying Tang, Yi Wang
similarity 0.66
Abstract · 14 pages,4 figures

Estimating treatment effects from observational data typically relies on the No Unmeasured Confounding Assumption (NUCA), which rarely holds in practice. Proximal causal learning (PCL) addresses unmeasured confounding via proxy variables, yet existing methods require the proxy variables to be pre-specified. Thus, we propose PCL-U, a framework that learns proxy variables directly from observed covariates. PCL-U uses neural encoders to decompose covariates into treatment-inducing, outcome-inducing, and shared proxies, guided by minimax mutual information objectives, and obtains causal estimates through a practical moment-based risk function. Experiments on benchmarks show that PCL-U matches or outperforms existing baselines. Besides, there are two types of synthetic datasets with varying dimensions and confounding strengths that illustrate that our method maintains stable estimation accuracy.

0.14

Causal Foundation Models

cs.LG stat.ML ·2026-09-02 ·Christopher Stith, Hossein Rahmani, Jesse C. Cresswell
code/data similarity 0.64
Abstract · Code is available at https://github.com/layer6ai-labs/cfms

Causal inference is the practice of estimating the effect of a treatment or intervention from data. It traditionally requires a bespoke pipeline for every new problem: first proposing a causal mechanism, selecting a compatible estimator, and finally training it. Meanwhile, across diverse settings and modalities, much of machine learning has shifted to the paradigm of foundation models: networks pretrained once at scale and applied to new tasks without fine-tuning. Causal foundation models (CFMs) bring this paradigm to causal inference. CFMs are pretrained neural networks that estimate causal quantities, such as the average treatment effect, on entirely new datasets using in-context learning without requiring model updates. This work provides a practical introduction to this emerging area. We summarize the necessary background in causal inference and machine learning before discussing CFMs. Throughout, we include example code and Jupyter notebooks.

0.47

Proximal Balancing for Causal Effect Estimation under Unmeasured Confounding

cs.LG stat.MLstat.ME ·2026-09-30 ·Yonghan Jung
code/data similarity 0.64
Abstract · 59 pages. Code: https://github.com/CausalDataScience/proximal-balancing

Estimating causal effects from observational data is central to science and policy, but the effects are not identified when confounders are unmeasured. Proximal causal inference addresses this problem with proxies of the unmeasured confounders. However, existing proxy-based approaches either designate proxy roles and solve an inverse problem, which is ill-posed and hard to estimate with high-dimensional proxies, or use a latent-variable model, which assumes that the learned latent variable matches the hidden confounder and leaves bias when it does not. To address these challenges, we introduce proximal balancing. It carries the classical idea of covariate balancing to confounders that are observed only through proxies: it learns a low-dimensional summary of the covariates and proxies that makes the treatment groups comparable, and then adjusts for this summary. It needs no designated proxy roles, inverse problem, or latent model. We give identification theory, finite-sample guarantees, and a practical algorithm, PROBE. We demonstrate the method on low-dimensional, high-dimensional, and image proxies and on real-world data.

0.33

Data-informed Adaptation of Foundation Models for Causal Effect Estimation

cs.LG cs.AI ·2026-11-08 ·Chunwei Ma, Russell D Wolfinger
benchmark similarity 0.62
Abstract · Preprint

Due to the fundamental problem of causal inference -- the impossibility of observing counterfactual outcomes -- there is always a gap between the training goal (outcome, propensity) and the inference target (CATE, ATE). Traditional causal effect estimation revolves around setting assumptions, selecting identification strategies, and choosing causal estimators, while more recently, Causal Foundation Models (CFMs), built on Prior-Data-Fitted Networks (PFNs), ease this process by pretraining on massive synthetic prior datasets. Despite their success, such amortization makes causal inference less transparent, obscuring which assumptions the model implicitly relies on for a given dataset. The high diversity of real-world data-generating processes (DGPs) and Structural Causal Models (SCMs) makes it hard to know, a priori, which causal inference strategy is compatible with a given dataset. In this work, we focus on this compatibility between an observational dataset and method-specific assumptions, and find that geometric characteristics of data embeddings -- specifically, the variogram -- provide a useful signal of whether a given causal estimation strategy is appropriate. We develop MoE-Learner, a mixture-of-causal-experts framework that embeds a dataset under multiple assumption-specific views and uses the variogram as a counterfactual-free router to assess each expert's validity. Rather than eliminating causal assumptions, this shifts their validation from a fixed, a priori choice to a criterion that can be checked directly from data geometry. MoE-Learner achieves the best average rank on benchmark datasets (IHDP, ACIC, Lalonde). Being orthogonal to (causal) foundation models, our method builds a bridge from data characteristics to causal estimation strategy rather than proposing another CFM.

0.06

An End-to-End Pipeline for Causal ML with Continuous Treatments: An Application to Financial Decision Making

cs.LG stat.MEstat.APstat.ML ·2026-09-24 ·Javier Moral Hernández, Clara Higuera-Cabañes, Álvaro Ibraín
publishedcode/data similarity 0.62
Abstract · Oral presentation at the 3rd Workshop on Causal Inference and Machine Learning in Practice, KDD 2025, Toronto. Code: https://github.com/javi…

This paper presents an end-to-end causal machine learning (ML) pipeline designed for real-world applications with continuous treatments. The proposed framework consists of six sequential steps: dimensionality reduction, causal identification, positivity assumption violation handling, estimation, refutation and evaluation, and policy optimization. We introduce practical contributions not currently available in existing causal ML toolkits, specifically: (1) a method for detecting and quantifying positivity violations in continuous treatment settings (2) a novel, scalable two-stage dimensionality reduction framework tailored for causal inference with high-dimensional data; (3) the adaptation of sensitivity analysis and estimation methods originally designed for binary treatments to the continuous treatment space and (4) an end-to-end integration of these components into a modular, reproducible workflow. These innovations address real-world challenges in causal inference that are often not covered in theoretical frameworks but frequently encountered in industrial applications. The methodology is validated with a synthetic dataset inspired in a real-world financial debt collection use case, however its design can be applied to analogous problems across different industries. Results demonstrate that the proposed methodology offers a more computationally efficient approach and produces less biased estimates compared to standard methods for problems with continuous treatment and high-dimensional data. A fully functional GitHub repository with documented code and numbered notebooks is made available ensuring reproducibility and practical implementation. The pipeline presented is intended to contribute to closing the gap between academic approaches and practical application in industry contexts where causal ML can be highly beneficial such as the financial sector.

0.60