CS Paper Radar

Balancing Partition Forest for Causal Weighting

Felipe Angelim, Alessandro Leite

cs.LG stat.ME ·submitted 2026-11-17 21:25 UTC · v1

Abstract

Balancing weights are used in observational causal inference to construct a population in which the treatment is independent of observed pretreatment covariates. The ideal weight is the ratio between the product of the covariate and treatment marginals and their joint distribution, for binary and continuous treatments alike. We propose Balancing Partition Tree (BPT) and Balancing Partition Forest (BPF), which estimate this ratio on a learned rectangular partition of covariate--treatment space. Each split maximizes the gain in a Bregman divergence computed from joint and marginal counts. Two choices of divergence yield criteria that maximize the mutual information captured by the partition or reduce the squared error of the weights. We show that the population residual of either criterion bounds the bias of inverse-probability-weighted and doubly robust response estimators that use the population partition weights. Across 17 synthetic and semi-synthetic settings and three response estimators, BPF obtains the lowest mean RMSE rank among seven weight estimators, and a single tree fits in 0.14 seconds on 16,512 observations.

Closest papers

Nearest neighbours by meaning across the whole index.

Explaining Heterogeneous Treatment Effects with Causal Forests and the Hoeffding Functional Decomposition

cs.LG stat.ML ·2026-10-12 ·Gaëtan Patinier, Clément Bénard, Margaux Törnqvist
similarity 0.70
Abstract

The estimation of heterogeneous treatment effects is a central objective of causal inference. However, state-of-the-art algorithms to solve this task are based on machine learning principles, and thus behave as black boxes. Consequently, the identification of covariates driving heterogeneity remains a challenging and open problem. To address this limitation, we introduce CausalTreeHFD, an interpretable extension of causal forests, based on the Hoeffding functional decomposition adapted to tree ensembles. Our approach decomposes predictions of conditional average treatment effects (CATE) into contributions from individual covariates and pairwise interactions, providing a direct characterization of the factors driving treatment effect heterogeneity. We establish the consistency of CausalTreeHFD, which converges towards the Hoeffding decomposition of the underlying CATE function, under standard assumptions for the analysis of causal forests. Experiments on simulated and real datasets show that CausalTreeHFD accurately identifies relevant covariates and interactions, and precisely recovers their contributions to heterogeneous treatment effects.

0.09

Splitting the Difference: Interpretable Causal Forests for Treatment Effect Heterogeneity and Bias

cs.LG stat.ML ·2026-09-15 ·Nicolas Alexander Ihlo, Merle Behr
similarity 0.64
Abstract

In various fields, such as medicine and marketing, accurately predicting individual treatment effects holds significant promise. However, achieving reliable predictions alone is often insufficient for making informed decisions; it is equally important to understand why the treatment effect is higher for some individuals than for others. To address this two-fold challenge of prediction and interpretation, we introduce an algorithm based on decision trees and random forests for estimating individual treatment effects. Our algorithm is simple: it operates exactly like a standard random forest, but with a different splitting criterion, and requires no additional workarounds such as double machine learning or orthogonalization as used in Generalized random forests. It handles observational studies with varying treatment propensities without requiring separate estimation of the full propensity function. This is achieved by combining two splitting criteria---one targeting heterogeneity in the treatment effect, the other targeting bias correction for the average treatment effect---which together improve split point selection and automatically distinguish confounders from features responsible for heterogeneity. As a result, interpretation follows directly from the fitted tree structure itself, that is, from which features the trees split on and with which split statistics, without requiring separate post-hoc analysis. For the theoretical analysis of this algorithm, we consider a change point model with step functions for potential outcomes and treatment propensity and provide insights into the theoretical underpinnings of our approach. Simulation studies show that our simple algorithm achieves comparable, and often better, prediction accuracy than existing methods, while substantially improving interpretability.

0.31

Proximal Balancing for Causal Effect Estimation under Unmeasured Confounding

cs.LG stat.MLstat.ME ·2026-09-30 ·Yonghan Jung
code/data similarity 0.63
Abstract · 59 pages. Code: https://github.com/CausalDataScience/proximal-balancing

Estimating causal effects from observational data is central to science and policy, but the effects are not identified when confounders are unmeasured. Proximal causal inference addresses this problem with proxies of the unmeasured confounders. However, existing proxy-based approaches either designate proxy roles and solve an inverse problem, which is ill-posed and hard to estimate with high-dimensional proxies, or use a latent-variable model, which assumes that the learned latent variable matches the hidden confounder and leaves bias when it does not. To address these challenges, we introduce proximal balancing. It carries the classical idea of covariate balancing to confounders that are observed only through proxies: it learns a low-dimensional summary of the covariates and proxies that makes the treatment groups comparable, and then adjusts for this summary. It needs no designated proxy roles, inverse problem, or latent model. We give identification theory, finite-sample guarantees, and a practical algorithm, PROBE. We demonstrate the method on low-dimensional, high-dimensional, and image proxies and on real-world data.

0.33

Conditional Average Treatment Effect Distillation for Hypothetical State-Intervention Targeting Under Budget Constraints

cs.LG ·2026-10-19 ·Vasundhara Acharya, Bülent Yener
similarity 0.61
Abstract · Under review at PLOS ONE

Personalized public-health targeting must capture heterogeneous intervention benefits while remaining interpretable under resource constraints. Flexible causal-effect models can be hard to operationalize, while coarse subgroup policies may lose individualized effect information. We study budget-constrained hypothetical state interventions in observational data without a logged historical decision policy. For obesity, elevated glucose, and lifetime smoking-history states, causal-structure-informed pretreatment covariates are prespecified, with capacity capped at 70% of those observed in the adverse state. We evaluate causal distillation where Causal Forest and Bayesian Causal Forest teachers estimate conditional average treatment effects (CATEs), which decision tree and random forest students approximate. We compare individualized policies with unsupervised K-means subgroup policies and supervised causal-tree policies with leaf counts matched to K-means cluster counts. Observational policies are assessed on held-out data using a doubly robust estimator, bootstrap uncertainty, and decision-focused teacher-student fidelity measures. Across PIMA obesity and glucose and NHANES smoking-history experiments, each distilled student was within 0.011 absolute utility of its teacher, with allocation Jaccard similarities of 0.738-0.937. K-means and causal-tree policies were also competitive, with the highest point-estimate policy varying by application. Prespecified paired comparisons were nonsignificant after Holm adjustment, while near-budget-boundary agreement was less stable than global fidelity for some teacher-student pairs. Findings support causal distillation for translating flexible effect models into simpler budgeted targeting rules, although observational estimates depend on causal-identification assumptions and require longitudinal or prospective validation.

0.19

Proximal Causal Learning under Unmeasured Confounding

cs.LG ·2026-10-03 ·Ying Tang, Yi Wang
similarity 0.59
Abstract · 14 pages,4 figures

Estimating treatment effects from observational data typically relies on the No Unmeasured Confounding Assumption (NUCA), which rarely holds in practice. Proximal causal learning (PCL) addresses unmeasured confounding via proxy variables, yet existing methods require the proxy variables to be pre-specified. Thus, we propose PCL-U, a framework that learns proxy variables directly from observed covariates. PCL-U uses neural encoders to decompose covariates into treatment-inducing, outcome-inducing, and shared proxies, guided by minimax mutual information objectives, and obtains causal estimates through a practical moment-based risk function. Experiments on benchmarks show that PCL-U matches or outperforms existing baselines. Besides, there are two types of synthetic datasets with varying dimensions and confounding strengths that illustrate that our method maintains stable estimation accuracy.

0.14

Weighted Spline-Expanded Networks with Distributional Balancing for Continuous Treatment Effects

cs.LG stat.ML ·2026-09-27 ·Shucheng Liu, Chan Park, Guanhua Chen
similarity 0.59
Abstract

Estimating causal effects with continuous treatments in observational studies is challenging due to confounding, model misspecification, and high-dimensional covariates. We propose the Weighted Spline-Expanded Network (WSENet), an end-to-end neural framework that addresses these challenges by combining covariate balancing, structured treatment embedding, and bias-corrected outcome estimation. WSENet first applies Distance Covariate Optimal Weights to induce distributional independence between covariates and treatment without relying on parametric models. It then learns the conditional outcome via a structured network that fuses outcome-relevant representations of covariates with a spline-expanded treatment input, enabling smooth and flexible modeling of the dose-response relationship. To mitigate residual bias, we introduce Weighted Targeted Regularization, a correction technique based on efficient influence functions that yields a doubly robust estimator. Extensive evaluations on semi-synthetic and real-world datasets, including high-dimensional genomic and environmental health data, demonstrate that WSENet consistently outperforms existing baselines in both accuracy and stability.

0.15

Bayesian Causal Forests for Zero-Inflated Continuous Outcomes

cs.LG stat.MLstat.ME ·2026-10-08 ·Hugo Gobato Souto, Eric Wang, Igor Shuryak
benchmark similarity 0.59
Abstract

Estimating (heterogeneous) treatment effects is still challenging when the outcome is semicontinuous (i.e., exhibiting both a discrete point mass at zero and a skewed continuous distribution for positive values), despite the strong presence of this data type in real world settings. Existing methods either ignore the zero mass, impose fragile parametric assumptions, or suffer from extreme computational costs and data augmentation noise. This paper proposes Zero-Inflated Continuous Bayesian Causal Forests with Duan's Smearing (ZIC-BCF-Smear), a decoupled two-part nonparametric estimator that fits a Probit BCF on the full sample to model participation and a Gaussian BCF strictly on the active subpopulation to model positive intensity. Subpopulation Propensity Adjustment (SPA) mitigates regularization-induced confounding within the active subpopulation, and Duan's non-parametric smearing estimator re-transforms predictions to the response scale, bypassing the fragile scale multipliers of parametric models. A comprehensive simulation benchmark shows that ZIC-BCF-Smear matches well-specified parametric models without their assumptions and remains stable and calibrated where competitors either diverge or pathologically over-cover for nonlinear data. The method is then applied to individual-participant data from the SPECTRUM randomized phase III head-and-neck cancer trial, estimating the causal effect of assignment to panitumumab plus chemotherapy on the number of days patients spend with severe toxicity, an outcome for which a quarter of patients contribute an exact zero. Panitumumab assignment raises that burden by about ten days per patient under the trial's own differential treatment duration, and the decoupled structure localizes the effect mainly in the positive-intensity part rather than in whether the reconstructed severe-AE burden is positive.

0.38

Representation Learning for Sample-Efficient CATE Estimation by Leveraging Multiple Outcomes

cs.LG ·2026-09-05 ·Maitreyi Swaroop, Shikha Bhat, Samantha Rodriguez, Tamar Krishnamurti, Bryan Wilder
theory similarity 0.58
Abstract

Estimating conditional average treatment effects (CATE) enables efficient targeting of interventions, but many applications have limited experimental samples, making it difficult to estimate heterogeneous effects from high-dimensional covariates. In such settings, policymakers and medical practitioners often succumb to the curse of dimensionality or apply off-the-shelf dimension reduction methods that may not preserve treatment heterogeneity. Yet these domains often come with large historical datasets measuring a wide range of outcomes -- a source of supervision that is rarely exploited in practice. Following causal representation learning, we hypothesize that such domains with high-dimensional covariates have lower-dimensional underlying dynamics. We can thus leverage the diverse outcomes measured in historical data to learn a lower-dimensional representation of the covariates. Theoretically, we prove that when the auxiliary outcomes satisfy a set of surrogacy conditions and the representation retains relevant covariate information, the original CATE is identified when the high-dimensional covariates are replaced by the learned representation. Combined with existing dimension-dependent rates for CATE estimation, the result implies greater sample-efficiency on the same experimental sample. Additionally, we characterize the bias-variance tradeoff when the assumptions do not hold perfectly, and show that the representation-based estimator can still achieve lower error when the reduction in estimator variance outweighs the bias due to compression. Empirically, we evaluate the method on synthetic data and semi-synthetic medical data.

0.21