CS Paper Radar

Outstrumental Variable Regression

Felix Schur, Linus Kühne, Julius von Kügelgen, Jonas Peters

cs.AI stat.MLcs.LGstat.ME ·submitted 2026-10-30 18:47 UTC · v1
theory

Abstract

Estimating the causal effect of a treatment $X$ on an outcome $Y$ from observational data in the presence of unobserved confounding requires additional structure or assumptions. Existing identification strategies such as instrumental variable regression exploit exogenous variation in only the treatment. We show that the causal effect can also be identified if the outcome mechanism varies across a finite set of environments, even if the treatment distribution is unchanged. Concretely, we introduce Outstrumental Variable Regression (OVR), which proceeds in three steps: (i) compute the conditional expectation of $Y$ given $X$ in each environment; (ii) form the vector of differences in these conditional expectations between all environments and a reference environment (we call this vector contrast); and (iii) regress $Y$ on $X$ while adjusting for the contrast and environment. We prove that this yields the true causal effect if the following two conditions hold: inclusion restriction, i.e., the contrast determines the conditional confounding bias; and positivity, i.e., the treatment varies sufficiently strongly after adjustment. We prove that a finite-sample version of OVR is consistent under regularity conditions and demonstrate the procedure's effectiveness on synthetic and real-world data.

Closest papers

Nearest neighbours by meaning across the whole index.

Sharp Bounds on Continuous Treatment Effects under Unobserved Confounding

cs.LG math.ST ·2026-10-23 ·Junzhe Zhang
similarity 0.66
Abstract

We study partial identification of conditional treatment effects with a continuous treatment under unobserved confounding. We target the conditional average potential outcome (CAPO) E[Y_x|z] and the conditional average treatment effect (CATE) between two treatment levels. We assume a bounded outcome and Lipschitz continuity of the response functions and of the propensity scores given the latent confounder, and show that these conditions imply the smooth treatment response and smooth treatment selection conditions of Kim et al. (2018). The combined bound of Kim et al. uses only two reference points on the identified diagonal and is generally loose. Bounding through every diagonal reference point instead gives explicit bounds whose average is the sharp identified set of the CAPO at every treatment, inside or outside the observational support. Capping the difference between the upper and lower bounds gives sharp causal bounds on the CATE. These bounds are informative without monotonicity or overlap assumptions.

0.28

Backtracking Direct, Indirect and Total Effects

cs.LG stat.MEstat.ML ·2026-10-20 ·Jose M. Peña
similarity 0.60
Abstract

Natural direct and indirect effects are defined through cross-world interventional counterfactuals. We propose an alternative construction based on backtracking counterfactuals. Rather than intervening on the treatment or mediator and change the structural equations, we use a backtracking conditional distribution to construct an alternative exogenous state satisfying a desired treatment-mediator constraint and then evaluate the unchanged structural equations on that state. This yields the backtracking direct and indirect effects, and also the backtracking total effect. Likewise, we adapt the population intervention effects.

0.25

Average versus expected causal effects under interference: Modeling assumptions and estimation bottlenecks

cs.LG stat.MEecon.EM ·2026-11-09 ·Vishesh Karwa, Edoardo M. Airoldi, Donald B. Rubin
similarity 0.59
Abstract · 42 pages, 4 figures, 30-page appendix

Causal inference under treatment interference requires assumptions to reduce the exponentially large number of potential outcomes. We develop hierarchical finite-population models for potential outcomes by separating these assumptions into three layers: interference neighborhoods, exposure mappings, and outcome models. Given an interference neighborhood and exposure mapping, we show that potential outcomes admit a nonparametric decomposition into direct, spillover, and treatment--spillover interaction components. This decomposition provides a common coordinate system for nonparametric, semiparametric, and parametric models of finite-population potential outcomes. For a given potential-outcome model, we define two classes of estimands. Average causal effects (ACEs), such as direct and total treatment effects, contrast potential outcomes under fixed treatment--exposure conditions. Expected causal effects (ECEs), such as expected direct and indirect effects, contrast expectations of potential outcomes under a specified allocation policy. For both classes, we bound the variance of the canonical Horvitz--Thompson estimator by three terms: a diagonal weight term, a term from overlapping interference neighborhoods, and a residual design-dependence term. Our upper and lower bounds show that under graph-unaware designs, nonparametric design-unbiased estimation of ACEs can require sample sizes growing exponentially in the interference degree, whereas polynomial growth can suffice for design-aligned ECEs. Under neighborhood interference, we construct graph-aware independent-set designs with variance bounds polynomial in the maximum degree for direct and total treatment effects on every graph, whereas graph cluster randomization can incur worst-case variance exponential in the degree.

0.28

Foundation Models for Partial Causal Identification

cs.AI ·2026-08-21 ·Alexis Bellot, Anish Dhir
similarity 0.59
Abstract

This paper investigates the development of causal foundation models for bounding the effect of interventions and counterfactuals from observational data. We show that a canonical prior can be defined with full support over the space of structural causal models with discrete observables. With this canonical prior, we translate the problem of bounding counterfactuals into that of learning distributions over functions that map data (and possibly structural assumptions) to a causal query of interest. This extends the promising causal foundational modelling paradigm to the estimation of partially-identifiable causal effects, i.e., under unobserved confounding, where multiple values are equally compatible with the observed data and prior structural assumptions.

0.44

Transporting the Past: An Optimal Transport View of Backtracking Counterfactuals

cs.AI cs.LG ·2026-11-05 ·Zhangyi Liu, Pouria Fatemi, Suvrit Sra
similarity 0.58
Abstract

We study backtracking counterfactual inference for Structural Causal Models (SCMs) through the lens of optimal transport. In SCMs, a factual observation generally induces a posterior distribution over exogenous variables, making counterfactual inference inherently distributional. We introduce two complementary frameworks that transport this posterior onto the set of exogenous configurations satisfying a desired counterfactual query. The first constructs a natural pointwise projection and is suitable when the transported exogenous distribution can be used directly. The second enforces mutual independence among counterfactual exogenous variables, so that the transported variables remain interpretable as genuine exogenous noises of the same SCM. We show that both frameworks are consistent with the original backtracking counterfactual principle, and we propose marginal, penalty-based, and hard-constrained solvers for finite-posterior settings. Synthetic experiments on non-bijective SCMs illustrate the geometry of the problem and reveal trade-offs among transport cost, counterfactual constraint satisfaction, and preservation of exogenous independence.

0.18

Proximal Balancing for Causal Effect Estimation under Unmeasured Confounding

cs.LG stat.MLstat.ME ·2026-09-30 ·Yonghan Jung
code/data similarity 0.57
Abstract · 59 pages. Code: https://github.com/CausalDataScience/proximal-balancing

Estimating causal effects from observational data is central to science and policy, but the effects are not identified when confounders are unmeasured. Proximal causal inference addresses this problem with proxies of the unmeasured confounders. However, existing proxy-based approaches either designate proxy roles and solve an inverse problem, which is ill-posed and hard to estimate with high-dimensional proxies, or use a latent-variable model, which assumes that the learned latent variable matches the hidden confounder and leaves bias when it does not. To address these challenges, we introduce proximal balancing. It carries the classical idea of covariate balancing to confounders that are observed only through proxies: it learns a low-dimensional summary of the covariates and proxies that makes the treatment groups comparable, and then adjusts for this summary. It needs no designated proxy roles, inverse problem, or latent model. We give identification theory, finite-sample guarantees, and a practical algorithm, PROBE. We demonstrate the method on low-dimensional, high-dimensional, and image proxies and on real-world data.

0.33

Forecasting Associations, Not Interventions: A Preregistered Causal Audit of Covariate-Aware Time Series Foundation Models

cs.LG ·2026-10-22 ·Zong-Han Bai
benchmark similarity 0.56
Abstract · 21 pages, 11 figures, 12 tables

Covariate-aware time series foundation models (TSFMs) accept a future path for a control variable and return a forecast, inviting what-if queries. The query is interventional; the models are trained on observational data. We determine whether their answers are the conditional slope $\partial E[Y|X]$ or the interventional effect $\partial E[Y|do(X)]$, at three levels. Theory: a Bayes-optimal observational predictor answers interventional queries associationally unless the adjustment set is available and used; for in-context least squares we derive the resulting confounding gap -- a model's effect estimate under an observational minus under a randomized context -- in closed form, a parameter-free reference line. Behaviour: on a preregistered grid with exact counterfactual ground truth, Chronos-2, TiRex-2, TabPFN-TS and TimesFM-2.5 all track this line ($R^2$ 0.90-1.00) and respond more confounded than regression itself (slopes 1.3-1.8), on linear and nonlinear structural models. Pairs of models with identical observational laws prove this is not an identifiability limit: when the effect is identifiable, least squares recovers 100% of the true effect difference, Chronos-2 75%, TiRex-2 34%. Representation: linear probes decode the data-generating regime (94-96%) and the true effect ($R^2$ 0.7-0.9) from embeddings that the forecasts ignore. On two physical systems with randomized actuators, pretrained models under-respond by 2-5x and ignore in-window confounding. Minutes of interventional post-training on 3,000 synthetic series cut the gap by up to 83% and transfer outside the training prior. Its forecasting cost is a replay-distribution effect: replaying the model's own pretraining prior cuts it from +47% to +10% MASE, and with low-rank adaptation yields a recipe meeting the preregistered criterion over three seeds (52-61% gap reduction at +1-3% cost) while improving the DoTime benchmark.

0.30

Causal Inference with Unobserved Confounding: A Mixture Learning Perspective

cs.LG eess.SPstat.CO ·2026-09-19 ·Mansi Sood, Devavrat Shah
similarity 0.55
Abstract

Unobserved confounding is a fundamental challenge in causal inference from observational data. This article develops a mixture-learning perspective, viewing latent confounders as sources of heterogeneity that induce mixture structure in observed data. Under suitable structural and identifiability assumptions, recovering the mixing distribution and component mechanisms enables estimation of interventional distributions and causal estimands. Using variants of Bernoulli mixtures as a running example, we contextualize mixture-learning techniques and their structural assumptions, and connect them to causal inference in panel-data settings, including latent factor models and synthetic interventions.We then consider high-dimensional exponential-family mixtures with dependent outcome trajectories, moving beyond counterfactual means to model counterfactual distributions. We situate this perspective relative to complementary approaches for unobserved confounding. Together, these ideas provide a bridge between mixture learning and causal inference, connecting recent advances in high-dimensional mixture learning to scalable identification and estimation of causal effects while raising new challenges for mixture learning.

0.11