CS Paper Radar

Sample Dependence-Aware Blind Source Separation for Linear Causal Discovery

Cihan Eralp Kumbasar, Emin Erdem Kumbasar, Tulay Adali

eess.SP ·submitted 2026-10-05 16:34 UTC · v1

Abstract

Causal discovery seeks to determine directional relationships among variables in complex systems, yet observational data alone generally do not identify causal direction. Complete identification therefore requires assumptions beyond linearity and acyclicity. A key approach is the Linear Non-Gaussian Acyclic Model (LiNGAM), which formulates linear structural equation model estimation as a blind source separation (BSS) problem. LiNGAM treats disturbances as mutually independent random variables under independent sampling, relying on higher-order statistics (HOS) and non-Gaussianity for identifiability. This restricts identifiability when multiple disturbances are Gaussian and ignores potentially informative temporal dependence. To broaden causal identifiability, we formulate linear acyclic causal discovery with mutually independent disturbance processes and transfer established BSS identification conditions to causal structure recovery. Under this formulation, replacing the mutual information cost with mutual information rate enables identification under a broader class of disturbances, including Gaussian processes with nonproportional covariance functions. Synthetic experiments reveal the limitations of methods relying solely on HOS or sample dependence, while their joint exploitation provides near-perfect causal recovery across the tested disturbance settings. Experiments on real functional magnetic resonance imaging (fMRI) data further demonstrate that jointly exploiting HOS and sample dependence improves the bootstrap stability of estimated ancestral directionality.

Comment
5 pages, 2 figures. Submitted to the 2027 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Closest papers

Nearest neighbours by meaning across the whole index.

The Statistical Cost of Causal Discovery with Feedback

cs.LG stat.ML ·2026-09-28 ·Sunmin Oh, Seungsu Han, Gunwoong Park
similarity 0.67
Abstract

What determines the unavoidable sample cost of learning cyclic causal structure? For cyclic linear non-Gaussian models, we study exact condensation recovery from observational data: identifying the strongly connected component (SCC) partition and all edges between components. We establish the first information-theoretic lower bounds on sample complexity for this target. For $p$ variables, maximum SCC size $s_{\max}$, and maximum external-parent count $d_B$, any estimator requires order $s_{\max}\log(ep/s_{\max})+d_B\log(ep/d_B)$ samples in the worst case over a regular model class. These bounds distinguish the costs of SCC membership and external-parent selection. Under principal invertibility and without correlation faithfulness, we establish a population block-exogeneity principle that identifies unknown root SCCs through residual independence and inclusion minimality. A sparse-adjustment characterization shows that small adjustment sets suffice to identify SCCs and their direct external parents, without regressing on all previously recovered variables. These characterizations yield BlockExo, which attains a structurally matching sample bound without knowing $s_{\max}$ or $d_B$ under suitable conditions. Simulations support the structural dependence of our sample bound and demonstrate BlockExo's sample-efficient recovery in comparisons with other methods for cyclic causal discovery.

0.26

Causal Discovery beyond Conditional Independence: Identifiability, Algorithms, and Statistical Inference for Directed Acyclic and Cyclic Graphs

cs.LG stat.MEstat.ML ·2026-10-16 ·Yang Ni
similarity 0.67
Abstract

Learning causal structure from data requires assumptions about mechanisms, noises, observation schemes, and interventions. Historically, causal discovery has relied primarily on conditional independence. This review focuses on modern causal discovery methods that exploit properties of distributions beyond conditional independence. Our organizing principle separates the source of identification from the statistical estimator and its computational implementation. This perspective connects conditional-independence methods with distributional asymmetries, conditional-moment restrictions, and variation across environments or individuals. We examine discovery under latent confounding and feedback, distinguishing causal information about observed variables from reconstruction of latent structure and emphasizing the additional semantics required by cyclic models. We also distinguish population identification, frequentist and Bayesian consistency, uncertainty quantification, and algorithmic guarantees. Throughout, examples show why the same observational distribution can support different conclusions under different model classes. We conclude with guidance for comparing methods at their identifiable targets and a research agenda for uncertainty, heterogeneous populations, non-scalar variables, and the intersection of discrete data, feedback, and hidden confounding.

0.07

Generalizing Identifiability Results in Causal Discovery from Complete Data to Missing Data Settings

cs.AI stat.MLcs.LGstat.ME ·2026-10-13 ·Matteo Ceriscioli, Shohei Shimizu, Mallika Gupta, Karthika Mohan
similarity 0.64
Abstract

While causal discovery methods have matured for complete data, such algorithms for handling missing values remain limited. We establish general sufficient conditions under which causal graphs remain identifiable (i.e., uniquely determined from the available data distribution) under various missingness categories, including Missing Not At Random, and provide a framework to extend correctness guarantees from causal discovery algorithms for complete data to missing data settings. Our results show that identifiability of causal graphs with no unobserved confounders is preserved when (1) missingness mechanisms do not causally interact, (2) no variable directly causes its own missingness, and (3) either faithfulness holds for missingness mechanisms, or they follow generalized linear models. Guided by these theoretical results, we introduce two asymptotically correct algorithms for Additive Noise Models (ANMs) that recover the underlying causal graph and provide consistent parameter estimates.

0.09

Causal Discovery for Linear Models with Latent Confounding via Multi-domain Identifiable Representation Learning

cs.LG cs.AI ·2026-10-20 ·Danru Xu, Aapo Hyvärinen, Sara Magliacane
similarity 0.64
Abstract · 29 pages, 6 figures

Causal discovery with latent confounding is particularly challenging, but a common setting in real-world data. In this work, we focus on linear causal models with latent confounding, represented by acyclic directed mixed graphs (ADMGs). Existing methods that fully identify ADMGs typically assume non-Gaussianity or graphical constraints, such as bow-freeness. In contrast, we propose Linear ADMG Learning (LinADMG), a framework for learning ADMGs for linear causal models through identifiable representation learning. Rather than relying on non-Gaussianity or bow-freeness, LinADMG leverages multi-domain settings to identify the noise variables. We show that the identifiability of the noise variables is sufficient for recovering all direct causal relations, and that, under an additional latent-confounding no-cancellation condition, LinADMG can identify the whole ADMG. We implement LinADMG with four identifiable representation learning approaches from the literature and validate the methods on simulated and semisynthetic datasets.

0.30

NOTREKS: Marginal Independence in Score-based Structure Learning

cs.LG stat.MLstat.ME ·2026-11-18 ·Fabian Bleile, Sarah Lumpp, Mathias Drton
similarity 0.62
Abstract

Score-based structure learning estimates causal graphs by optimizing a data-dependent objective over structural equation models. We study how prior knowledge that selected pairs of variables are marginally independent can be incorporated into such causal discovery methods. Under faithfulness, marginally independent pairs cannot be connected by a trek, so the knowledge becomes a graphical no-trek constraint, which we call NOTREKS information. We introduce a power-series trek (PSTrek) penalty for gradient-based optimization and a trek constraint for order-based search, and we analyze why such information helps in finite samples and how it restricts the search space. Our numerical experiments illustrate to what extent NOTREKS information helps in causal discovery. In particular, using synthetic benchmarks with oracle NOTREKS information, we show that these constraints can improve both structural recovery and adjustment-based effect identification.

0.16

Symmetries and Causality: Causal Effect Identification Beyond IID Data

cs.AI math.ST ·2026-09-03 ·Martin Rabel, Jakob Runge
similarity 0.62
Abstract

We develop theory for the identification of complex causal queries from non-IID data. We propose a formal description of stochastic systems based on symmetries in data leaving causal mechanisms invariant. These symmetries become the source of statistical repetition for identification and mandate knowledge-transfer from observations to queries. The result is an abstract, simple and very general language for causal reasoning. We give descriptions of models and queries, and the formal infrastructure for their mathematically rigorous identification. The proposed structure enables a number of simplifying principles: A shared description of mechanisms and interventions, a duality of observed and queried structure, and the sub-division of the identification task into three steps - extraction, computation and query-expression. Our approach reproduces and matches standard theoretical results on IID data and transport of experimental and non-experimental data. By design, it additionally applies beyond IID data and captures complex causal queries not expressible via do- or soft-interventions.

0.37

Beyond Stationarity in Time Series: Discovering Causal Structures and Latent Regimes via Markov Blankets

cs.LG cs.AI ·2026-09-04 ·Lei Zan, Charles K. Assaad, Emilie Devijver, Eric Gaussier
similarity 0.61
Abstract · Accepted at the 11th AALTD Workshop at ECML PKDD 2026, Naples, Italy

This paper introduces Regime-aware Constraint-Based and Noise-Based causal discovery with Markov Blankets (RCBNB-MB), a novel causal discovery algorithm for time series that relaxes the common assumption of a single, time-consistent causal structure. Time series are typically observed at discrete time points and often exhibit regime changes that challenge the assumption of a static causal structure, a limitation in many real-world dynamic systems. To address this challenge, RCBNB-MB identifies latent causal regimes, defined as subsets of time points within which a stable causal structure holds. The algorithm follows an iterative strategy that segments the time series into regimes and discovers the causal graph within each regime. By leveraging the Markov blanket rather than direct parents, RCBNB-MB gains robustness to errors in causal discovery and preserves predictive information. We provide theoretical guarantees for RCBNB-MB's ability to recover both regime transitions and causal graphs under reasonable assumptions. Furthermore, we validate its effectiveness through extensive experiments on simulated datasets with known ground truth and real-world IT monitoring data, where taking into account regime shifts is critical. Empirical results show that RCBNB-MB systematically outperforms baseline approaches in accurately detecting regime changes and their associated causal graphs, positioning it as a robust and versatile framework for non-stationary time series analysis.

0.20

Decoupled Causal Discovery

cs.LG stat.ML ·2026-09-20 ·Zhengkang Guan, Fei Wu, Kun Kuang
similarity 0.61
Abstract · 24 pages

Causal discovery from observational data is a fundamental yet challenging task in scientific research. While existing approaches are primarily based on conditional independence tests, structure scores, or restrictive functional assumptions, we propose Decoupled Causal Discovery (DCD), a novel decoupling-based perspective that does not rely on these methodologies. DCD directly identifies the Markov boundary (MB) by decoupling non-target variables via weighting functions, such that only variables within the MB preserve dependence with the target under the decoupled distribution. Building on this, DCD iteratively constructs the Completed Partially Directed Acyclic Graph (CPDAG) by exploiting structural asymmetries within the MBs. We establish the theoretical identifiability, soundness, and completeness of DCD. Empirical evaluations demonstrate that DCD achieves strong performance, particularly excelling in challenging noise regimes.

0.24