CS Paper Radar

Beyond Gaussian Assumptions: Distribution-Aware Channel Capacity for Effective Connectivity

Jianan Jian, Jacob Kang, Nurahmed Multezem, Benjamin Li, Nan Xu

cs.LG q-bio.NC ·submitted 2026-09-26 16:51 UTC · v1

Abstract

Effective-connectivity estimation from brain signals often relies on Gaussian residual modeling, which enables tractable estimation but can discard informative distributional structure and distort inferred directed interactions when empirical residuals are non-Gaussian. We show across multiple modalities, species, and experimental conditions that both brain signals and fitted channel residuals frequently deviate from Gaussianity. We therefore introduce a distribution-aware, information-theoretic measure of effective connectivity based on channel capacity under general residual distributions. To estimate the resulting capacity from empirical, potentially non-Gaussian residuals, we develop a dual-flow min-max estimator based on normalizing flows, in which a generator searches over admissible input distributions under a power constraint while an observer estimates output entropy. We provide a theoretical characterization of the estimator, showing that the observer objective recovers differential entropy up to a KL approximation term, that the formulation reduces to classical Gaussian capacity as a special case, and that residual entropy can alter achievable information rates beyond variance; game-gap and error analyses further characterize optimization and approximation sources. In brain-like simulations with known directed connectivity, Dual-flow achieves the highest AUROC and AUPRC across ten conditions spanning diverse network topologies, hidden drivers, feedback, and heterogeneous hemodynamics, compared with Gaussian capacity, Granger causality, VAR-LiNGAM, and GIMME. Applied to multimodal brain signals, the method reveals time- and condition-resolved directed interactions consistent with known neurobiological circuitry. Together, these results establish a principled distribution-aware framework for effective-connectivity estimation beyond Gaussian residual modeling.

Comment
31 pages, 9 figures, 5 tables

Closest papers

Nearest neighbours by meaning across the whole index.

A Mathematical Framework for EEG Functional Connectivity: Taxonomy, Measure Relationships, Identifiability, and Analytical Bounds

eess.SP ·2026-10-17 ·Jerrin Thomas Panachakel
similarity 0.63
Abstract

Electroencephalographic (EEG) functional connectivity is quantified using diverse measures of statistical dependence, spectral coupling, phase synchronization, information transfer, directed interactions, cross-frequency coupling, and network topology. An important question is what can be inferred about one connectivity measure from another. This paper develops a mathematical framework that treats connectivity measures as mappings from an explicitly defined admissible state space to observable values. For a source measure and a target measure, the set of target values compatible with an observed source value is defined as a cross-connectivity attainable set. This formulation distinguishes exact determination, conditional determination using additional information, bounded inference, approximate identification, and non-identifiability. The framework is extended to multichannel connectivity matrices, graph measures, and dynamic connectivity. It also incorporates the influence of filtering, referencing, volume conduction, source leakage, inverse modeling, epoch duration, and estimator assumptions on admissible inferences. Analytical examples examine relationships between covariance and correlation, mutual information and correlation under joint Gaussianity, coherence and phase-locking value under restrictive signal conditions, and the general non-identifiability of the phase-lag index and weighted phase-lag index without additional assumptions. By making assumptions and attainable values explicit, the framework provides a systematic basis for determining what connectivity results can and cannot establish about other measures.

0.18

GRFBrain: Graph-Structured Rectified Flows for EEG Dynamic Modeling

cs.AI ·2026-09-29 ·Haohui Jia, Zheng Chen, Jathurshan Pradeepkumar, Xu Cao, Yasuko Matsubara +2 more
similarity 0.60
Abstract

Forecasting time-varying functional connectivity from electroencephalography (EEG) requires modeling both history-dependent trends and structured variability across channels. Conditional flow matching provides a framework for distributional forecasting, yet it remains unclear whether graph-informed source distributions offer practical advantages over isotropic noise and strong deterministic predictors. We introduce a graph-structured residual flow framework that separates conditional mean prediction from stochastic residual transport. A history-only predictor estimates the future connectivity graph, while a graph Gaussian source encodes dependencies derived from past connectivity through a Laplacian-based covariance. A conditional velocity field transports source samples to future graph residuals, with transport time explicitly distinguished from physical EEG time. Our study identifies the conditions and controls needed to distinguish useful residual transport from improvements attributable to deterministic prediction, learned representations, and sampling effects.

0.30

It Takes Two Moments: Rigidity and Limits of Continuous Encoders for Over-the-Air Computation

cs.IT eess.SPmath.OC ·2026-10-15 ·Saeed Razavikia
similarity 0.57
Abstract

We study over-the-air computation of functions, such as empirical variance, formed by combining two separately postprocessed sums of locally transformed observations. We consider continuous encoders subject to pointwise peak-power constraints over a single use of a complex multiple-access channel. With four or more transmitters, we identify conditions under which exact noiseless recovery forces every continuous encoder collection into a common affine structure that preserves both sums, reducing infinite-dimensional encoder design to selecting a finite set of coefficients. To quantify resilience against channel noise, we introduce a robustness score that measures the separation of noiseless received aggregates relative to variations in the desired function value. Within this characterized encoder family, we formulate robustness maximization as an exact convex semi-infinite program, eliminating rank constraints without a relaxation gap, and construct a decoder that attains the minimum uniform noise-amplification constant. For several function classes, including empirical variance, we derive closed-form robustness-optimal encoders and scores. Under mild regularity conditions, we also establish sharp limits on the Gaussian mean squared error at high signal-to-noise ratios and show how using the input distribution reduces average error at the expense of uniform robustness.

0.22

ALICE: In-context, Zero-shot, Mutual Information Estimation

cs.LG ·2026-09-28 ·Giulio Franzese, Simone Rossi, Pietro Michiardi
benchmark similarity 0.57
Abstract

Estimating mutual information (MI) from samples is a central objective in a variety of scientific fields. Modern neural estimators are accurate in the large-data regime, but they fall short when data is scarce, and each must be fit anew for every distribution under study. Current estimators are moreover tied to specific data types. These constraints limit their adoption in many applications where per-distribution training is impractical and sample sizes are small. We present ALICE, a foundation model that removes per-distribution training, while achieving competitive estimation accuracy. Trained exclusively on a broad family of synthetic distributions, ALICE acts as an in-context estimator of rectified-flow velocity fields: conditioned on samples of an unseen distribution, it estimates that distribution's velocity field without any explicit training. MI is then obtained through a fixed identity that integrates the squared difference between the joint and conditional fields. We validate ALICE on a standard, challenging benchmark and apply it in three domains, biology, genetics, and neuroscience, whose data the model has never seen. For the first time, we show that a single model closes the gap with neural estimators trained separately for each distribution, while natively supporting different data dimensionality and sample cardinality, enabling zero-shot MI analysis across scientific domains.

0.27

Exact Second-Order Asymptotics for the Wyner--Ahlswede--Körner Problem

cs.IT ·2026-08-22 ·Daming Cao
similarity 0.56
Abstract · Draft manuscript

We determine the exact local second-order rate region of the finite-alphabet Wyner--Ahlswede--Körner problem under full support, at informative boundary points exposed by a finite supporting slope. The characterization permits nonunique optimizing test channels with unequal information variances and requires no neighborhood smoothness of the optimized first-order value. The optimal success function is a conditional Gaussian envelope averaged over the fluctuation of the helper's observed source type. For each type, the helper selects the minimum or maximum conditional variance according to the remaining description budget, while preserving both first-order rates. The converse follows from a uniform Gaussian bound for ordinary channel images. An exact posterior score decomposition separates a common source score, a nonnegative optimality gap, a negligible source residual on low-cost histories, and a conditionally independent channel fluctuation. Conditional-type covering with two endpoint optimizers and one common binning map attains the bound. Under a strict first-order benefit from the helper, a separate limiting-rate argument also gives the unrestricted weighted second-order optimum. A strictly positive finite source exhibits a strict gain over every fixed-optimizer Gaussian expression, and an exact binary image calculation illustrates the limiting coefficient.

0.48

Monotonicity of the Rényi channel capacity under non-signaling assisted channel simulation

cs.IT quant-ph ·2026-09-28 ·Tina Shariat, Matt Hoogsteder-Riera, Marco Tomamichel
similarity 0.56
Abstract · 25 pages, 1 figure

We give an alternative variational proof that non-signaling correlations shared between the sender and receiver cannot increase the Rényi capacity of a classical channel. This monotonicity follows from the data-processing inequality for channel divergences established by Oufkir, Yao and Berta. Our approach works directly with the information-radius representation of the capacity. The constraints defining non-signaling boxes are linear in the box, while the Rényi capacity depends on the channel nonlinearly. We use a Legendre transform to express the capacity as an extremum over a family of affine functionals in which the channel appears linearly. Combining this method with separate arguments for the Shannon capacity and endpoint orders, we recover monotonicity at every order from zero to infinity. We then derive consequences for standard coding exponent functions: non-signaling simulation cannot increase the random-coding or sphere-packing exponent below capacity, or decrease the strong-converse exponent above capacity.

0.35

Wireless Evidence Acquisition for Multimodal Inference Constrained by Temporal Windows

eess.SP ·2026-09-25 ·Alessandro Compagnoni, Anup Mishra, Carla Fabiana Chiasserini, Elad Michael Schiller, Petar Popovski
hot direction similarity 0.56
Abstract · 5 pages, 4 figures, submitted to IEEE Communications letters

Multimodal inference in safety-critical applications, such as autonomous driving and robot navigation, requires heterogeneous sensor observations to reach an edge server within a task-prescribed temporal window. Referenced to the event or state being inferred, this window ends at the latest time an observation remains useful for the current decision. Since sensor readiness times, data volumes, wireless channel conditions, and task relevance vary across sensors, maximising network throughput does not necessarily minimise the fused prediction error when the window closes. We cast multimodal uplink scheduling as sequential wireless evidence acquisition and, for a linear minimum mean-square error (LMMSE) fusion model, derive a conditional evidence gain metric from the reduction in residual-error volume. Defined through second-order statistics, this metric applies beyond Gaussian models and coincides with conditional mutual information when the target and prediction errors are jointly Gaussian. We then develop MIRA, a greedy task-driven maximum information-rate allocation policy that combines conditional evidence gain with each sensor's channel state information and remaining data volume, while updating sensor relevance as evidence is acquired. Experiments on synthetic classification, human activity recognition, and vehicle-trajectory regression show that MIRA outperforms both relevance-only and channel-only scheduling. Relative to the former, MIRA improves classification accuracy by up to 70% and reduces regression mean-square error (MSE) by up to 5.5%. Relative to the latter, it requires 58% less acquisition time to attain an 80% target accuracy, while achieving up to 95% higher accuracy and 9% lower regression MSE. These gains are achieved without maximising received-data volume.

0.35

Mutual Information Constrained Chernoff Bottleneck

cs.IT cs.LGmath.OCmath.ST+1 ·2026-09-29 ·Dier Tang, Guangyue Han
similarity 0.56
Abstract · 35 pages, 4 figures, 3 tables. Feedback and comments are welcome!

The classical information bottleneck (IB) measures the relevance of a representation $U$ of $X$ to a target $Y$ by $I(U;Y)$, which does not directly characterize the error of downstream decisions. For a binary hypothesis $Y$ inferred from many separately encoded observations, the optimal error exponent is the Chernoff information between the two conditional distributions of $U$ given $Y$. We study the mutual information constrained Chernoff bottleneck, which seeks an encoder that maximizes this Chernoff information subject to a rate constraint $I(U;X) \leq R$. We show that its optimal value $C(R)$ increases strictly up to $R = H(V)$, where $V$ merges the symbols of $X$ with equal likelihood ratio, remains at the uncompressed exponent beyond, and, unlike the IB curve, need not be concave. We further show that $k+1$ outputs suffice to attain $C(R)$, where $k$ is the cardinality of $V$. We propose an alternating algorithm that updates the encoder via a generalized Blahut--Arimoto algorithm and the Chernoff parameter $s$ via a nonlinear equation, and prove that its iterates remain feasible, with nondecreasing and convergent Chernoff information. Comparing with the classical IB for $n$ samples, we show that, whenever the two objectives disagree, the IB encoder has the smaller equivocation $H(Y|U^{n})$ at $n = 1$, whereas the Chernoff bottleneck has the smaller error probability and equivocation for all large $n$. Numerical experiments confirm the theory, and on real topic-detection data from the 20 Newsgroups corpus, compressing each word to only $17\%$ of its entropy retains $90\%$ of the error exponent and nearly the accuracy of the uncompressed classifier.

0.39