CS Paper Radar

Heteroskedastic Canonical Polyadic Tensor Decomposition

Kyle Ritscher, Carlos Llosa-Vite

cs.LG stat.MEstat.ML ·submitted 2026-09-30 18:01 UTC · v2

Abstract

When minimizing the squared-error loss, the popular CP decomposition can be interpreted as parameter inference in a Gaussian model with a low-rank mean tensor and constant variance across the tensor entries. We introduce heteroskedastic-CP (HCP), which models entrywise variability with a non-constant, low-rank precision tensor, and develop an alternating block-coordinate ascent method to recover both the low-rank mean and precision tensors from noisy observations. Our procedure is computationally competitive, with the same leading-order factor-update complexity as CP-ALS. We demonstrate HCP on synthetic experiments and an EEG application.

Comment
39 pages, 17 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Bayesian Tensor Train Kernel Machines with Automatic Model Complexity Inference

cs.LG stat.ML ·2026-11-04 ·Afra Kilic, Kim Batselier
code/data similarity 0.58
Abstract · 31 pages, 4 figures, 1 algorithm. Code available at https://github.com/afrakilic/BTTKM

Tensor Network (TN) kernel machines accelerate supervised learning by using low-rank TNs to reduce computation and memory. However, most TN-based methods are deterministic with manually tuned ranks and feature dimensions, while the existing Bayesian TN kernel machine is restricted to the CANDECOMP/PARAFAC decomposition (CPD), whose single rank is shared by all modes. We extend this framework to the tensor train (TT) and propose Bayesian Tensor Train Kernel Machines (BTT-KM), whose hierarchical ARD-type priors on the TT cores infer the TT ranks and feature dimensions from data. Since each TT core is coupled to the others only through its neighbors, its closed-form posterior update requires propagating the contributions of all other cores along the chain. Mean-field variational inference yields a Bayesian alternating least squares algorithm with the same computational complexity as its deterministic counterpart and a closed-form predictive distribution. A synthetic experiment illustrates that BTT-KM recovers the true TT ranks and feature dimensions from an over-parameterized initialization.

0.62

EEG-AS: Instance-Level Foundation Model Selection for EEG Foundation Models via Behavior Reconstruction

cs.LG cs.AI ·2026-09-01 ·Yunzhen Zhang, Ruoxi Piao, Muhammad Ibrahim Ali Shah, Hasan Onur Keles, Mustafa Misir
theory similarity 0.58
Abstract

Electroencephalography (EEG) is a non-invasive technique for measuring neural activity and has been widely used in neuroscience applications. Recent advances in EEG foundation models have enabled strong performance across diverse neural decoding tasks. However, no single foundation model consistently performs best across datasets or individual EEG instances, while instance-level model selection remains largely unexplored. To address this limitation, we formulate EEG foundation model selection as an instance-level Algorithm Selection (AS) problem. We propose \textbf{EEG-AS}, an instance-level algorithm selection framework that characterizes each EEG instance using inference-available latent EEG embeddings, handcrafted neurophysiological features, and an anchor foundation model. During training, EEG-AS learns to reconstruct unavailable foundation-model behaviors from privileged prediction tokens conditioned on an anchor foundation model, while during inference it estimates these behaviors without executing the entire model portfolio, enabling efficient selection from seven EEG foundation models. Experiments on seven public EEG benchmarks demonstrate that EEG-AS substantially narrows the gap between the Single Best Solver (SBS) and the oracle upper bound for each instance. These results highlight the effectiveness of instance-level AS for adaptive deployment of EEG foundation models.

0.31

Adaptive Forgetting for Nonstationary Optimization: Towards Robust EEG Decoding

cs.LG cs.HC ·2026-09-21 ·Hongyu Zhu, Lin Chen, Jing Chen, Yuting Zhou, Mingsheng Shang
hot direction similarity 0.58
Abstract · Submitted

Electroencephalography (EEG) provides non-invasive monitoring of brain activity and is widely used in emotion recognition, motor imagery and sleep staging. Although within-subject decoding has achieved considerable progress, cross-subject generalization remains a central challenge in practical applications. EEG decoders are typically trained with Adam/AdamW under a fixed second-moment decay coefficient, even though cross-subject learning involves low signal-to-noise ratios, subject variability, and gradient nonstationarity. A fixed coefficient implicitly assumes that gradient statistics are homogeneous across layers and time, which can limit model's adaptability to cross-subject EEG signals and degrade generalization. To address these issues, we propose AFOR, a tensor-wise adaptive optimizer that converts the fixed second-moment decay coefficient into a dynamic coefficient estimated online from local gradient state. AFOR combines a Residual-Alignment Signal Scorer (RASS) and an Adaptive Forgetting Controller (AFC). RASS summarizes local gradient residuals and directional agreement into a signal-quality score, and AFC maps this score through self-referential normalization to a bounded per-step decay coefficient, with cumulative-product initialization correction maintaining consistency under time-varying decay. Under a strict cross-subject protocol on three EEG benchmarks that cover three representative fields, AFOR achieves the best average performance among the compared optimizers, improving the mean test accuracy over Adam by 3.00%, 2.07%, and 4.38%, respectively.

0.30

Best Practices in EEG Analysis: Preprocessing, Modeling, and Machine Learning

eess.SP cs.LG ·2026-09-29 ·Parsa Razmara, Woojae Jeong, Aditya Kommineni, Raymundo Cassani, Richard Leahy +1 more
published similarity 0.57
Abstract · 38 pages, 5 figures. Chapter 16 of the 2026 monograph "Electroencephalogram Signals and Cognition," edited by Hema A. Murthy, Shrikanth Nara…

Electroencephalography (EEG) analysis requires careful choices in preprocessing, statistical modeling, and machine learning because EEG signals are highly susceptible to artifacts, volume conduction, low signal-to-noise ratio, and substantial inter-subject variability. This chapter provides a practical and methodological guide to modern EEG analysis, spanning EEG preprocessing, artifact removal, filtering, bad-channel detection and interpolation, re-referencing, independent component analysis (ICA), and preprocessing of simultaneous EEG-fMRI recordings. We review major approaches for computational EEG analysis, including event-related potentials (ERPs), time-frequency analysis, functional and effective connectivity, source localization, multivariate decoding, permutation testing, and multiple-comparison correction. We then examine machine-learning methods for EEG, from feature-based classifiers to deep learning and emerging EEG foundation models, with emphasis on cross-subject generalization, limited-data regimes, data leakage, evaluation metrics, and fair benchmarking. Reproducibility is treated as a core requirement throughout, including transparent preprocessing, BIDS-EEG data organization, standardized derivatives, preservation of raw data, and FAIR data practices. The chapter is intended as a practical reference for researchers developing reliable, interpretable, and reproducible EEG analysis and machine-learning pipelines.

0.27

Variational Bayesian Tensor Decomposition With Discrete Mixture Prior for Unsourced Random Access

eess.SP cs.IT ·2026-09-22 ·Ala Baccar, Alexis Decurninge, Alberto Rech, Sofiane Kharbech, Eric Pierre Simon +1 more
similarity 0.57
Abstract · Journal paper, 14 pages, 8 figures

Tensor-based modulation (TBM) schemes are a promising approach for unsourced random access (URA), where user separation relies on decomposing the received signal tensor via the canonical polyadic decomposition (CPD), typically computed with alternating least squares (ALS). Standard ALS, however, treats the factor matrices as unstructured and fails to exploit the discrete structure of the tensor sub-constellations. We propose DVB-ALS, a discrete variational Bayesian CPD framework with specific priors, tailored to a tensor structure with the corresponding encoding strategy, combined with iterative computation of an approximate posterior distribution. A discrete Gaussian mixture prior on one Grassmannian factor softly aligns the estimates toward the constellation points. The remaining factors are jointly modeled with a structured Gaussian prior whose posterior mean is constrained to the Khatri-Rao product manifold and posterior variance upper-bounded to prevent norm divergence during inference. The resulting closed-form coordinate ascent algorithm jointly estimates all latent factors and their uncertainties. We integrate DVB-ALS into DVB-TBM to design a complete URA receiver with single-user demapping, polar decoding with cyclic redundancy check (CRC) verification, and successive interference cancellation (SIC). Simulation results show significant gains over standard ALS-based decomposition and robust detection performance in URA settings, outperforming state-of-the-art schemes under high system loads.

0.27

Nonlinear Tensor Decomposition for Pattern Discovery

eess.SP ·2026-10-04 ·Atharva Awari, Geert Roelof van der Ploeg, Arnaud Vandaele, Nicolas Gillis, Evrim Acar
similarity 0.57
Abstract · 5 pages, 2 figures. Submitted to ICASSP 2027

The CANDECOMP/PARAFAC (CP) decomposition is widely used for revealing the underlying patterns from multiway data (also referred to as a higher-order tensor). When the data is clipped or saturated, however, the linear CP model becomes unreliable. Several remedies exist such as treating the clipped entries as missing or imputation; however, both fall short in different scenarios. We propose a nonlinear CP model (NCP) for pattern discovery in this setting, extending ideas from nonlinear matrix decompositions to tensors, and solve it using a flexible ADMM (Alternating Direction Method of Multipliers)-based framework that can accommodate a variety of nonlinearities. Using synthetic data with known factors and simulated metabolomics data where clipping arises from instrument detection limits, we demonstrate that NCP recovers the underlying factors more accurately than CP fitted to only the observed entries or threshold-imputed data.

0.40

Knowledge-guided Pattern Discovery via Coupled Tensor Factorizations

cs.LG ·2026-08-13 ·Gaute Johannessen, Geert Roelof van der Ploeg, Evrim Acar
similarity 0.57
Abstract

In order to understand complex systems such as the human metabolome or human brain, different sensing technologies are used, generating complex data. These datasets are often multiway, i.e., with more than two axes of variation such as a subjects by metabolites by time array. While tensor factorizations have successfully revealed interpretable patterns from such complex data, they have so far been mainly data-driven. On the other hand, there is more to data -- there are computational models (of these systems), which are rich sources of prior information. In this paper, we introduce a knowledge-guided approach that brings together data and computational models by jointly analyzing real data and simulated data (generated using a computational model) using coupled tensor factorizations with linear coupling. Our experiments on real metabolomics measurements demonstrate that guiding the analysis of such noisy data with simulated data improves the pattern discovery performance while also revealing potential discrepancies between data and computational models.

0.04

Guaranteed Low-Rank Tensor Recovery from Modewise Measurements via Normalized Block-Weighted Riemannian Gradient Descent

cs.LG ·2026-09-21 ·Yushi Zhou, Feng Zhang
similarity 0.57
Abstract

We consider the recovery of low-multilinear-rank tensors from linear measurements and propose an adaptive block-weighted modewise Riemannian gradient descent method. The method combines memory-efficient modewise measurements with a normalized adaptive weighting strategy for the core and factor components of the Riemannian gradient. The weighting improves convergence without increasing the multilinear-rank bound of the search direction or the size of the reduced core used for retraction. Under the tensor restricted isometry property and a suitable initialization, we establish local linear convergence and derive sampling guarantees for sub-Gaussian and subsampled orthogonal with random sign (SORS) measurements. Numerical experiments on synthetic low-Tucker-rank tensors show that the proposed method reduces iteration counts and computational time while maintaining reliable recovery performance, especially near the recovery threshold and for structured SORS measurements.

0.20