CS Paper Radar

Directional Statistics in Signal Processing: A Geometry Driven Overview of Models, Learning, and Applications

Anders S. Olsen, Kanti V. Mardia, Dimitri Van De Ville, Morten Mørup

eess.SP stat.MEstat.ML ·submitted 2026-11-03 09:50 UTC · v1
survey

Abstract

Many signal-processing objects are defined by periodicity, normalization, sign or global-phase ambiguity, basis invariance, or positive-semidefinite constraints and therefore cannot be modeled faithfully in ordinary Euclidean space. This paper develops a geometry driven framework for directional statistics in signal processing, connecting signal representations to their natural manifolds or quotient spaces and to probability models compatible with their invariances. After reviewing instances of directional statistics in the signal processing literature, we review circular, toroidal, spherical, projective, Stiefel, Grassmann, and covariance-valued distributions, emphasizing their statistical assumptions, computational requirements, and dimensional limitations relevant to signal processing. We describe various modeling and estimation strategies, including analytical and gradient-based maximum likelihood, structured low-rank parameterizations, mixtures and hidden Markov models (HMMs), score-based and contrastive estimation, and geometry-aware K-means. To exemplify the consequences of geometry-aware modeling, we study multivariate phase coherence in synthetic data and functional neuroimaging, comparing toroidal phase vectors to projective, Grassmann, and positive-semidefinite representations. We also study speaker separation in a car environment, showing that directional representations outperform a standard Euclidean model. These examples demonstrate that when the geometric representation, statistical distribution, inference method, and computational regime are considered together, they have the potential to lead to improved models across a broad range of signal processing applications.

Closest papers

Nearest neighbours by meaning across the whole index.

Interpretable intrinsic dimension estimation through componentwise calibration of distance and angle

cs.LG stat.ML ·2026-09-29 ·Chih-Hsuan Huang, Chih-Wei Chen, Szu-Chi Chung
similarity 0.59
Abstract · 35 pages, 5 figure, 2 tables

DANCo (Dimensionality from Angle and Norm Concentration) jointly calibrates nearest-neighbor distance and angular statistics and consistently reaches state-of-the-art accuracy on clean intrinsic-dimension (ID) benchmarks. Practical data, however, introduce neighborhood-relative noise and sample-amplitude heterogeneity that can distort these geometric signals. We reformulate DANCo componentwise, retaining separate distance and angular discrepancy curves so that the source of an estimate can be identified and interpreted. For the distance component, we derive a closed-form Kullback-Leibler divergence for the generic-order ratios of the generalized ratios ID estimator (Gride); when both angular parameters are matched (Full), Gride reduces mean percentage error from $27.7\%$ to $17.6\%$ at noise equal to $40\%$ of typical neighbor spacing on 24 manifolds. For the angular component, two sampling regimes motivate aligning mean direction while retaining concentration matching (Profiled). On a Gaussian scale mixture with generating dimension 70 embedded in 100 dimensions, profiling raises the Minimum Neighbor Distance (MiND) estimate from $22.8$ to $66.7$, while removing the known amplitudes restores MiND-Full to $71.9$; the control thus attributes the Full shortfall to amplitude heterogeneity. On CIFAR-10 and ImageNet, amplitude-reducing normalizations move angular location toward the references and narrow the Full-Profiled gap, an observational counterpart to the controlled mixture. Across four pretrained convolutional neural networks, Gride-Profiled, the two-nearest-neighbor estimator (TWO-NN), and the maximum-likelihood estimator (MLE) exhibit similar rise-and-fall profiles, while Full-Profiled differences identify the layers most sensitive to angular calibration.

0.26

Spectral-Domain Information Geometry of Stationary Covariance Models: Gaussian and Elliptical Extensions

eess.SP math.ST ·2026-11-09 ·Shu Yang, Dongying Li, Wenxian Yu
similarity 0.58
Abstract · 26 pages, 7 figures

This paper develops an information-geometric framework for stationary covariance structures. We begin with the infinite-dimensional setting, where stationary covariance structures can be characterized without finite-window boundary effects. By formulating the covariance structure as a bilinear form on a suitable class of test functions, we establish its spectral representation and show how finite-dimensional Toeplitz covariance matrices arise as restrictions to nested observation subspaces. For zero-mean proper complex Gaussian wide-sense stationary (WSS) processes, we show that the normalized finite-dimensional Fisher information converges to a spectral-domain metric. In logarithmic spectral coordinates, this metric becomes the standard $L^2$ inner product, yielding an explicit Fisher--Rao distance that is also recovered as the asymptotic normalized affine-invariant Riemannian distance between Toeplitz covariance matrices. We then extend the framework to elliptical observation models by separating global covariance scale from shape. The shape Fisher information is orthogonal to radial nuisance directions and is characterized by a dimension- and radial-model-dependent coefficient. We derive a condition under which this coefficient converges to its Gaussian value as the observation dimension tends to infinity. The resulting limiting spectral-shape geometry is the centered $L^2$ geometry of log-spectra and is invariant to positive rescaling. Numerical experiments illustrate the theoretical convergence results and the recovery of the Gaussian shape coefficient.

0.20

Geometric Feature Learning for Functional Data Valued on the Symmetric Positive Definite Manifold

cs.LG stat.ML ·2026-09-24 ·Samuel V. Singh, Mimi Zhang
similarity 0.57
Abstract

We here develop a functional neural network, termed MatFAE, for learning trajectories on the Riemannian manifold of symmetric positive definite (SPD) matrices. MatFAE features intrinsic layers that map manifold-valued functions to Euclidean vector-valued functions, followed by a functional layer that projects them into a finite-dimensional Euclidean space. Unlike most neural networks for discrete-time sequences, MatFAE treats each sequence as a continuous function and can therefore encode trajectory dynamics (e.g., first-order derivatives) in its latent representations. Additionally, the morphology of the functional weights in the functional layer offers interpretability by revealing the regions of the input functional data that contribute most to the latent representations. We justify the design principles and properties of each intrinsic layer and detail how matrix factorization is handled during backpropagation. We apply MatFAE to a range of fMRI datasets, demonstrating its ability to efficiently learn informative representations from high-dimensional SPD trajectories and its practical value for real-world neuroimaging analysis.

0.15

Rotational Equivariance in Machine Learning: A Comprehensive Tutorial

cs.LG ·2026-08-31 ·Peter Lippmann, Fred A. Hamprecht
similarity 0.56
Abstract

Rotational symmetry is one of the most important structural principles in machine learning on 3D data. In applications ranging from physics and materials science to 3D computer vision, predictions should not depend on an arbitrary choice of coordinate frame. Rotational equivariance captures this requirement mathematically by enforcing that a rotation of the input induces a corresponding transformation of the model output. This tutorial provides a comprehensive introduction to rotational equivariance, starting from the physical and geometric intuition behind coordinate independence and building up the necessary machinery from geometric deep learning, group theory, and representation theory. We introduce message passing on Euclidean graphs, group actions and representations, spherical harmonics, Wigner matrices, tensor products, and Clebsch-Gordan decomposition, and explain how these ingredients give rise to modern equivariant architectures. We then survey the principal strategies for incorporating rotational equivariance in deep learning, including group convolutions, internal tensorial representations, and canonicalization-based methods, and discuss their practical strengths and limitations. The tutorial aims to lower the barrier to the subject by connecting the underlying mathematics to practical model design, by unifying ideas that are often expressed in different formal languages, and by helping practitioners choose among competing approaches through a clear discussion of their trade-offs.

0.11

Shape-Adaptive Subspace-Constrained Quadratic Matrix Factorization

cs.LG ·2026-11-08 ·Zheng Zhai, Zhuan Liang, Sujun Guo
similarity 0.56
Abstract

Quadratic manifold fitting provides a flexible framework for modeling nonlinear low-dimensional structures embedded in high-dimensional spaces. However, existing methods typically employ prescribed noise models or fixed loss functions, limiting their adaptability to varying noise characteristics. To address this limitation, we propose an alternating maximum likelihood estimation method for subspace-constrained quadratic matrix factorization, termed AMLE-SQMF, which jointly estimates the quadratic manifold and the underlying noise distribution. Specifically, we model the residuals using a generalized Gaussian distribution (GGD), whose shape parameter controls the tail behavior and determines the associated fitting loss. By exploiting the closed-form maximum likelihood estimator of the scale parameter, we eliminate the scale variable and derive a profile negative log-likelihood. Based on this formulation, we develop an alternating optimization algorithm that iteratively updates the manifold parameters and estimates the noise shape parameter. This enables adaptive loss selection within a unified likelihood-based framework, without requiring prior specification of the noise characteristics. Experiments on synthetic and real-world datasets demonstrate the effectiveness of AMLE-SQMF in quadratic manifold fitting and its robustness to diverse noise distributions.

0.29

Model-Based Learning of Latent Euclidean Embedding from Relational Data

cs.LG stat.ML ·2026-10-31 ·Yinghang Chen, Yunxiao Chen, Haoran Zhang
similarity 0.56
Abstract

Visualizing and interpreting the dependence structure in relational data often benefits from geometric representations via low-dimensional Euclidean embeddings. However, existing approaches are typically restricted to specific response types, rely on burdensome high-dimensional nonconvex optimization, or lack uniform theoretical guarantees for simultaneous coordinate recovery. To address these limitations, we introduce a unified, distance-based latent space framework for both unipartite and bipartite relational data---accommodating continuous, binary, ordinal, and count-valued observations---via a modular two-stage procedure that decouples signal estimation from geometric recovery. First, we estimate the low-rank signal matrix using spectral denoising. For models with nonlinear link functions, we further apply one-step row- and column-wise refinement to achieve uniform entrywise accuracy. Second, we recover the latent configurations through direct spectral analysis for unipartite data and a low-dimensional alignment optimization for bipartite data. We establish uniform recovery guarantees that characterize the propagation of error from signal estimation to the embedding space. To illustrate the scalability and interpretability of our approach, we apply the proposed method to two real-world datasets: a statistician citation network and European Parliament voting records.

0.30

Light Entropic Optimal Transport on Riemannian Manifolds

cs.LG ·2026-10-02 ·Xavier Aramayo-Carrasco, Petr Mokrov, Alexander Korotin
similarity 0.56
Abstract

Entropic Optimal Transport (EOT) has become a practical framework for learning stochastic couplings between complex distributions, with applications in generative modeling and domain adaptation. However, most EOT solvers are designed for Euclidean spaces, while manifold extensions remain limited and often rely on costly iterative methods, simulated dynamics, or generic neural models that do not fully exploit the underlying geometry. We introduce ManifoldLightOT, a light approach for learning kernel-induced EOT couplings directly on common manifolds. Using the kernel form of the EOT solution, we construct geometry-specific Gibbs kernels together with compatible potential parameterizations for spheres, tori, $\mathrm{SO}(3)$, and $\mathrm{SE}(3)$. These choices yield closed-form normalization and directly sampleable conditional distributions. Our formulation naturally extends to products of manifolds, making it applicable to more complex geometries. The parameters of the potentials are optimized directly from samples using Monte Carlo estimates of the learning objective. Through synthetic and real-world experiments, we show that ManifoldLightOT often outperforms existing manifold OT methods while retaining direct sampling.

0.26

SPDAlign: Interpretable Riemannian Alignment for EEG Forward Modeling Shifts

cs.LG ·2026-10-05 ·Shanglin Li, Shiwen Chu, Okan Koç, Chenyu Liu, Qibin Zhao +3 more
similarity 0.55
Abstract

Electroencephalography (EEG) based brain-computer interfaces enable direct brain-to-device communication for applications such as rehabilitation and communication. However, their practical utility is often limited as the non-stationary nature of the EEG data introduces distribution shifts across domains (e.g., sessions and subjects). Adapting machine learning models to be invariant to these shifts in an unsupervised way, without using costly labeled calibration data, would drastically improve the utility of EEG data. In this work, we use a classic generative model of EEG to study distribution shifts introduced by the domain-specific forward process, which is associated with factors such as head geometry. We theoretically show that such distribution shifts can be recovered solely through linear transformations on the Symmetric Positive Definite manifold. Building on this insight, we propose SPDAlign, an interpretable framework for promoting domain-invariant EEG learning. SPDAlign first aligns the domain-specific means and corrects global rotations across domains using a recent optimal transport technique called Wasserstein Procrustes. We systematically study the proposed approach through simulations and demonstrate its competitive performance on extensive public EEG datasets. Additionally, SPDAlign is a globally linear framework and is intrinsically interpretable, so that the framework can identify frequency ranges of interest, determine the spatial patterns reflecting source-sensor relationships, and address cross-subject variability.

0.24