CS Paper Radar

Coded Hankel Polynomial Chaos: Spectral Identification of Dominant Polynomial-Chaos Modes

Zhiliang Deng, Xiaomei Yang

cs.LG stat.ML ·submitted 2026-08-17 05:32 UTC · v1
unusual

Abstract

Identification of dominant polynomial-chaos modes is usually formulated as a sparse-regression problem on a sampled multivariate polynomial dictionary. We develop coded Hankel polynomial chaos (CH-PC), a complementary spectral formulation for dominant-mode identification. A finite generating transform converts PCE coefficients into a coefficient-generating polynomial, and evaluation along a geometric phase orbit produces a finite exponential sum. Its model order and spectral nodes are encoded by low-rank Hankel matrices, while coordinate phase shifts attach root-of-unity labels from which the full polynomial multi-indices are recovered. Coordinate-shifted probes are combined as common-node snapshots, and independent phase encodings provide redundant representations when a single spectral encoding is poorly conditioned. For finite observations, population, finite-data, and observed probes are kept distinct: sampling or quadrature error and observation error enter as separate Hankel perturbations, which are then connected to spectral stability, discrete decoding, and phase voting. For tensor-product candidate sets, the generating kernel factorizes into one-dimensional sums and can be evaluated without assembling the full multivariate PCE design matrix. Numerical experiments on sparse Legendre benchmarks and a stochastic Darcy problem illustrate exact recovery, noise stabilization, unknown-order identification by phase persistence, and dominant-mode recovery for a PDE-generated quantity of interest.

Closest papers

Nearest neighbours by meaning across the whole index.

Geometric Transition of Latent Dynamics in Intermittent Chaos: SVD-based Effective Dimension for Detection and Proactive Control

eess.SY nlin.CD ·2026-10-12 ·Takashi Hikihara, Tetsushi Saburi
published similarity 0.51
Abstract · 13 pages, 7 figures. Accepted for publication in Chaos: An Interdisciplinary Journal of Nonlinear Science

This paper investigates the geometric detection of latent dynamic transitions (where the latent space is defined as a finite-dimensional state space reconstructed via a delay-embedding Hankel matrix) in mutually coupled phase-locked loops (PLLs) exhibiting on-off intermittent chaos. We propose a data-driven approach to identify the transition of the effective dimension in latent dynamics as a precursor to physical bursting events. By applying Singular Value Decomposition (SVD) to a Hankel matrix constructed from high-resolution oversampled data, we extract the effective dimension that reflects the dynamical shift of intrinsic variables - from a synchronized two-dimensional manifold to a higher-dimensional chaotic state - prior to the actual burst. This geometric indicator enables a proactive, event-driven intervention using Pyragas-type delayed feedback control, which is activated only when the detected dimension exceeds a critical threshold. Simulation results demonstrate that this geometric precursor effectively compensates for control latencies and substantially reduces accumulated control energy compared to conventional continuous feedback. The findings establish a methodological strategy for stabilizing infinite-dimensional delayed systems by exploiting early warning signals embedded in dimensional transitions of latent dynamics.

0.36

Locally Adaptive Conformal Prediction for Polynomial Chaos Expansions

cs.CE stat.COstat.MEstat.ML ·2026-11-06 ·Dimitrios Loukrezis, Arthur Hatstatt, Bruno Sudret, Dimitris G. Giovanis
benchmark similarity 0.50
Abstract · 22 pages, 11 figures, 2 tables

This work develops a locally adaptive jackknife+ conformal prediction framework for polynomial chaos expansions. Therein, the non-conformity scores are normalized with an auxiliary polynomial chaos expansion trained on the log-transformed leave-one-out residuals of the base model. We show that the coverage guarantee of jackknife+ conformal prediction carries over to the adaptive intervals if the leave-one-out auxiliary models are trained on nested leave-one-out residuals. For fixed-basis polynomial chaos expansions fitted by ordinary least squares, all required quantities are derived in closed form and the guarantee-preserving adaptive intervals are obtained from a single model fit, without any model retraining. For sparse polynomial chaos expansions, where multiple model fits are necessary, we propose a heuristic simplification that limits the computational overhead of adaptivity at the cost of the formal coverage guarantee. Numerical experiments on an academic benchmark with known heteroscedastic noise and on an engineering simulation dataset show that the suggested method attains the target coverage while providing intervals that adapt to local prediction uncertainty, therefore being considerably more statistically efficient. These advantages are particularly prominent in high-uncertainty regions of the input space, where the performance of non-adaptive methods degrades substantially.

0.26

Multichannel Sampling and Reconstruction in Multidimensional Shift-Invariant Spaces

eess.SP ·2026-10-26 ·Riya Ghosh, Satish Mulleti, Chandra Sekhar Seelamantula
unusual similarity 0.50
Abstract

We develop a multichannel sampling and reconstruction framework for multidimensional principal shift-invariant spaces based on a finite-dimensional polyphase representation. Periodic nonuniform shifts and derivative measurements are modeled as analysis channels, leading to a frequency-domain linear system relating the measurements to the polyphase components of the underlying coefficient sequence. Stable recovery is characterized through uniform singular-value bounds on the associated polyphase matrix, and explicit synthesis kernels are obtained from its Moore Penrose left inverse. The formulation applies to both separable and genuinely non-separable generators and includes several classical one dimensional sampling formulas as special cases. For irregular derivative measurements, where the periodic polyphase structure is no longer directly available, we develop an iterative reconstruction method based on local bivariate Hermite interpolation followed by orthogonal projection onto the shift-invariant space. A sufficient contraction condition is derived to guarantee geometric convergence of the iteration. Numerical experiments demonstrate the reconstruction performance for separable and non-separable generators and illustrate robustness to additive measurement noise and sampling-location perturbations.

0.30

Time-Varying Spiky Wave-Shape Functions for Non-Stationary Signal Decomposition

eess.SP ·2026-08-26 ·Marcelo A. Colominas, Hau-Tieng Wu
similarity 0.48
Abstract

We propose a novel framework for decomposing nonstationary spiky signals. Unlike classical adaptive non-harmonic models, which represent signals as amplitude- and frequency-modulated (AM--FM) oscillations, the proposed model is designed for signals whose dominant structures are highly localized, impulsive, or spike-like, and contains physiological variability, which is challenging to be modeled as AM--FM representations. Representative examples include electrocardiogram (ECG) complexes, epileptic electroencephalogram (EEG) transients, and other pulse-like physiological signals. We first introduce a fixed-waveform model for repetitive spiky structures and then extend it to accommodate cycle-to-cycle waveform variability. The resulting algorithm, termed \emph{Spiky Shape-adaptive Mode Decomposition} (SSAMD), estimates waveforms in the Fourier coefficient domain. Fourier coefficients are first estimated via local regression and then regularized by exploiting their low-dimensional manifold structure. Specifically, we combine a PCA-based parametrization with an entropy regularization acting on the singular-value spectrum of the coefficient matrix, promoting morphological consistency while preserving structured waveform variability. The proposed framework is flexible and overcomes the limitations of existing models. We validate the method on synthetic and real biomedical signals, including ECG with atrial fibrillation, epileptic EEG, and trans-abdominal maternal ECG. Experimental results demonstrate effective denoising, waveform tracking, decomposition, and segmentation, while preserving physiologically meaningful morphological variations.

0.25

Weighted Empirical Risk Minimization for Machine Learning under Long-Range Dependence: Exact Pathwise Rates and Learning-Error Geometry

cs.LG stat.ML ·2026-09-09 ·Elina Moldavskaya
similarity 0.47
Abstract · 42 pages, 5 figures

We develop an exact almost-sure learning theory for smooth parametric models trained by regularly weighted empirical risk minimization on long-range dependent data. The training observations are generated from a fixed finite window of a stationary Gaussian sequence, and the sample weights are regularly varying. If the loss gradient at the population minimizer has Wiener-chaos rank $m$ and a nonzero low-frequency coefficient, then, in the long-memory interior regime, the finite-lag score reduces on the iterated-logarithm scale to a single weighted Hermite chaos. This yields an almost-sure Bahadur representation, an exact limsup law for the learned parameter, and, for $m\ge2$, the functional cluster set of the complete learning trajectory. The polynomial learning exponent is determined by the memory parameter and the chaos rank and is invariant under the admissible power weighting, whereas the sharp pathwise constant and cluster geometry depend on the weights. In the rank-one case, global optimization over the admissible power exponents shows that every optimizer is positive. Time-series prediction and classification examples illustrate the results.

0.66

A Unified Uncertainty Representation for Graph Neural Networks via Doubly-Spectral Stochastic Expansion

cs.LG cs.AI ·2026-09-28 ·Fred Xu, Thomas Markovich, Florence Regol, Yizhou Sun
publishedtheory similarity 0.47
Abstract · paper already accepted at Neurips 2026

Reliable deployment of graph neural networks requires calibration, out-of-distribution (OOD) detection, and robustness to distribution shift, yet existing methods address these needs with separate models and objectives. We model uncertain node embeddings as random graph signals: graph Fourier filters capture structural variation, and a scalar orthogonal-polynomial chaos coordinate captures latent stochastic variation. The resulting doubly-spectral stochastic (DSS) expansion supplies task-matched readouts from one representation: the mean coefficient encodes class evidence for the energy-based OOD score, the higher-order coefficients encode structured logit variation, and quadrature averaging over the chaos coordinate defines the single predictive distribution used for prediction and calibration. A capacity theorem shows that, under a full-rank feature assumption, a restricted subfamily matches the chaos coefficients of any Gaussian-latent random graph signal, with exponentially decaying truncation error under a growth condition; the task-level claims are established empirically. DSS-GNN has two deployment modes: standalone, or as a residual branch beside a deterministic encoder (DSS-Hybrid). Standalone DSS-GNN achieves the lowest Brier score among the compared uncertainty-aware baselines on all 14 node classification benchmarks without post-hoc correction; DSS-Hybrid achieves the best AUROC on most node-OOD settings, competitive cross-graph OOD detection, and the strongest shifted accuracy on all 7 GOOD concept-shift benchmarks under standard empirical risk minimization (ERM). Cross-evaluating both modes on all three tasks shows that each remains effective on the other's tasks, with documented exceptions, and yields explicit deployment guidance.

0.27

A decomposition-integration framework coupling singular spectrum analysis with a volatility-adaptive LSTM for stock price forecasting

cs.CE cs.LG ·2026-10-17 ·Xin-Rui Lu, Da-Qing Zhang
benchmark similarity 0.47
Abstract

Financial time series exhibit multi-scale, high-noise, and non-stationary volatility dynamics. Decomposition--integration frameworks built on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) have advanced this field, yet existing CEEMDAN hybrids remain unstable: high-frequency mode mixing contaminates downstream predictors, and the heterogeneous volatility of decomposed components is not matched by any volatility-adaptive mechanism. To address these gaps, this paper proposes CEEMDAN-SE-SSA-VMGL. CEEMDAN adaptively decomposes the original series, and sample-entropy-driven K-means clustering groups the intrinsic mode functions into high-, mid-, and low-frequency and residual components. Singular spectrum analysis (SSA) is then applied to the high-frequency group, whose singular-value decomposition of the trajectory matrix and principal-component reconstruction decouple intertwined pseudo-oscillatory modes and alleviate mode mixing. We further design a plug-and-play robust LSTM variant, the volatility-modulated GARCH-LSTM (VMGL), which embeds a differentiable GARCH(1,1) layer inside the LSTM cell as a risk gate; the estimated conditional volatility multiplicatively scales the forget-gate activation, letting memory decay adapt to the instantaneous volatility while remaining fully end-to-end trainable. Component predictions are linearly combined. On five US and Chinese financial series (CSI 300, CSI 500, AAPL, GOOGL, S&P 500), the proposed model is compared with eleven benchmark architectures, lowering the forecasting error by 9% to 24% relative to the best benchmark and by 60% to 70% relative to a standard LSTM. Diebold--Mariano and model-confidence-set (MCS) tests confirm the statistical significance and stability of the gains, spectral analyses verify the SSA denoising efficacy, and backtesting demonstrates the framework's economic utility.

0.25

Learning Chaos Without Seeing Chaos: Extrapolation of Global Dynamics in Autoregressive Transformers

cs.LG nlin.CD ·2026-09-30 ·Yilun Liu, Yi Zhang, Ganyu Wu, Sikuan Yan, Mengyue Wang +3 more
similarity 0.47
Abstract

Autoregressive models are trained to predict a system's behavior one step at a time, and recursive generation allows the learned dynamics to unfold over long horizons. To what extent can such dynamics learned from local observations recover broader organization of an underlying system that was only partially observed during training? Here we study small autoregressive transformers trained from scratch on trajectories sampled from restricted parameter regimes of several non-linear dynamical systems, including logistic and sine maps, the Lorenz system, and the generalized Hopf system, with control parameters and state trajectories represented as sequences of continuous tokens. Under closed-loop evaluation at parameters far outside the training distribution, the models can recover self-similar period-doubling cascades, chaotic dynamics, and attractor structures with remarkable visual and numerical fidelity. For the logistic map, a transformer reproduces successive period doublings up to period 128, yielding a finite-order scaling ratio of 4.6687, matching the Feigenbaum constant to within $5\times10^{-4}$. We further investigate how these structures emerge over the course of training, and reveal with causal interventions how control-parameter information is processed through attention into state prediction and shapes the resulting closed-loop dynamics. These results suggest that a surprisingly narrow window into a system's local behavior may suffice for autoregressive transformers to generalize to its unseen global dynamical organization.

0.23