CS Paper Radar

Learning Fractional-Order Dynamics from a Single Trajectory

Xiaole Zhang, Ziyi Zhang, Zehao Zhao, Stephen Tu, Guannan Qu, Yorie Nakahira, Paul Bogdan

cs.LG eess.SY ·submitted 2026-09-16 05:02 UTC · v1

Abstract

Many real-world processes exhibit long-range dependence, where the current state depends on a slowly decaying trace of past states rather than on the most recent state alone. This paper studies system identification for discrete-time fractional-order linear time-invariant systems from a single observed trajectory of length $t$, a setting that captures such non-Markovian dynamics through the Grünwald--Letnikov difference operator. Unlike Markovian systems, fractional-order systems couple estimation across the entire history, making both statistical analysis and practical identification more challenging. We propose \emph{Fractional-Order Ordinary-Least-Squares Grid-Search (FO-GS)}, a simple two-stage estimator that exploits the diagonal structure of the fractional-difference operator to decouple the identification problem row-wise. Under the stability assumption, we establish high-probability, non-asymptotic error bounds for estimating both the fractional order and the system matrix in the heterogeneous setting, with both estimation errors scaling as \(\mathcal{O}(t^{-1/2})\). Through experiments, we show that \emph{FO-GS} outperforms existing baselines in recovering both the fractional order and the underlying system dynamics.

Closest papers

Nearest neighbours by meaning across the whole index.

Robust data-driven discovery of fractional differential equations via weak formulations and Pareto-based subset selection

cs.LG math.DS ·2026-08-13 ·Pongpisit Thanasutives, Yoshinobu Kawahara
benchmark similarity 0.54
Abstract · 47 pages

Fractional partial differential equations describe nonlocal dynamics, but discovering them from noisy data is difficult because fractional differentiation amplifies high-frequency measurement noise and the derivative orders are unknown. We propose Weak-Pareto, which combines an adjoint-consistent weak formulation of fractional terms with Pareto-based subset selection over discrete term types and continuous fractional orders. For linear right-hand-side terms, the adjoint transfers fractional operators from measured fields to smooth test functions, replacing noise-sensitive pointwise differentiation with smoothing integration; for nonlinear terms, the noise-suppression effect is partial yet useful. Coefficients are fitted by ridge regression within a branch-aware differential-evolution search over the orders. The support size is then selected at the validation-error-complexity elbow. We show that the variance of fixed linear right-hand-side weak features vanishes under grid refinement, whereas noise amplification in pointwise fractional features increases with derivative order. Across fractional advection-diffusion, reaction-diffusion, and Burgers benchmarks, Weak-Pareto recovers parsimonious structures from clean and noisy measurements. In controlled advection-diffusion and Burgers comparisons, it retains the correct support at every tested multiplicative-noise level, whereas the unregularised strong-form counterpart largely fails once noise is introduced; this advantage persists under additive Gaussian noise. Ablations show that the weak library drives noise robustness and that continuous-order Pareto search avoids the support-selection failure of a dense fixed dictionary. On the advection-diffusion benchmark, Weak-Pareto yields more consistent operator recovery and substantially lower measured runtime than a contemporary neural baseline.

0.10

Fractional State Space Transition for Long Sequence Modeling

cs.LG cs.CL ·2026-09-28 ·Ivan Kobyzev, Abbas Ghaddar, Ali Nasiri-Sarvi, Lifeng Shang, Yufei Cui
top venue similarity 0.54
Abstract · NeurIPS 2026 (Oral)

State Space Models (SSMs) compress sequence history into a bounded recurrent state, making the resulting memory law a central architectural choice for long-context performance. Most modern SSMs rely on ODE-based dynamics that lead to exponential forgetting, limiting their ability to retain information over broad temporal ranges. We introduce FRAC, a selective SSM architecture derived from fractional dynamics that replaces this exponential decay with power-law long memory. To make fractional dynamics practical, FRAC approximates the heavy-tailed target kernel with a finite-state, log-spaced sum of exponential modes. This construction turns fractional memory into an efficient recurrent module with parallel training and prefill, while retaining bounded-state autoregressive decoding. Extensive experiments, including 1.3B-parameter language modeling, demonstrate that FRAC consistently improves long-context performance over state-of-the-art SSM baselines while staying competitive on short-context. These results show that fractional dynamics provide a practical and effective prior for long-context SSMs.

0.36

Grid-Refinement SBL for AFDM Channel Estimation Under Fractional Delay and Fractional Doppler Channels

eess.SP ·2026-10-30 ·Qu Luo, Limin Liu, Zhe Li, Qihao Peng, Haowei Wu +1 more
published similarity 0.53
Abstract

This paper investigates channel estimation for affine frequency division multiplexing (AFDM) systems over channels with fractional delay and fractional Doppler (FDFD) shifts. An exact FDFD channel model is first established, and the corresponding input--output relationship is also derived. To address the FDFD-induced delay--Doppler coupling, a first-order linear approximation grid-refinement sparse Bayesian learning (FLA-GR-SBL) method is developed. To further remedy the convergence and stability issues caused by the limited accuracy of the first-order approximation, we propose a two-dimensional grid-approximation SBL (2D-GA-SBL) algorithm, which iteratively refines the delay--Doppler grid and thereby characterizes the channel more accurately. Simulation results demonstrate that the proposed algorithms significantly outperform existing on-grid and off-grid SBL benchmarks in terms of both normalized mean square error (NMSE) and bit error rate (BER).

0.38

Drift-admissibility via Optimal Transport

cs.LG stat.MLmath.OC ·2026-09-10 ·Abigail Langbridge, Enrico Biffis, Jakub Mareček, Robert Shorten
similarity 0.53
Abstract · 10 pages; 3 figures; 2 tables

We introduce structure-aware optimal transport diagnostics for assessing whether empirical time-series dynamics are compatible with a prescribed predictable-drift class. Our approach translates a pathwise property of stochastic processes into a finite-dimensional projection problem over empirical transition laws, encoding admissibility as row-wise moment constraints on local couplings and quantifying deviations via a Kullback--Leibler projection gap $G_{λ,k}$. This yields both a principled diagnostic and a scalable Bregman--Dykstra algorithm that retains the efficiency of Sinkhorn-type methods while incorporating structural constraints. Calibrated against a Brownian reference null, $G_{λ,k}$ separates process classes that are indistinguishable by second-order statistics alone---including fractional Brownian motion and BSS processes sharing identical Hurst indices---without asymptotic resampling or continuous-time recovery. This positions the method as a general tool for structure-aware model validation of sequential data.

0.32

On Stochastic Continuous-Time Linear System Identification for Adaptive Stabilization

cs.LG stat.ML ·2026-11-02 ·Reza Sadeghi Hafshejani, Mohamad Kazem Shirani Faradonbeh
similarity 0.49
Abstract

System identification studies the canonical problem of reliably learning system-dynamics from state and input trajectories. One of its important applications consists of estimating a feedback gain matrix that can stabilize an unknown system. This paper focuses on the analysis of such adaptive stabilization schemes for multivariate linear time-invariant state-space models. The system instability practically renders trajectories short, i.e., the observed data is notably limited. So, it is crucial to tightly consider effects of \emph{all} involved quantities including length and number of trajectories, dimension, controllability Gramian, and signal-to-noise ratio. We put forward a simple, practical, and reliable relationship between the chance that adaptive stabilization (based on system identification) fails to stabilize the system, in terms of all the above-mentioned quantities. Our findings show that despite exponential effects of all other quantities on failure probability, such effects do not hold for signal-to-noise ratio. More specifically, this study shows that the strength of the excitation signal helps stabilization only \emph{logarithmically}; a very important phenomenon that we explain under the term \emph{signal saturation}.

0.29

Learning Linear Systems under Heavy-Tailed Noise: A Non-Asymptotic Analysis from A Single Trajectory

cs.LG eess.SY ·2026-09-30 ·Xiaomian Yang, Sungho Shin
similarity 0.49
Abstract

We establish non-asymptotic sample complexity bounds for the least-squares estimation of vector autoregressive models for exponentially stable systems with heavy-tailed noise based on a single observed trajectory. By assuming i.i.d. noise, bounded noise covariance, and persistent excitation, we show that the estimation error is $\widetilde{\mathcal{O}}(r^{1/2}T^{-1/2+1/p})$ under bounded $p$th moment for $p > 2$, where $T$ is the number of samples, $r$ is the noise dimension, and $\widetilde{\mathcal{O}}(\cdot)$ hides logarithmic terms. We also introduce a unifying approach to sample complexity analysis applicable to broad classes of noise distributions and showcase this by deriving error bounds for sub-exponential and sub-Gaussian noise distributions. Finally, we specialize our analysis to autoregressive models with exogenous inputs and show that the dimension factor of the error bound is independent of the model order.

0.20

Model-Order-Adaptive Channel Estimation for AFDM Systems with Fractional Delay and Doppler

cs.IT ·2026-10-07 ·Ruizhe Wang, Cunhua Pan, Hong Ren, Shaohua Li, Jiangzhou Wang
hot direction similarity 0.49
Abstract

Affine frequency division multiplexing (AFDM) has emerged as a promising waveform for high-mobility communications owing to its ability to exploit multipath diversity. However, channel state information (CSI) acquisition remains challenging in channels with fractional delay and Doppler and an unknown number of propagation paths. In this paper, we investigate the channel estimation for AFDM systems. We first analyze the AFDM response in the presence of fractional-delay-induced frequency wrapping. The analysis reveals that fractional delay may displace the dominant extremum and generate informative secondary extrema. Then, we develop a model-order-adaptive channel estimator within an improved space-alternating generalized expectation-maximization (SAGE) framework. A dual-pilot reference symbol is employed for path and delay initialization, while pilot observations across multiple AFDM symbols provide temporal information for Doppler estimation. New paths are identified through statistically controlled residual tests, whereas unsupported or redundant paths are removed by conditional support pruning. The delay, Doppler frequency, and complex gain of each retained path are subsequently estimated through a coarse-to-fine procedure and refined using the exact AFDM likelihood. Simulation results demonstrate that the proposed method achieves lower normalized mean squared error (NMSE) and bit error rate (BER) than representative SAGE, sparse-recovery, and Bayesian benchmarks. It also provides reliable path detection and model-order estimation and maintains robust performance at terminal velocities of up to 600~km/h.

0.25

The Cost of Long Memory: State, Context, and Stability Complexity in Sequence Models

cs.LG ·2026-09-24 ·Yuheng Song
theory similarity 0.49
Abstract · 49 pages, 2 figures

Long-range temporal dependence poses a resource question for sequence models: for a specified predictive-memory law, how much state, context, or dynamical criticality is required in order to forecast accurately? We study this question directly in forecasting risk. For algebraically decaying predictive memory, we prove matching upper and lower approximation bounds for exponential and finite-state modes. The best $r$-mode forecast error decays as $e^{-Θ(\sqrt r)}$, so reaching forecast error $τ$ needs $r=Θ(\log^2(1/τ))$ states or modes. Earlier curse-of-memory results establish broad limitations of stable recurrent models under different approximation notions; here both sides match for one canonical predictive target in forecast risk, which fixes the optimal resource exponent for that target. We then show that genuine fractional long memory changes the geometry itself. In particular, forecast error is measured after fractional integration, prediction from a finite context of length $L$ has an exact $1/L$ leading order, and a fixed fractional strength $d$ keeps the square-log state-complexity law. Near the short-memory boundary, we identify the relevant $d^2$ and $d^4$ scales and give a uniform constructive law in the intermediate regime. For nonlinear contextual recurrences with uniformly contractive state dynamics, we derive an exponential first-chaos envelope and an explicit necessary condition that relates forecast accuracy to the contraction margin. Vanishing forecasting error on an algebraic target forces the recurrence quantitatively toward criticality, a condition that is necessary and not by itself sufficient. Finite-sample Kullback--Leibler calculations further connect the predictive geometry to statistical information. Theorem-matched experiments with contractive state-space, gated recurrent, and attention models reproduce the state and stability predictions.

0.26