CS Paper Radar

Frame bounds and bandwidth tiling for time-causal bandpass wavelets

Jens E. Pedersen, Tony Lindeberg, Peter Gerstoft

eess.SP math.NA ·submitted 2026-09-15 13:54 UTC · v2

Abstract

Wavelets and frames that provide strong guarantees for signal representations are a cornerstone in signal processing theory, but have long been restricted to non-causal settings. Recent work extended wavelet analysis to time-causal systems that operate on streaming signals, with exact reconstruction and time-recursive implementations. However, the frame guarantees that make such representations reliable under noise and quantization are uncharacterized. We derive closed-form frame bounds and conditioning on band-limited domains, together with peak frequencies, constant-Q bandwidth tiling, and spectral decay rates for time-causal bandpass wavelets. Our work provides design rules for the scale ratio and channel count, which we validate numerically against discrete implementations of the causal wavelets in terms of recursive filters.

Closest papers

Nearest neighbours by meaning across the whole index.

Phase Retrieval of Bandlimited Signals Using a Morlet Wavelet and an Admissible Companion

cs.IT math.CA ·2026-10-29 ·Bei Liu, Meng Ning, Liping Wu, Qingyue Zhang
theory similarity 0.53
Abstract

In this paper, we demonstrate that complex bandlimited signals can be uniquely recovered (up to a global phase factor) from two families of wavelet transform magnitudes, sampled at twice the Nyquist rate in two frequency bins. These families come from translations of the fixed dilated Morlet wavelet and a fixed companion wavelet. The companion wavelet admits an augmented Morlet--Gaussian representation. We rewrite the two families as two modulated Gaussian convolution measurements of an auxiliary bandlimited signal. Using a Gaussian convolution uniqueness result, we prove that samples on \((4B)^{-1}\mathbb{Z}\) determine every signal in \(PW_B^2\) (up to a global phase factor). Compared with earlier wavelet phase retrieval results, our approach requires significantly fewer sampling points.

0.31

Wavelet Flow Matching for Time Series

cs.LG cs.AI ·2026-09-30 ·Lucas Poinsignon, Jorge da Silva Goncalves, Samuel Ruiperez-Campillo, Julia E. Vogt
benchmark similarity 0.51
Abstract · 45 pages, including appendix; 11 figures, 13 tables

Synthetic time series are increasingly used for data augmentation, privacy-preserving data sharing, and downstream model development, yet faithfully reproducing both multi-scale temporal structure and cross-channel dependencies remains challenging. We study multivariate time-series generation through flow matching in the wavelet domain. By operating on multilevel discrete wavelet coefficients rather than directly in the time domain, the model represents coarse structure and progressively finer details at separate scales. Their naturally different variances further induce an implicit coarse-to-fine generative process without requiring an explicit multi-scale schedule. Since the transform acts independently on each channel, we pair it with a channel-token transformer whose attention directly models cross-channel dependencies. Across seven benchmark datasets and four sequence lengths, our method is best or tied on a majority of dataset-metric combinations, with the largest and most consistent improvements in Context-FID and discriminative score.

0.24

Multi-Threshold Sampling: Signal Space, Sampling Operators, and First Recorded Crossing-Time Distributions

eess.SP physics.ins-det ·2026-09-10 ·Ao Qiu, Qingguo Xie
theory similarity 0.51
Abstract

Multi-threshold (MT) sampling records crossing times for parameter estimation and waveform reconstruction. We develop signal and observation spaces and stochastic crossing, timing, and selection operators with associated Markov kernels. Finite point measures accommodate variable crossing counts and preserve multiplicity after quantization. For nonhomogeneous Poisson photon arrivals with shared threshold noise, shared timing jitter before quantization, and identity selection, we derive exact first recorded crossing-time distributions. A Poisson series covers general admissible paths with a time-uniform truncation bound. For continuous paths, interval extrema give the exact cumulative distribution function (CDF) and a Fourier representation with contact corrections. A biexponential arrival-intensity and response model admits a two-dimensional first-crossing integral equation on arbitrary finite observation windows, with a unique bounded measurable solution and a Poisson-tail approximation bound. For continuous causal responses with finitely many analytic pieces and bounded first and second branch derivatives, we prove a conditional standard-deviation (SD) limit at first mean crossings with positive slope under relative threshold-noise and fine timing scales. For the biexponential model, its coefficient increases strictly on a parameter-uniform interval and, under a shape condition, up to the first mean peak. Scintillation experiments compare the calculated CDF and conditional SDs with independent waveform simulations on a window extending beyond the single-photon response peak.

0.42

Universality and Generalization of Causal Transformers Across Context Lengths

cs.LG math.OCstat.ML ·2026-09-28 ·Takashi Furuya, Maarten V. de Hoop, Gabriel Peyré
similarity 0.49
Abstract

Long contexts are central to modern transformer systems, but most expressivity results choose a different network for each fixed sequence length. We study whether one masked transformer can approximate causal token-to-token maps uniformly over sequences of arbitrary length sampling a fixed normalized horizon. To relate sampling resolutions, we model tokens by $α$-Hölder sequences or, more generally, a common modulus of continuity. Our notion of continuity across resolutions characterizes the causal families admitting uniform approximation on these compact input classes by a single transformer with length-independent parameters. The result extends to the infinite-length mean-field limit, where tokens form continuous curves and masked attention becomes a causal time integral. For bounded regression with target maps satisfying a $β$-smooth stability condition defined using regular test functions, quantitative approximation yields a generalization bound: exact empirical risk minimization over suitably sized bounded-weight transformers gives root mean-square prediction error $O((\log\log N/\log N)^{β/(d+2)})$ from $N$ iid labeled sequences. The bound holds at fixed confidence on the same sampling distribution, with $d$ the token dimension and no maximum-length factor. Finally, experiments on physical time series support the Hölder-regular token model at observed scales, with dataset-dependent fitted exponents, whereas text input embeddings provide a contrasting case. Native and dense sampling, shuffled controls, and refinement checks delimit this empirical regularity regime.

0.24

Neuralized Multi-Wavelet Decomposition for Time Series Classification and Forecasting

cs.LG cs.AI ·2026-09-24 ·Xiaohan Jiang, Jingyuan Wang, Jiahao Ji, Yongyao Wang, Chen Yang +1 more
top venue similarity 0.49
Abstract · 17 pages, 3 figures

Time series analysis is fundamental in domains such as finance, healthcare, and meteorology. Real-world time series often exhibit multiscale characteristics shaped by diverse latent factors, resulting in intricate temporal patterns and rich frequency structures. However, existing approaches typically focus on either frequency-domain decomposition or time-domain pattern extraction in isolation, neglecting their joint structure. This decoupled modeling limits representation expressiveness and undermines performance in tasks requiring simultaneous temporal and spectral reasoning. To address this gap, we propose m-WCN, a novel end-to-end deep learning framework that neuralizes multi-wavelet decomposition for joint extraction of temporal patterns and frequency components. By approximating the classical GHM multi-wavelet transform with trainable convolutional operators and enforcing orthogonality constraints, m-WCN produces interpretable multi-resolution representations. Built on this foundation, we introduce two task-specific architectures: TFBC for time series classification, which boosts discriminative features across frequency scales, and FTB for forecasting, which ensembles frequency-aware predictors. Extensive experiments on 64 UCR datasets and seven public forecasting benchmarks demonstrate the effectiveness of our approach. Built on the neuralized m-WCN, our TFBC and FTB outperform various baseline models across diverse datasets, achieving average improvements of 19.97% in classification and 19.92% in forecasting tasks.

0.40

WinoTS: Wavelet-based Self-Distillation for Time Series Models

cs.LG cs.AI ·2026-09-30 ·Noam Major, Kathy Razmadze, Yoli Shavit
similarity 0.49
Abstract

Self-supervised pre-training of time series models is currently dominated by next-token prediction and reconstruction objectives. In continuous-valued domains, these paradigms often waste model capacity on high-frequency, point-wise noise at the expense of learning invariant structure. While invariance-based self-distillation has proven highly effective in computer vision, its application to temporal data remains largely underexplored. Effectively adapting such methods to time series requires carefully designed augmentations: spatial operations like cropping can shift the timing of repeating cycles or distort the signal, while basic jittering may provide limited variation. We introduce Wavelet-based self-distillation for time series (WinoTS), an invariance-based pre-training paradigm designed specifically for temporal signals. At its core, WinoTS leverages time-frequency augmentations to construct multi-scale structural views without distorting underlying signal dynamics. Across extensive evaluations, WinoTS outperforms state-of-the-art baselines in long-term forecasting, cross-domain zero-shot transfer, and unsupervised anomaly detection. Notably, linear probing on frozen WinoTS representations frequently surpasses fully supervised models trained from scratch. Systematic ablations demonstrate that WinoTS is a flexible, architecture-agnostic framework yielding gains across time series backbones, and establish that time-frequency transformations provide a principled alternative to vision-style spatial augmentations.

0.28

Frame-Wise Streaming for Efficient Learned Speech Compression

cs.SD eess.AS ·2026-10-15 ·Yuhan Liu, Jun Xu, Fengxi Zhang, Zhengxue Cheng, Li Song
top venue similarity 0.48
Abstract

Speech compression is increasingly important in scenarios such as real-time and satellite communication. Neural codecs have shown superior Rate-Distortion (RD) performance over traditional signal-processing codecs. Models with long-range dependency encoders/decoders and entropy models outperform convolution-based structures, but they still lack streaming support since they rely on sequence-level correlations. In this paper, we propose StreamLSC, a frame-level streaming learned speech compression model built on three fundamental components of streaming networks, i.e. Boundary-Cached Causal Convolution, Intra-Frame Layer Normalization, and RNN-mode RWKV. Our model incorporates a streamable entropy quantizer module, ensuring efficient context model while preserving causal constraints. Experiments show that the streaming model achieves performance comparable to its offline counterpart, attaining state-of-the-art rate-distortion results, significant gains in subjective evaluations, -51.37% (ViSQOL) and -53.99% (PESQ) BD-RATE savings on average, and improvements of 0.2154 and 0.5156 in BD-ViSQOL and BD-PESQ.

0.25

TWIG: A Time-Causal Wavelet Operator for Autoregressive Forecasting on Irregular Graphs

cs.LG ·2026-09-18 ·Subashree Venkatasubramanian, David A. Barajas-Solano, Chuyang Liu, Daniel M. Tartakovsky, Dipankar Dwivedi
benchmark similarity 0.47
Abstract · 23 pages, 5 figures. Preprint

We introduce TWIG (Time-Causal Wavelet Operator for Irregular Graphs), a graph-native neural operator for autoregressive surrogate modeling on static irregular graphs. TWIG transforms each node history into causal multiscale temporal features that separate recent variation from progressively slower memory components, then propagates these features through graph-wavelet operator blocks with gated pointwise channel mixing. The architecture is causal by construction and designed for closed-loop forecasting, where predictions are recursively reused as future inputs. We evaluate TWIG on three irregular-domain forecasting problems spanning regional diffusion, three-dimensional subsurface hydrology, and aerodynamic flow, with graphs ranging from 400 to 5,233 nodes and model capacities from approximately 70k to 10M parameters. TWIG achieves the lowest aggregate rollout errors on the subsurface-hydrology and regional-diffusion benchmarks and ranks second on the 10M-parameter aerodynamic-flow benchmark, behind the GPS Transformer. Across all three settings, TWIG consistently outperforms the corresponding non-time-causal Graph WNO baseline. These results demonstrate that TWIG provides an effective and scalable approach to stable autoregressive forecasting of dynamical fields on irregular graphs.

0.34