CS Paper Radar

Causal adaptive intensity estimation for non-stationary point processes: a Kalman-kernel duality framework

Hanwu Qin, Dianhai Wang, Meng Zhang, Huangjun You, Zhengyi Cai

eess.SP stat.ME ·submitted 2026-10-16 02:01 UTC · v1

Abstract

Estimating the instantaneous conditional intensity of a non-stationary point process from a single realization of discrete event timestamps is a fundamental problem in computational neuroscience, quantitative finance, and network monitoring. Traditional adaptive kernel methods achieve variable bandwidths through Abramson's square-root law, yet existing implementations require non-causal access to the complete event record and incur $\mathcal{O}(N^2)$ or at best $\mathcal{O}(N \log N)$ computational cost. Causal alternatives based on reciprocal inter-arrival times, meanwhile, suffer from systematic divergence under Poisson and bursty arrival dynamics due to Jensen's inequality. This paper addresses both limitations by establishing a formal duality between steady-state Kalman filtering and adaptive exponential kernel smoothing. An endogenous state-space observer is constructed in which Poisson counting statistics dictate the measurement noise ($R \propto λ$) and geometric diffusion governs the process volatility ($Q \propto λ^2$). Under these physically motivated axioms, the algebraic Riccati equation autonomously yields an effective smoothing bandwidth scaling as $τ\propto λ^{-1/2}$, giving a causal, recursive, $\mathcal{O}(1)$ per-step realization of square-root adaptive bandwidth scaling. A second-order constant-velocity extension produces a $λ^{-1/4}$ scaling that reduces approximation bias, and a probabilistic dormant-state gating mechanism suppresses phantom intensity leakage during structural zeros. Synthetic benchmarks together with neural and financial data show that the observer adapts across orders of magnitude in intensity with an empirical per-step cost of approximately 30\,$μ$s.

Closest papers

Nearest neighbours by meaning across the whole index.

Multi-Threshold Sampling: Signal Space, Sampling Operators, and First Recorded Crossing-Time Distributions

eess.SP physics.ins-det ·2026-09-10 ·Ao Qiu, Qingguo Xie
theory similarity 0.56
Abstract

Multi-threshold (MT) sampling records crossing times for parameter estimation and waveform reconstruction. We develop signal and observation spaces and stochastic crossing, timing, and selection operators with associated Markov kernels. Finite point measures accommodate variable crossing counts and preserve multiplicity after quantization. For nonhomogeneous Poisson photon arrivals with shared threshold noise, shared timing jitter before quantization, and identity selection, we derive exact first recorded crossing-time distributions. A Poisson series covers general admissible paths with a time-uniform truncation bound. For continuous paths, interval extrema give the exact cumulative distribution function (CDF) and a Fourier representation with contact corrections. A biexponential arrival-intensity and response model admits a two-dimensional first-crossing integral equation on arbitrary finite observation windows, with a unique bounded measurable solution and a Poisson-tail approximation bound. For continuous causal responses with finitely many analytic pieces and bounded first and second branch derivatives, we prove a conditional standard-deviation (SD) limit at first mean crossings with positive slope under relative threshold-noise and fine timing scales. For the biexponential model, its coefficient increases strictly on a parameter-uniform interval and, under a shape condition, up to the first mean peak. Scintillation experiments compare the calculated CDF and conditional SDs with independent waveform simulations on a window extending beyond the single-photon response peak.

0.42

Learning Transition Kernels of Jump-Diffusion Processes with Conditional Diffusion Models

cs.LG stat.ML ·2026-10-06 ·Yuzhen Zhao, Yating Liu, Quentin Guibert
benchmarkhot direction similarity 0.54
Abstract

We study the problem of learning transition kernels for time-homogeneous jump-diffusion processes using conditional diffusion models, with the goal of generating new sample paths from training data consisting of N independent trajectories observed on a high-frequency discrete time grid. On the theoretical side, we establish non-asymptotic bounds for the conditional score estimation error and for the KL divergence between the laws of the true and generated discretely observed paths. On the numerical side, we first evaluate our method on synthetic data to assess the theoretical findings and benchmark its performance against the approach of Gao et al. (2025). We then apply our method to real-world data and investigate its performance on a probabilistic forecasting task.

0.37

Stochastic Tracking of Drifting Affine Fixed Points

cs.LG ·2026-10-19 ·Sajad Khodadadian
similarity 0.54
Abstract · 50 pages, 2 figures

Linear stochastic approximation (SA) is widely used to estimate fixed points from noisy observations, but most finite-time analyses assume that the underlying operator remains fixed. We study linear SA with time-varying affine operators, where the fixed points change over time and the observation noise may be correlated across rounds. For constant-stepsize updates, we establish a bound on the cumulative expected squared distance between the iterates and the corresponding fixed points. The bound accounts for the initial error, observation noise, and changes in the fixed points over time. We also establish lower bounds for scalar Gaussian models, showing that, under specified conditions, a suitably chosen constant stepsize achieves the smallest possible worst-case cumulative error up to constant factors, even compared with estimators that use future observations. These results further quantify the effect of temporal correlation on estimation accuracy. Since choosing an appropriate stepsize generally requires knowledge of the noise level and how much the fixed points change, we develop an adaptive method that uses an additional bounded, unbiased observation of the fixed point to achieve an almost optimal algorithm without needing the knowledge of the noise level and the fixed point variation over time. Finally, we apply our results to value-function estimation using synchronous tabular temporal-difference learning in changing environments, assuming generative-model access and a common invariant distribution.

0.28

Instrumental Variables in Continuous-Time Stochastic Processes

cs.LG ·2026-11-05 ·Lars Pennig, Søren Wengel Mogensen, Niki Kilbertus
similarity 0.53
Abstract

Causal questions often arise in systems that evolve in continuous time. While instrumental variable (IV) methods provide a principled approach to identify causal effects in static or discrete-time settings, even in the presence of unobserved confounding, they do not yet extend to continuous-time dynamics. In this work, we develop an IV framework for stationary continuous-time stochastic processes parameterized by stochastic differential equations (SDE), where the instrument itself takes the form of a stochastic process. We encode the structural sparsity and causal effects directly at the infinitesimal level of the drift, and contrast these assumptions with the IV assumptions on the discretized version of the same process. Based on these structural assumptions, we derive moment restrictions using path-valued instruments. We show how these restrictions simplify for Ornstein-Uhlenbeck processes and present an identification condition together with a corresponding consistent estimation method. Finally, we extend our estimation framework to nonlinear causal effects by expressing the path-based moment restrictions leveraging the signature kernel. Empirically, our method recovers causal effects in confounded continuous-time systems where maximum-likelihood-based estimation and discrete-time IV methods are systematically biased.

0.14

Adaptive DOA Estimation With KL-Based Kernel Bandwidth Adaptation Under Impulsive Noise

eess.SP ·2026-10-10 ·Mojtaba Hajiabadi, Saeid Pakravan, Ghosheh Abed Hodtani, Ming Zeng
similarity 0.53
Abstract

Direction-of-arrival (DOA) estimation can degrade markedly in impulsive noise, where methods relying on Gaussian or second-order statistical assumptions are particularly susceptible to large-amplitude outliers. This paper develops an adaptive DOA estimator that employs Gaussian kernel weighting to attenuate the influence of large prediction errors while adjusting the kernel bandwidth online according to a Kullback--Leibler (KL) divergence criterion. A sample-based approximation of the KL criterion yields a recursive bandwidth update that adapts the degree of outlier suppression to the observed error statistics rather than prescribing a fixed bandwidth a priori. The spatial-filter coefficients and kernel bandwidth are updated recursively, and the DOAs are recovered from the resulting spatial spectrum. Mean and mean-square analyses are developed under standard adaptive-filtering approximations to characterize the coefficient convergence and steady-state behavior. Simulation results under Gaussian-mixture impulsive noise demonstrate stable coefficient adaptation and improved DOA estimation accuracy over representative competing methods in several challenging operating regimes, with the most pronounced gains occurring at low-to-moderate signal-to-noise ratios. The results also indicate reduced sensitivity to the initial kernel bandwidth through online bandwidth adaptation.

0.23

Causal Input--Output Modeling with Prior Information

eess.SY math.OC ·2026-11-17 ·Amirhossein Taghvaei, Daran Xu
theory similarity 0.53
Abstract

We study the problem of inferring a causal input--output model from unpaired marginal observations and a given prior coupling. We formulate this problem using entropic causal optimal transport, which seeks a coupling that preserves the observed marginals, satisfies a one--sided causality constraint, and remains close to the prior. For Gaussian marginals and general quadratic costs, we prove that the optimal coupling is Gaussian and reduce the problem to a finite--dimensional optimization over covariance matrices. Using a Cholesky transformation to simplify the causality constraint, we derive a Lagrangian dual formulation and develop a block coordinate descent algorithm with explicit update formulas. We establish linear convergence of the algorithm, with explicit convergence rates, and prove stability of the optimal coupling under marginal covariance perturbations and derive a statistical error bound. We further show its equivalence to Sinkhorn iterations. Numerical experiments demonstrate the computational efficiency of the proposed algorithm and illustrate the predictive advantages of causal couplings.

0.24

Constrained Probabilistic Numerics: Gaussian Process Solvers for Linear PDEs under Linear Inequality Constraints

cs.LG stat.MLmath.NA ·2026-10-09 ·Boyuan Deng, Kshitiz Upadhyay, Michael Shields
benchmarktheorycode/data similarity 0.53
Abstract · 9 figures, 3 tables. Code available at https://github.com/bydeng01/linpde-gp

Gaussian process solvers for linear partial differential equations (PDEs) return posteriors rather than point estimates, but they condition only on equality information: the PDE residual, boundary data, and measurements. Many solutions of interest also obey inequality constraints, including nonnegativity, monotonicity, and absence of arbitrage, which equality conditioning cannot enforce. We prove that conditioning a Gaussian process prior jointly on linear equality observations and a finite-dimensional inequality event is equivalent to conditioning sequentially in terms of Borel measures on the solution space. The physics-informed posterior is therefore a valid prior for the inequality update at virtual points. The combined law is non-Gaussian yet computable through truncated-Gaussian moments, and neither the PDE conditioning nor the inequality update requires modification. We evaluated the construction on a Poisson benchmark, option-price surfaces, and air-quality fields. Under incomplete boundary data, a monotonicity constraint lowered the error of a two-dimensional Poisson reconstruction by $63\%$. On a real S&P 500 option chain thinned to $20$ retained quotes, no-arbitrage constraints reduced held-out extrapolation error by $22\%$ and cut the calendar-arbitrage rate from $10\%$ to $1\%$. On four real air-quality snapshots, nonnegativity reduced a Gaussian moment-based sub-zero-tail proxy by $74\%$ at the sparsest monitor count. Changes in mean accuracy and constraint diagnostics differed across data regimes. The probability of the noisy virtual constraint event under the equality posterior measures agreement with the specified bounds before the update. The construction turns admissibility from a post-processing step into conditioning information for probabilistic PDE solvers.

0.39

Quickest Change Detection in Parametric Models With 1-Bit Measurements

cs.IT math.ST ·2026-08-18 ·Liyan Xie, Martina Cardone
similarity 0.52
Abstract · Accepted to IEEE Information Theory Workshop (ITW) 2026

We consider the quickest change detection from 1-bit quantized observations, where the post-change distribution is a parametric model with unknown parameters and the quantization thresholds are jointly chosen with the detection statistic. We propose an Adaptive-Quantization-Threshold CUSUM (AQuTeCUSUM) algorithm, which estimates the post-change parameter online and adaptively selects the quantization threshold to maximize the induced Kullback-Leibler divergence. Under suitable regularity conditions, we characterize the average run length and worst-case average detection delay of the AQuTe-CUSUM procedure, and show that it is asymptotically optimal in first-order as the average run length goes to infinity. Finally, we assess the performance of AQuTe-CUSUM for two distributions, namely the Gaussian and Poisson.

0.28