CS Paper Radar

Learning Latent Fields in Multiobject Tracking

Shaoxiu Wei, Bhaskar Rao, Florian Meyer

eess.SP ·submitted 2026-10-28 20:55 UTC · v2
theory

Abstract

Multiobject tracking using measurements from arrays of wireless sensors is a key task in applications ranging from autonomous navigation to public safety. Many existing methods compress raw complex-valued signals into detections or intensity maps during preprocessing, thereby discarding potentially relevant information about the objects and the propagation environment. We propose a Bayesian framework for multiobject tracking that relates object states to raw complex-valued signals via a physics-based superpositional model. The model combines a physics-based array manifold, such as radar steering vectors or the replica vectors of matched-field processing, with a latent field. This latent field is a family of context-dependent signal-power distributions that captures the effects of the objects and the propagation environment and is shared across objects and time. It is parameterized by a conditional normalizing flow, which is trained during runtime without labeled data by maximizing an evidence lower bound (ELBO) derived from the Bayesian model. Learning and inference are thus coupled in a sequential framework. We evaluate the method in simulation and in real-world radio and acoustic experiments, with spatial scales ranging from meters to kilometers, and show that it outperforms detection-based methods.

Comment
Minor wording changes to the abstract; technical content unchanged

Closest papers

Nearest neighbours by meaning across the whole index.

Normalizing Flow for Neural-Enhanced Track-Before-Detect

eess.SP cs.LG ·2026-10-18 ·Shaoxiu Wei, Bhaskar Rao, Florian Meyer
theory similarity 0.78
Abstract

Multiobject tracking (MOT) is a fundamental capability in autonomous navigation, radar and sonar systems, as well as 6G integrated sensing-and-communication (ISAC) networks. In this paper, we propose a neural-enhanced track-before-detect (TkBD) framework that operates directly on complex-valued raw signals and learns a latent representation of unmodeled propagation effects during runtime. We introduce an environment-dependent latent intensity variable that characterizes the signal power of each object in the shared propagation environment. The probability density function of this intensity variable is represented by a normalizing flow and trained online in an unsupervised manner within the sequential Bayesian inference procedure. The learning objective is derived from a variational Bayes formulation by maximizing the evidence lower bound (ELBO), thereby accounting for the uncertainties inherent in the Bayesian TkBD problem. To enable scalable inference, we make use of a recently introduced Bayesian TkBD framework that combines belief propagation, which avoids high-dimensional operations, with sequential Monte Carlo methods for efficient low-dimensional updates.

0.23

ALF: Spectrally Anchored Latent Flow Matching for Wireless Signal Generation

eess.SP ·2026-09-28 ·Yiyang Li, Sai Shankar Narasimhan, Priam Alataris, Avi Bagchi, Kaushik Chowdhury +1 more
similarity 0.61
Abstract

Wireless time-series generation is useful for emerging applications that will drive the adoption and integration of machine learning tasks within next-generation networks, such as waveform classification in shared spectrum bands and interpretation of the physical world through integrated sensing and communications. Unlike a generic time series, wireless signals have time-frequency duality, where a frequency domain bandwidth constraint implicitly imposes latent structural constraints on the evolution of the time-domain sequence. In this paper, we develop Anchored Latent Flow (ALF), a latent space flow model for label-conditioned signal generation that exploits this duality. Our flow model "reasons'" through a spectrogram, which is a 2-D representation of the signal constructed by applying a windowed Fast Fourier Transform to successive, overlapping signal segments and mapping their frequency-domain power components across time. Specifically, we shape the latent space of the flow model through a training-time auxiliary objective that is supervised by the (latent) spectrogram (i.e., anchoring through the spectrogram). By guiding the flow field to reason through a spectrogram, the generated sequence maintains long-range coherence across time and greatly improves the signal quality at inference. Empirically, ALF exhibits state-of-the-art generation quality and reconstruction error across various signal lengths, waveform classes, signal-to-noise ratio (SNR), and channel conditions, reaching a train on synthetic, test on real (TSTR) accuracy of 84.5%, a 1.9X average memory reduction, and 100X average compute speedup over existing models. Our design further enables downstream tasks, including style transfer and data augmentation, and has broad utility for the wireless community.

0.24

TRACE: Retrospective Streaming Generation of Physical Fields under Sparse Structured Sensing

cs.LG stat.ML ·2026-08-26 ·Xinyu Zhang, Lihao Chen, Panqi Chen, Lei Cheng, Ting Zhang +2 more
similarity 0.60
Abstract · 8 pages, 4 figures, 1 table (main text); 11 figures, 15 tables in the 20-page appendix. Under review at AAAI 2027

Reconstructing continuous physical fields from sparse measurements is central to scientific monitoring, inverse modeling, and digital-twin construction. Generative reconstruction has recently emerged as a promising paradigm for this task by learning data-driven physical priors that complete plausible full fields from limited observations. However, existing methods largely assume fixed, batch conditioning, whereas real sensing systems often produce structured streams: probes scan local regions, instruments observe moving fields of view, and communication constraints may leave entire frames missing. We propose TRACE, a retrospective streaming generative reconstruction framework for physical fields under structured sensing. TRACE performs approximate Bayesian inference in a learned continuous-coordinate latent space, converting sparse off-grid measurements into generative latent evidence, fusing it with a state-space temporal prior through Kalman-style filtering, and refining under-observed past frames via retrospective smoothing. Experiments on active matter, ocean sound-speed fields, and supernova simulations show that TRACE matches or surpasses frame-wise generative reconstructors, offline spatiotemporal methods, and streaming data-assimilation baselines in reconstruction quality under temporally sparse and spatially localized sensing protocols.

0.20

Adaptive Spectral-Koopman Dynamics Modeling for Temporal Domain Generalization

cs.LG cs.AI ·2026-10-02 ·Tengxue Zhang, Yu Ke, Yang Shu, Chenchen Sun, Yisheng An +2 more
code/data similarity 0.60
Abstract

Temporal Domain Generalization (TDG) has emerged to address real-world streaming data with distribution shifts over time. However, existing methods are either prone to overfitting to domain-specific noise in the data space or become overly complex and less interpretable in the parameter space. To bridge these gaps, we propose \textbf{AdaSpecK}, a spectral-Koopman framework with adaptive context extraction for TDG. To mitigate noise fitting to irregularly sampled domains, we introduce spectral-regularized Koopman dynamics modeling, which applies spectral-aware filtering in the latent space to extract denoised low-frequency trajectories and learn a Koopman operator to model the system dynamics in a linearized space. To model complex historical environments under non-stationarity, we design a context-informed heterogeneous pattern extraction mechanism. Specifically, we employ a target-conditioned attention module to attend to distinct past windows, producing a dynamic, target-specific historical summary. By constructing an environmental signature from the current evolutionary pattern, our model adaptively perceives which aspects of the past context are most informative for future prediction via a learned router. Extensive experiments on eight diverse classification and regression benchmarks demonstrate that AdaSpecK achieves state-of-the-art performance. The code and datasets are available at \href{}{https://anonymous.4open.science/r/Ada-Spec-K}.

0.32

Self-Supervised Passive WiFi CSI-Based Motion Tracking with Physics-Informed Deep SSM

eess.SP ·2026-10-25 ·Yifan Feng, Haiyao Yu, Geng Wang, Yunkai Hu, Shenghong Li +3 more
similarity 0.59
Abstract

Inferring target position from WiFi channel state information (CSI) is challenging due to the noisy and heterogeneous nature of CSI-derived observations. Measurements such as angle, delay, and Doppler provide only imperfect information about target position and velocity, particularly in dynamic multipath environments where observation reliability varies. Motivated by this challenge, this paper proposes a physics-informed Bayesian state space framework for passive CSI-based tracking. We introduce a context-conditioned deep state space model (DSSM) that captures temporal motion and environmental dynamics, while adaptively modeling time-varying observation uncertainties. By incorporating geometric constraints, this framework enables heterogeneous CSI measurement modalities to jointly regularize the consistency and confidence of the tracking process. Experimental results demonstrate that the proposed framework yields smoother trajectory estimates with reduced temporal fluctuations and outperforms existing methods in tracking accuracy.

0.18

A JEPA-Based Field-Layer World Model for Bridging Channel Prediction and Estimation

eess.SP ·2026-08-10 ·Yuzhi Yang, Brahim Mefgouda, Hang Zou, Lina Bariah, Anis Bara +3 more
similarity 0.58
Abstract · submitted to IEEE trans

Channel state information (CSI) acquisition, reconstruction, and prediction are fundamental yet costly tasks in modern MIMO-OFDM wireless systems. Direct coefficient-level prediction of raw CSI is fragile in realistic propagation environments, since small spatial perturbations, local scattering changes, and phase variations can cause large errors in the complex channel domain. However, the underlying wireless propagation field still contains stable and predictable structures that can be exploited across time, frequency, antenna, and carrier dimensions. Motivated by this observation, we propose a JEPA-based field-layer world model (FWM) that learns a shared latent propagation state from multi-resolution CSI observations across the considered carrier bands and predicts its task-relevant evolution in the latent domain. The proposed FWM maps multiple CSI observation resolutions to a shared latent propagation-field space through scale-specific tokenizer heads. A latent prediction backbone is then trained to infer masked or future field states, while an incremental multi-scale alignment strategy allows new observation scales to be incorporated without retraining the entire model from scratch. For downstream reconstruction, the predicted latent field is used as a structured prior and combined with sparse current pilots. Experiments on single-band and cross-band reconstruction demonstrate improved symbol detection and, more notably, substantial beamforming gains despite modest NMSE improvements, indicating that FWM captures task-relevant spatial propagation structure beyond coefficient-wise CSI fitting.

0.35

CoRF: Cross-Scene RF Synthesis by Learning Propagation and Preserving Array Physics

cs.NI ·2026-09-28 ·Kang Yang, Duaa Nakshbandi, Wan Du, Mani Srivastava
similarity 0.58
Abstract

Existing radio-frequency (RF) neural fields fit each scene separately, making new-scene deployment measurement- and optimization-intensive. This work studies amortized cross-scene spatial spectrum synthesis, where a shared model learns propagation across scenes and instantiates an unseen scene from sparse target-scene measurements without scene-specific training. To achieve this, CoRF separates learned scene-dependent propagation from the known receiver-array observation model. An unordered set of spectrum-only references conditions a canonical anchor field, producing arrival directions and query-dependent component powers for each query. Analytic array physics maps these components to the receiver covariance and then to the spatial spectrum. This factorization keeps the pretrained propagation model frozen, enabling synthesis at arbitrary query locations after a single reference-conditioning pass. A necessary local reference-capacity bound and an error decomposition further characterize the formulation. Across 35 simulated scenes spanning seven categories, CoRF outperforms the strongest baseline by 7.09 dB PSNR on unseen variants of represented scene categories and by 6.97 dB on entirely unseen scene categories.

0.48

Latent Score-Based Bayesian Cramér-Rao Bound Estimation for High-Dimensional Imaging Systems

cs.IT stat.MLcs.LGmath-ph+1 ·2026-10-02 ·Evan Scope Crafts, Thomas Wynn, Seonyeong Park, Mark Anastasio, Umberto Villa
similarity 0.57
Abstract

We propose a data-driven framework for estimating the Bayesian Cramér-Rao bound (CRB) in high-dimensional imaging systems with complex, analytically intractable priors. Direct CRB computation is challenging in this setting due to the need to model the prior score and to form and invert the Bayesian Fisher information matrix in very high dimensions. To address these issues, we first reformulate the inverse problem in the latent space of a pre-trained variational autoencoder, thereby dramatically reducing the dimensionality of the bound estimation problem while preserving the spatial structure of the images. The Bayesian CRB is formed in this latent space and mapped back to the native parameter space using a change-of-variables formula. Second, to learn the latent prior score, we introduce a new sliced score matching objective defined in a Bochner space endowed with an $H^1(Ω)$ Sobolev norm in space. This "Bochner-space sliced score matching" objective is consistent with standard sliced score matching, but penalizes errors in the spatial gradients of the score, suppressing high-frequency artifacts that otherwise contaminate the resulting CRB estimates. We validate the approach on a stylized quantitative photoacoustic computed tomography (qPACT) breast imaging problem with over one million unknown parameters, using a foundation-model autoencoder derived from Stable Diffusion. The proposed method yields stable, artifact-free Bayesian CRB estimates that reflect the highly non-Gaussian structure of the learned prior and reveal the substantial impact of the prior on the relative performance of competing qPACT design schemes.

0.28