CS Paper Radar

Efficient Regression Models for Scan Statistics

Gazi Abdur Rakib, Tristan Ashton, Ryan A. Loomis, Brian S. Mason, Eric J. Murphy, Ci Xue, Jeff M. Phillips

cs.LG stat.ME ·submitted 2026-08-23 03:44 UTC · v1
unusual

Abstract

We introduce a new class of regression models for scan statistics on real-valued signals. These allow for improved fitting of non-stationary signals to contrast with the interval anomalies identified by the scan statistics. Our models can represent generalized likelihood ratio statistics. While these methods naively require $O(n^4)$ for a length $n$ signal, we provide algorithmic improvements which lead to linear time algorithms (with assumptions on max interval width). Our methods, especially ones based on Nadaraya-Watson kernel regression, are demonstrated as especially effective in detecting both synthetically planted anomalies, and for identifying a real ``platforming'' issue in interferometric astronomy.

Comment
38 pages, 22 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Exploring Long-period Architectures: Four New Planet Candidates from Kepler with Periods >342 days

cs.LG astro-ph.EPastro-ph.IM ·2026-08-24 ·Matthew T. Hansen, Jason A. Dittmann
published similarity 0.53
Abstract · 23 pages, 19 figures, 9 tables, published in AJ

The Kepler detection pipeline, as well as the transit method, has a bias towards shorter periods, leaving a dearth of detections at longer orbital periods. This relative lack of detections has left an incomplete picture of the architectures of exoplanet systems within the long-period regime. We have built a single transit detection pipeline, utilizing a classification convolutional neural network and the onboard spacecraft diagnostics of the Kepler spacecraft, to detect long-period planets. We apply our pipeline to all currently known planetary systems in the Kepler field hosting at least one planet with an orbital period longer than 6 days. We manually vet all new signals from our pipeline, and identify four new planetary candidates, all of which are in systems where the inner planets exhibit transit timing variations (TTVs). Two of these candidates, Kepler 1752.02 and Kepler 199.03, cause two transit events that are consistent with periods of $777.78^{+0.01}_{-0.02}$ and $505.495^{+0.004}_{-0.004}$ days, and radii of $3.55^{+0.15}_{-0.15}$ and $2.74^{+0.05}_{-0.05}$ $R_{\oplus}$, respectively. Our remaining two candidates, Kepler 1897.02 and Kepler 1811.02, are single transit candidates with radii $4.81^{+0.20}_{-0.19}$ and $3.25^{+0.28}_{-0.30}$ $R_{\oplus}$, respectively. The shortest orbital periods for these candidates, consistent with the Kepler dataset (gaps and coverage), are 342 days for Kepler 1897.02 and 544 days for Kepler 1811.02. The new planetary candidates, on their own, are incapable of reproducing the observed TTV signals in the inner system. Although difficult to schedule, follow-up observations are needed to further constrain the new candidates and potentially discover the planets causing the perturbations.

0.39

Detecting Nighttime Anomalies from NASA Black Marble Using a Generalized Spatio-Temporally Robust Framework of Machine Leaning Ensembles

cs.LG cs.CV ·2026-10-05 ·Srija Chakraborty
similarity 0.52
Abstract · 8 pages, 5 figures, 2 tables

Nighttime lights from NASA's Black Marble product suite capture thermal and light emission signals from anomalous events including fires, volcanic eruptions, and gas flaring. Existing detection approaches rely primarily on thermal bands, limiting sensitivity to weaker signals. We propose a novel machine learning framework that jointly models Black Marble M-band and Day/Night Band (DNB) signals to derive a generalized, spatio-temporally robust ensemble of anomaly detectors. The framework iteratively builds detectors that scale across regions, seasons, anomaly classes, and extends over land and ocean. Detection sets at varying confidence levels are derived based on relevant bands and detector agreement. The approach improves true detection rate while reducing spurious detections and results demonstrate strong generalizability with applications in natural hazard monitoring and energy extraction.

0.25

Radio Interferometric Calibration with the Exponential Map

eess.SP astro-ph.IM ·2026-10-01 ·L. Cabral, M. Fernandez-Corazza, G. Gancio, P. Benaglia
theory similarity 0.50
Abstract · Submitted to IEEE Transactions on Signal Processing

The antenna-elements that make up a radio interferometer form a spatial filter that samples components of the Fourier transform of a target radio astronomical source brightness. Along the signal path, there are multiplicative and additive perturbation effects that alter the signal and that should be corrected. The process of mitigating these perturbation effects is called calibration. In this work, we develop a new and fast Maximum Likelihood based estimator of these perturbation effects using the Exponential Map and Lie groups. To evaluate its performance, we compare it to the Cramér-Rao Lower Bound and, to test the estimation time, we compare it with the Expectation Maximization algorithm, another fast Maximum Likelihood estimator. Finally, we apply our estimator to a real observation of the protoplanetary disk AS 209 made with the Submillimeter Array. We found that our proposed estimator meets the Cramér-Rao Lower Bound and it was approximately 40 times faster than the Expectation Maximization algorithm.

0.26

Solar System Surface Technosignatures: Searching for Signs of Artificial Design on Extraterrestrial Terrain

cs.LG astro-ph.IMastro-ph.EP ·2026-10-20 ·Ana Henrique, Sofia Sheikh, Benjamin Fields
similarity 0.50
Abstract

Artificial radio emissions have historically been a major focus of technosignature searches. Here, we apply an anthropological lens to expand this scope to surface technosignatures: non-random, intentional patterning on planetary terrain, similar to long-lasting human-made landscapes and monuments on Earth. On geologically inactive bodies such as the Moon and Mars, artificial traces and patterns could potentially remain visible for hundreds of millions of years. We discuss two recent developments that make this search timely: high-resolution imaging datasets, such as those produced by the HiRISE camera on the Mars Reconnaissance Orbiter (MRO), and ML-based anomaly-detection methods. Finally, we list two possible approaches to developing a model capable of searching for these surface technosignatures: a supervised and an unsupervised one. Complemented by LiDAR, ground-penetrating radar, and reflectance spectroscopy, these methods would enable the first quantitative upper limits on surface technosignatures while yielding ancillary benefits for planetary science.

0.31

Deterministic denoising of long-duration gravitational-wave signal candidates with $α$-(de)blending

cs.LG gr-qcastro-ph.HEastro-ph.IM+1 ·2026-09-14 ·Przemysław Figura, Michał Bejger
similarity 0.50
Abstract · 23 pages, 12 figures. Submitted to Classical and Quantum Gravity

We present a deterministic machine-learning method for denoising candidate signals from all-sky searches for continuous gravitational waves from rotating neutron stars. Using the time-domain $F$-statistic search pipeline, we post-process the resulting $F(f,\dot{f})$ candidate patterns with iterative $α$-(de)blending, a deterministic diffusion-type generative model implemented as a U-Net, well suited to the non-Gaussian, correlated noise of the $F$-statistic output. Two models, trained on data based on simulated 6- and 12-day time-domain segments with software-injected signals similar to the LVK hardware injections, are tested by comparing deblended images to the library of expected signal patterns via the Structural Similarity Index Measure. In general the method recovers the correct sky-position-dependent pattern for signal-to-noise ratios $ρ\gtrsim 4$, moderately below typical all-sky detection thresholds, with recovery depending strongly on pattern morphology, demonstrating that deterministic diffusion-based denoising may serve as a consistency/veto tool ahead of the semi-coherent coincidence stage. We also discuss limitations and possible improvements of the method.

0.25

Improving the Sensitivity of Gravitational Wave Detection with Weighted Conformal Prediction

cs.LG gr-qcstat.ML ·2026-09-10 ·Ann-Kristin Malz, Gregory Ashton, Nicolo Colombo
publishedhot direction similarity 0.50
Abstract

In the last decade, kilometre-scale interferometric gravitational-wave detectors have observed hundreds of compact binary mergers, the majority of which are binary black holes. However, the data are noise-dominated, and multiple independent search algorithms (pipelines) are used to enhance sensitivity and improve robustness. Rather than the standard approach of selecting the most significant pipeline output, we combine the outputs from all pipelines using a conformal prediction-based framework to provide statistically rigorous confidence estimates for candidate events. While combining pipelines improves sensitivity and ranking robustness, it requires a principled statistical framework that remains valid as data properties evolve across observing runs. A key challenge is distribution shifts between simulated datasets used for training and calibration and the real, unlabelled, observations used for testing, which can invalidate coverage guarantees and bias confidence estimates. In this work, we address this challenge by incorporating likelihood-ratio reweighting into our conformal prediction framework to account for covariate shift. Using mock datasets containing simulated signals, we demonstrate that weighted conformal prediction restores well-calibrated coverage under covariate shift and increases the confidence of events near the detection threshold, recovering true signals that would otherwise be missed.

0.46

Normality Constraint Learning: Adapting Foundation Models for Time Series Anomaly Detection

cs.AI ·2026-10-05 ·Xiaohui Zhou, Yijie Wang, Hongzuo Xu, Weixuan Liang, Guansong Pang
similarity 0.49
Abstract · 43 pages, 15 figures

Time Series Foundation Models (TSFMs) achieve strong generalization by learning to reconstruct or forecast broad temporal patterns from large-scale time series during pre-training. Yet this strength can become a weakness for anomaly detection: TSFMs may model rare anomalous patterns as effectively as normal ones, allowing anomalies to be accurately reconstructed or forecasted and thus diminishing their reconstruction/forecasting error-based anomaly scores. This paper proposes $\underline{\textbf{N}}$$\textbf{ormality}$ $\underline{\textbf{C}}$$\textbf{onstraint}$ $\underline{\textbf{L}}$$\textbf{earning}$ ($\textbf{NCL}$), a lightweight plug-and-play framework that adapts pre-trained TSFMs for accurate anomaly detection without modifying their pre-trained parameters. Our key insight is to constrain the broad pattern space of TSFMs to the normal structure of a target time series, preventing their broad modeling capability from obscuring abnormal deviations. Specifically, NCL constructs a compact normality subspace from a few normal patch features and adaptively steers each patch feature toward normality within this subspace, guided by contrastive constraints that form compact and discriminative normality manifolds. The calibrated features are aggregated to reinforce normal components and fused with the original TSFM output, amplifying the discrepancy between normal and abnormal observations for the reconstruction/forecasting error-based anomaly scoring. Extensive experiments across diverse TSFM families and benchmarks show that NCL consistently improves anomaly detection performance, providing a generalizable framework for adapting TSFMs to anomaly detection.

0.09

A Multi-Cloud View of Internet Background Radiation

cs.NI ·2026-09-18 ·Nils Kempen, Ricky K. P. Mok, Bernhard Degen, Syed Mujtaba Jafri, Ralph Holz
published similarity 0.49
Abstract

As services are increasingly centralized in public clouds, understanding the nature of Internet Background Radiation (IBR) hitting these particular environments is an important part of understanding their overall security posture. Classical network telescopes, long the cornerstone of IBR research, face hurdles here: their surface area is shrinking, and their well-known address ranges are easily avoided. We present a multi-cloud view of IBR in this paper. We deploy a passive, distributed network telescope with 336 IPs across five major cloud providers. We compare traffic from our cloud telescope with data from two classical telescopes, a large well-known (/9 + /10) and a small unknown /16, to analyze observational biases. To enable a fair comparison across very different telescope sizes, we tune a scan detection algorithm to determine appropriate thresholds. Our findings reveal that IBR in the cloud is strongly provider-dependent rather than geography-dependent, highlighting the necessity of multi-cloud deployments for comprehensive visibility of IBR in the cloud. Our cloud telescope also captures a distinct set of scanners, confirming that scanning activity is not uniform across the IPv4 space, and we confirm that small, distributed telescopes are ill-suited for observing random events like DDoS backscatter. Our work underscores that monitoring must evolve beyond classical telescopes to include diverse, multi-cloud vantage points to accurately capture IBR.

0.58