CS Paper Radar

Moving Beyond the DRW Model: Learning Quasar Variability with Generative Models

Nadav Bojan Sellam, Kevin Park, Alex Bronstein, Zoltán Haiman

cs.AI astro-ph.GA ·submitted 2026-11-11 04:59 UTC · v1

Abstract

The optical continuum variability of quasars is often described by a damped random walk (DRW) model, with characteristic damping timescales $τ_{\rm DRW}$ of hundreds of days and amplitudes $σ_{\rm DRW}$ of $\mathcal{O}(0.1)$ magnitudes. This model has been widely used as a null hypothesis to assess the significance of periodic signals in quasar light curves in the search for supermassive black hole binaries, the significance of extreme quasar variability like tidal disruption events (TDEs) and changing-look (CL) quasars, or to model time lags in reverberation mapping. However, the DRW model is known to be incomplete, and an incorrect null hypothesis can lead to biased significance estimates. We investigate the impact of such null-hypothesis mis-specification on the detection of periodic signals in synthetic quasar light curves and introduce the generative model Nullasar, capable of learning quasar variability directly from time-series data. We demonstrate that Nullasar, trained with flow matching, can learn delicate statistical properties of stochastic light-curve variability without explicitly assuming any noise model. We further demonstrate that Nullasar can learn correlated distributions of noise parameters and generate new light-curve realizations from a range of deviations from the Gaussian DRW noise model, approximating parametric descriptions of stochastic processes. When used as a null hypothesis for detecting periodic signals in synthetic light curves, Nullasar performs comparably to fitting the correct DRW model to each light curve, and outperforms parametric fitting when the variability follows a more flexible AR(2) model. Finally, we identify practical limitations, including sensitivity to contamination of the training set by non-null signals, and show that projecting the conditioning vector of the model onto its leading principal components largely mitigates it.

Closest papers

Nearest neighbours by meaning across the whole index.

EncoTESS: Age-Sensitive Encodings from Raw TESS Light Curves

cs.LG astro-ph.SRastro-ph.GAastro-ph.IM ·2026-08-25 ·Phil R. Van-Lane, Joshua S. Speagle, Ryan Cloutier, Christopher A. Theissen, Gwendolyn M. Eadie +1 more
code/data similarity 0.59
Abstract · 36 pages, 23 figures (including appendices)

Main sequence stars of spectral types late F through M exhibit systematic variability in photometric light curves, particularly when they are young. Rotational modulation of starspots manifests as quasi-sinusoidal variability, which enables the measurement of rotation periods. Variability can also be stochastic, as in stellar flaring. However, since measurements of stochastic processes depend on the time of observation, they are typically noisier. Considering that different manifestations of variability have unique observational nuances, models that naturally unify these are incredibly useful for stellar characterization. Towards this goal, we have developed EncoTESS: a Time Series Foundation Model (TSFM) trained on a subset of TESS 2-min light curves. EncoTESS is specifically designed to handle the observational noise, heteroskedastic measurements, irregular sampling, and large data gaps common to TESS data. It is also ~1% of the size of a typical literature TSFM, so can be run easily on a modern laptop. EncoTESS encodes light curves into a fixed-size latent parameter space, which can be used to infer physical stellar properties and recovers light curve summary statistics well. EncoTESS outperforms rotation period and variability amplitude as age indicators for stars that have not converged onto the slow rotator sequence yet; broadly these include K and M stars less than ~100 Myr, and M stars less than ~1 Gyr. We focus on age inference as an application of EncoTESS in this work, but other downstream tasks such as stellar classification could also be explored. The architecture of EncoTESS enables its future extension to TESS light curves of all cadences, and additional surveys such as Kepler and the upcoming PLATO mission. The core EncoTESS framework and library of encodings produced for the stars used in this work are publicly available at https://github.com/philvanlane/encotess.

0.60

Feature-Based and Deep Learning Methods for Astronomical Light Curve Classification

cs.LG astro-ph.IM ·2026-11-03 ·V. Baymakanov, Kh. Khamitov, A. Raimova, A. Isaeva, R. Taran +5 more
hot direction similarity 0.56
Abstract · 14 pages, 5 figures. Submitted to Moscow University Physics Bulletin (DLCP-2026 special issue)

We compare feature-based machine learning and end-to-end deep learning for variable star classification using the Zwicky Transient Facility (ZTF) StarEmbed dataset, which contains about 40,000 objects across seven imbalanced classes. Classical models trained on physically motivated features consistently outperform deep networks trained directly on raw light curves. We find that limited labeled data contributes to the performance gap, while the multivariate, irregularly sampled, and morphologically diverse nature of light curves poses additional challenges for deep learning models. While deep learning holds promise for learning representations directly from observations, our results indicate that current models fail to generalize with the available training set size. These findings motivate further investigation of the benefits of scaling labeled datasets and self-supervised pretraining on large unlabeled surveys. This work establishes a quantitative baseline for future research and highlights the need for further innovations to unlock the potential of deep learning in astronomical time series analysis.

0.28

Continuous Delayed-Memory Stochastic Gradient Descent and Continuous-Time Reinforcement Learning from History of Astrophysical Time Series Studies

cs.LG stat.AP ·2026-09-17 ·Juncheng Yi
similarity 0.55
Abstract · Keywords: Stochastic process, Stochastic gradient descent, Continuous-Delayed-Memory Stochastic Gradient Descent, Stochastic Delay Different…

Quasars are luminous objects in the universe that exhibit stochastic brightness variations encoding information about the supermassive black holes powering them, and modeling these variations from ground-based survey data time series, known as light curves, is a statistical challenge. This paper reviews how stochastic differential equations (SDEs) have been adapted with neural network parameterizations to overcome this challenge in history. We create the Continuous-Delayed-Memory Stochastic Gradient Descent which depend on the past state of the discrete iteration process. We performed the simulation on some 2-dimensional landscape and observed some wider-exploration and more precise convergent behavior compared to Vanilla SGD by adjusting hyperparameters. Besides, we proposed a reinforcement learning structure with continuous time policy gradients for exploratory policies without solving HJB PDE, and we show that its optimality conditions recover the Gibbs policy of previous works.

0.26

Deterministic denoising of long-duration gravitational-wave signal candidates with $α$-(de)blending

cs.LG gr-qcastro-ph.HEastro-ph.IM+1 ·2026-09-14 ·Przemysław Figura, Michał Bejger
similarity 0.54
Abstract · 23 pages, 12 figures. Submitted to Classical and Quantum Gravity

We present a deterministic machine-learning method for denoising candidate signals from all-sky searches for continuous gravitational waves from rotating neutron stars. Using the time-domain $F$-statistic search pipeline, we post-process the resulting $F(f,\dot{f})$ candidate patterns with iterative $α$-(de)blending, a deterministic diffusion-type generative model implemented as a U-Net, well suited to the non-Gaussian, correlated noise of the $F$-statistic output. Two models, trained on data based on simulated 6- and 12-day time-domain segments with software-injected signals similar to the LVK hardware injections, are tested by comparing deblended images to the library of expected signal patterns via the Structural Similarity Index Measure. In general the method recovers the correct sky-position-dependent pattern for signal-to-noise ratios $ρ\gtrsim 4$, moderately below typical all-sky detection thresholds, with recovery depending strongly on pattern morphology, demonstrating that deterministic diffusion-based denoising may serve as a consistency/veto tool ahead of the semi-coherent coincidence stage. We also discuss limitations and possible improvements of the method.

0.25

A Mechanistic Interpretability Study of an Astronomy Foundation Model

cs.LG astro-ph.IM ·2026-11-11 ·Rachel C. Zhang, Alberto Bietti, Wes Gurnee, Alessandro Favero, Miles Cranmer
published similarity 0.52
Abstract · Accepted at NeurIPS 2026. A condensed version was selected for an oral presentation at the NeurIPS 2026 Workshop on Interpretability for Dis…

Foundation models are increasingly used across the sciences, but whether their internal computations correspond to known scientific operations or proceed through different mechanisms remains unclear. Understanding these mechanisms is essential for assessing reliability, identifying failure modes, and learning new science from the models. We present, to our knowledge, the first causal mechanistic interpretability study of an astronomy foundation model, AION-1, focusing on its multimodal advantage in redshift prediction, where combining imaging with photometry outperforms photometry alone. We find that this advantage is largest for spatially extended and dust-attenuated galaxies, and that most of it is localized to the first of the encoder's twelve blocks. Within that block, how well a property is linearly decodable does not predict whether it can be localized. Spatial extent is causally used, and one attention head dominates linear probing for it, yet ablating that head has negligible effect on redshift prediction: the information is distributed across heads and is decodable again one layer after we erase it. Dust attenuation shows the opposite pattern: it is only weakly decodable anywhere in the encoder, yet a single head is necessary for most of the multimodal advantage, particularly for the most dust-attenuated galaxies, and keeping that head as the only active head in its block preserves nearly all of the advantage. None of the astrophysically motivated operations we tested explains what this head computes. Whether this reflects a limitation of current interpretability methods or a computation that does not correspond to any known astrophysical operation remains open, and resolving it is a prerequisite for using interpretability as a tool for scientific discovery.

0.28

Improving the Sensitivity of Gravitational Wave Detection with Weighted Conformal Prediction

cs.LG gr-qcstat.ML ·2026-09-10 ·Ann-Kristin Malz, Gregory Ashton, Nicolo Colombo
publishedhot direction similarity 0.52
Abstract

In the last decade, kilometre-scale interferometric gravitational-wave detectors have observed hundreds of compact binary mergers, the majority of which are binary black holes. However, the data are noise-dominated, and multiple independent search algorithms (pipelines) are used to enhance sensitivity and improve robustness. Rather than the standard approach of selecting the most significant pipeline output, we combine the outputs from all pipelines using a conformal prediction-based framework to provide statistically rigorous confidence estimates for candidate events. While combining pipelines improves sensitivity and ranking robustness, it requires a principled statistical framework that remains valid as data properties evolve across observing runs. A key challenge is distribution shifts between simulated datasets used for training and calibration and the real, unlabelled, observations used for testing, which can invalidate coverage guarantees and bias confidence estimates. In this work, we address this challenge by incorporating likelihood-ratio reweighting into our conformal prediction framework to account for covariate shift. Using mock datasets containing simulated signals, we demonstrate that weighted conformal prediction restores well-calibrated coverage under covariate shift and increases the confidence of events near the detection threshold, recovering true signals that would otherwise be missed.

0.46

Survey of Novel Deep Learning Architectures for Denoising Gravitational-wave Signals

cs.LG gr-qcastro-ph.HEastro-ph.IM+1 ·2026-09-07 ·Rohan Raha, Prayush Kumar
surveybenchmark similarity 0.52
Abstract · Submitted to "Machine Learning: Science and Technology", 52 pages, 35 Figures, 8 Tables

Gravitational-wave denoising must handle the full diversity of spinning, precessing binaries, since the recovered waveform underpins parameter estimation, tests of general relativity, and population studies. Matched filtering achieves this at a cost that becomes prohibitive as next-generation detectors push event rates higher; deep learning offers real-time reconstruction, but current methods are developed on narrow parameter spaces, precluding principled comparison and reliable deployment. We present the first controlled comparison of five neural-network architectures for gravitational-wave denoising, trained identically across the full astrophysically-motivated spinning binary-black-hole parameter space. A unifying principle emerges: matching network structure to the spectral anatomy of a coalescence -- inspiral, merger, ringdown -- outperforms brute-force model scaling. Our Multi-Scale Frequency-Aware architecture embodies this via dedicated parallel branches per frequency regime, achieving the best fidelity while using fewer parameters than larger models. It generalizes from simulated training to real LIGO-Virgo-KAGRA data without retraining, recovering merger morphology across confirmed events spanning three observing runs and both detectors, despite training on a single detector's simulated noise. We construct population-level uncertainty bands from denoising residuals, validate their calibration, and stress-test the framework on extended mass ratios and a spin population resembling hierarchical-merger remnants. Applied to real noise with no known signal, the network suppresses its output almost everywhere, with rare exceptions traced to noise transients rather than a general weakness -- indicating the statistic discriminates signal from noise and motivating a future detection study. Released weights give a deployable, reproducible benchmark for future extensions.

0.33

Evaluating Generative Time-Series Models on Data with Point Masses

cs.LG cs.AI ·2026-08-10 ·Jian Xu
benchmark similarity 0.51
Abstract

Many of the series that generative time-series models are benchmarked on place a large probability mass on a single value --- it does not rain, no ride is requested, no part is ordered. We report what happens when such data is evaluated carefully. First, the standard rolling-origin protocol can score a model on a window whose atom structure bears no resemblance to the dataset: on one benchmark the dataset is $42\%$ zeros and the evaluation windows are $13\%$, on another $47\%$ against $5\%$. This is not a cosmetic problem --- it reversed one of our own conclusions, turning the strongest occurrence model in our study into what looked like a cautionary tale. Second, we give a control in which CRPS is invariant \emph{by construction} while the temporal coupling is destroyed, which measures exactly how much that coupling contributes to a chosen statistic. Third, benchmarking seven models on a matched protocol over five seeds, an autoregressive hurdle beats a conditional flow on five of six datasets, by up to a factor of $153$, while the flow's own occurrence statistics vary by up to $62\%$ across training seeds and every baseline is deterministic. Finally, the model ordering is not the same under five different occurrence statistics, and the two that do not share a construction agree with each other least.

0.04