CS Paper Radar

Poisson Super Learning For Survival And Competing Risks On A Discretized Time Scale

Gabriele Pittarello, Thomas Gerds, Pernille Falberg Rønn, Helene Charlotte Rytgaard

cs.LG stat.MLstat.CO ·submitted 2026-11-02 15:03 UTC · v1

Abstract

We introduce the Poisson Super Learner, a scalable ensemble method for survival and competing risks prediction with right-censored data. The approach exploits the correspondence between the likelihood of piecewise-constant hazard models and the Poisson likelihood. After expanding the data over a chosen time partition, candidate hazard learners are trained under a common Poisson loss, and cross-validated log-hazard predictions are combined by a Poisson meta learner. The resulting ensemble is a geometric combination of candidate hazards, and can be used to estimate survival probabilities and cause-specific absolute risks. The Poisson Super Learner framework is modular and can in principle incorporate any learner that can estimate interval-specific hazards, including parametric, penalised, additive, and other machine-learning hazard models. Training targets the cause-specific hazard directly and does not require explicit modelling of the censoring distribution. For competing risks, separate cause-specific ensembles are fitted and subsequently combined to obtain individualised cumulative incidence predictions. We illustrate the approach using data from the Steno Diabetes Center collected between 2005 and 2022 to predict cardiovascular disease risk in patients with type 1 diabetes from detailed covariate information. The applied analysis is complemented by simulation studies designed to reflect key features of the data and to examine the behaviour of the method under controlled settings. All analyses were implemented using the freely available R software package poissonsuperlearner.

Closest papers

Nearest neighbours by meaning across the whole index.

Efficient Learning of Survival Analysis Models Under Outcome-Dependent Truncation and Censoring

cs.LG ·2026-10-08 ·Itai Zilberstein, Ioannis Anagnostides, Arman Kilic, Tuomas Sandholm
similarity 0.70
Abstract

Modern machine learning models are typically trained on data assumed to be representative of the predictive tasks the model will face in the future, but practical datasets violate this assumption. We focus on outcome-dependent truncation in which an observation appears in the training data depending on its label. Our work connects two largely distinct literatures: efficient learning under truncation and survival analysis. Existing methods for truncated survival analysis do not characterize the optimization landscape and instead rely on iterative procedures such as expectation maximization. We address this gap and prove that Cox regression can be efficiently learned under truncated and right-censored data using first-order optimization when the baseline hazard is known (despite nonconvexity). In contrast, when the baseline hazard is learned jointly, we construct identifiable and correctly specified models whose negative log-likelihood contains strict suboptimal local minima. On experiments with four survival datasets, we show that accounting for truncation reduces the prediction bias induced by naive Cox regression and extends to neural networks. We also show orders of magnitude speedups compared to standard expectation maximization.

0.30

Odds-Structured Distributional Regression for Interpretable Time-to-Event Prediction

cs.LG stat.ML ·2026-11-09 ·Jakob Versnjak, Manuel Welte, Titus Kuehne, Marcus Kelm, Grégoire Montavon
similarity 0.62
Abstract

Time-to-event prediction is fundamentally challenged by partial observability and aleatoric uncertainty. In clinical medicine, for instance, the timing of disease progression or acute readmission is contingent on highly dynamic and largely latent health trajectories. Rather than forcing a deterministic point forecast, distributional regression offers a principled means to address this complexity by predicting a probability distribution over time. However, explaining these distributional predictions presents a key obstacle: raw distribution parameters output by the model are abstract mathematical quantities that do not align well with domain concepts. To gain interpretability, we propose a novel paradigm where output parameters are designed to be additive in log-odds---a widely established measure in clinical risk modeling. Our approach, called ODDS-DR, moves beyond technical convenience to deliver clear domain alignment as well as the layer-wise computational structure required for robust, time-dependent feature attribution. Validated across two real-world clinical cohorts, our framework matches state-of-the-art predictive performance while resolving distributional outputs into interpretable risk markers across flexible prognostic horizons.

0.18

Distributionally Robust Survival Models under Subpopulation Shift and Outlier Contamination

cs.LG cs.AI ·2026-10-02 ·Seonghwi Kim, Sung Ho Jo, Minwoo Chae
similarity 0.62
Abstract · 36 pages, including appendices

Learning robust survival models under distribution shift is an important but challenging problem in many applications. In heterogeneous populations, a model that performs well on average may still perform poorly on certain subpopulations, and this issue becomes even more severe when the training data are contaminated by outliers. In this paper, we propose a novel distributionally robust framework for survival analysis that jointly addresses latent subpopulation shift and outlier contamination. The proposed method combines an outer minimization that selects a refined nominal distribution by reducing the influence of contaminated samples and an inner maximization that focuses on the most challenging subpopulation. This formulation directly accommodates non-decomposable survival losses while preserving interactions across samples, including the risk-set structure of the Cox negative partial log-likelihood. We develop an alternating gradient-based algorithm with outer updates derived from the KKT conditions of the inner maximization. Experiments on simulated data and two survival benchmarks demonstrate that the proposed method remains robust when subpopulation shift and outlier contamination occur simultaneously. It stabilizes training in contaminated settings and substantially improves worst-group performance across both linear and nonlinear survival models, while maintaining competitive and sometimes superior overall performance.

0.24

Doubly Robust Learning of Heterogeneous Survival Treatment Effects under Time-Varying Treatments

cs.LG ·2026-10-19 ·Tomàs Garriga, Munib Mesinovic, Luke De Bretton-Gordon, Gerard Sanz, Axel Brando +1 more
similarity 0.62
Abstract

Estimating heterogeneous survival treatment effects (HSTEs) from time-to-event data under time-varying treatments is important in fields such as medicine (e.g., to decide which sequence of treatments is better in terms of survival probability). However, this task is challenging because treatment decisions, patient characteristics, and censoring probability often evolve together, requiring sequential adjustment for both treatments and censoring. Existing survival learners mostly consider a single baseline treatment assignment, while longitudinal treatment-effect learners typically assume uncensored outcomes. In this paper, we introduce a novel doubly robust learner for heterogeneous survival treatment effects under time-varying treatments and history-dependent censoring. Our framework separates the intervention window from the survival horizon, with treatment prescribed for a finite period, after which care follows its natural course. We further establish the favorable theoretical properties of Neyman-orthogonality, rate double robustness and quasi-oracle efficiency. The framework accommodates flexible machine learning models for nuisance estimation and treatment-effect regression. We evaluate our learners through several numerical experiments, demonstrating their effectiveness.

0.10

Random Hazard Forests

cs.LG stat.MLstat.ME ·2026-08-21 ·Hemant Ishwaran, Eileen M. Hsich, Udaya B. Kogalur, Donald K. K. Lee
similarity 0.61
Abstract

Clinical data sources such as electronic health records and wearable sensors record patient status repeatedly over follow-up, often at irregular times and on different schedules for different measurements. These data create opportunities for continuously updated, individualized risk prediction. Existing approaches, however, often simplify the temporal structure for model fitting. We introduce Random Hazard Forests (RHF), a survival tree ensemble that estimates how a patient's hazard changes in continuous time as new measurements become available. The method formulates the estimation problem directly through a nonparametric hazard likelihood for predictable covariate processes. An efficient working model guides tree construction, after which flexible time-varying hazards are estimated for each terminal node. Given any predictable covariate path, each tree follows the path through its terminal nodes over time and assembles the corresponding node-level hazards into a trajectory. Averaging these trajectories across trees yields the pathwise hazard estimate. Because routing at each time uses only the covariate state available immediately beforehand, the construction accommodates internal longitudinal covariates without lookahead. Simulations and an intensive care application show that the forest accurately estimates changing risk under irregular and asynchronous covariate updates.

0.31

Joint Distributional Copula Regression for Insurance Claim Frequency and Severity via Boosting

cs.LG stat.MLstat.ME ·2026-10-27 ·Banghee So, Na Zhang
benchmark similarity 0.60
Abstract

In this paper, we introduce a model-based boosting approach for fitting structured additive distributional copula regression models for bivariate responses, with particular emphasis on jointly modeling insurance claim frequency and severity. The approach uses regression-type base learners, such as linear terms and splines with low degrees of freedom. It builds on generalized additive models for location, scale, and shape (GAMLSS), which extend generalized additive models (GAMs) by allowing multiple distributional parameters, rather than only the conditional mean, to depend on covariates. The structured additive predictors make the model inherently interpretable, offering greater transparency and auditability than black-box approaches. These features are particularly relevant in regulated actuarial settings and applications requiring explainable artificial intelligence. By estimating the entire conditional joint distribution, the framework also enables insurance practitioners to examine conditional quantiles, tail behavior, and prediction intervals of risks. The copula component captures dependence between claim frequency and severity and allows practitioners to investigate how this dependence varies with policyholder characteristics, potentially improving predictive performance. Moreover, by incorporating modern machine-learning techniques, specifically boosting, the proposed model improves prediction accuracy while retaining interpretability. We assess the proposed framework using both simulated and real data. The results demonstrate its ability to recover the true covariate effects on the marginal distributional parameters and the dependence structure, select informative variables, and achieve predictive performance competitive with standard benchmark models. We also illustrate how to interpret the fitted model.

0.26

Non-Crossing Deep Quantile Regression for Distributional Survival Prediction

cs.LG stat.MLstat.AP ·2026-08-17 ·Shuai Huang, Zhe Qu, Zhaowei Hua, Guohao Shen, Rui Tang +1 more
code/data similarity 0.60
Abstract · 50 pages, 15 figures, 17 tables. Main text and supplementary material combined into a single document. Submitted to the Annals of Applied St…

In survival analysis the way covariates act on the risk of an event often differs between early and late failure times, yet hazard- and mean-based summaries collapse this variation into a single number. Quantile-based modeling instead describes the full conditional distribution on the original time scale, but existing censored-data methods are either inflexible or produce logically inconsistent crossing quantile curves. We propose a Censored Non-crossing Quantile (CNQ) framework for right-censored data that jointly estimates several conditional survival quantiles and guarantees valid ordering by construction, with flexibility supplied by Kolmogorov-Arnold and Transformer backbones, and we establish a finite-sample excess-risk bound holding jointly across all fitted quantile levels. Across 27 simulation settings and six cohorts the framework attains lower pinball loss than quantile-, hazard- and tree-based competitors whenever the conditional distribution is asymmetric, with interval coverage closer to nominal on all six. In two clinical case studies (METABRIC, breast cancer; FLCHAIN, population mortality) it recovers covariate effects that vary across the survival distribution and would be hidden by a single hazard ratio, and yields coherent individualized quantile milestones. Code: https://github.com/BIG-S2/deepcnq

0.42

Causally Constrained and Uncertainty-Aware Cardiopulmonary Risk Prediction

cs.AI ·2026-11-13 ·Yuxiang Lai, Jiashuo Zhang, Liang Zhao, Xiaofeng Yang
similarity 0.60
Abstract

Routine chest computed tomography (CT) captures pulmonary, cardiac, and vascular phenotypes that jointly stratify lung cancer and cardiovascular disease, the two leading causes of death in lung-screening populations. Yet clinical risk calculators evaluate each disease in isolation and omit CT findings, whereas unconstrained machine learning overfits small hospital cohorts, learns treatment- and illness-confounded risk directions, and conceals uncertainty when patient records are incomplete. Here we present the Causal Envelope Agent (CE-Agent), a two-stage framework that compiles peer-reviewed epidemiological evidence into explicit constraints on risk-factor weights before any outcome is seen, while estimating local baseline risk and newly added CT phenotypes from cohort data. At deployment, closed-form uncertainty propagation accounts for missing clinical or CT inputs within milliseconds per patient, running over two orders of magnitude faster than Monte Carlo sampling and returning calibrated risk intervals that direct chart review and selective imaging to borderline patients. Across 53,452 lung-screening participants from 33 US hospitals and 6,814 multi-ethnic adults, CE-Agent outperforms cardiovascular calculators in lung screening, exceeds the Pooled Cohort Equations on hard atherosclerotic events while correcting their 1.7-fold risk overestimation, and generalizes from a single hospital or CT scanner to external sites while lowering required sample sizes up to fivefold. Applied unchanged to lung cancer, CE-Agent matches established screening models with accurate calibration even when restricted to risk-factor directions alone, and pairing both predictions improves joint cardiopulmonary triage from a single screening visit.

0.19