CS Paper Radar

A Practical Guide on Graphical Model Validation

Mario V. Wüthrich

cs.LG stat.MLq-fin.RM ·submitted 2026-09-22 14:04 UTC · v1
unusual

Abstract

This manuscript formalizes the most popular model validation tools used in general insurance actuarial modeling. These include graphical tools like calibration plots, actual-vs-expected plots, lift charts, Murphy diagrams, as well as classical statistical tools such as Bregman losses, deviance losses, elementary losses, Murphy's decomposition and Gini scores. Particular emphasis is placed on whether calibration and discrimination are studied under a policy-weighted or an exposure-weighted population measure. This distinction is crucial in ensuring that premium schemes are calibrated on the correct scale.

Closest papers

Nearest neighbours by meaning across the whole index.

Quantifying structural stability of transparent models for general insurance pricing

cs.LG stat.ML ·2026-11-12 ·Félix Côté, Marie-Pier Côté
benchmark similarity 0.52
Abstract · 16 tables and 9 figures

The short duration of general insurance contracts leads to rapid distributional shifts in the data, warranting regular model updates. This process may yield a post-update model that differs considerably from the pre-update model in both predictions and structure. Structural stability is upstream of predictive stability, yet existing structural stability metrics are mostly restricted to simple decision trees. Thus, we first introduce the notion of functional transparency, characterising models with a prediction function that can be expressed as a sum of univariate functions for main effects and bivariate functions for pairwise interactions. Then, we propose the Mean Squared Shape function distance, a metric to quantify the structural stability of functionally transparent models, which are particularly relevant in actuarial science. Using three public auto insurance datasets, we present a benchmark study to demonstrate the usefulness of our metric in identifying a stable and accurate transparent model. Generalised linear models with centred numerical covariates are stable, and explainable boosting machines (EBMs) offer a compromise between stability and performance. We also find that stabilisation strategies, such as sequential modelling and fixed hyperparameters, can substantially improve stability for both EBM and XGBoost models, with negligible impact on performance.

0.23

Joint Distributional Copula Regression for Insurance Claim Frequency and Severity via Boosting

cs.LG stat.MLstat.ME ·2026-10-27 ·Banghee So, Na Zhang
benchmark similarity 0.50
Abstract

In this paper, we introduce a model-based boosting approach for fitting structured additive distributional copula regression models for bivariate responses, with particular emphasis on jointly modeling insurance claim frequency and severity. The approach uses regression-type base learners, such as linear terms and splines with low degrees of freedom. It builds on generalized additive models for location, scale, and shape (GAMLSS), which extend generalized additive models (GAMs) by allowing multiple distributional parameters, rather than only the conditional mean, to depend on covariates. The structured additive predictors make the model inherently interpretable, offering greater transparency and auditability than black-box approaches. These features are particularly relevant in regulated actuarial settings and applications requiring explainable artificial intelligence. By estimating the entire conditional joint distribution, the framework also enables insurance practitioners to examine conditional quantiles, tail behavior, and prediction intervals of risks. The copula component captures dependence between claim frequency and severity and allows practitioners to investigate how this dependence varies with policyholder characteristics, potentially improving predictive performance. Moreover, by incorporating modern machine-learning techniques, specifically boosting, the proposed model improves prediction accuracy while retaining interpretability. We assess the proposed framework using both simulated and real data. The results demonstrate its ability to recover the true covariate effects on the marginal distributional parameters and the dependence structure, select informative variables, and achieve predictive performance competitive with standard benchmark models. We also illustrate how to interpret the fitted model.

0.26

InsClaimBench: Benchmarking Insurance Claim Adjudication Across the Decision Chain

cs.CL ·2026-10-07 ·Linqi Zhang, Chong Qi, Yan Cheng, Wanqing Cao, Yu Liu +2 more
benchmark similarity 0.48
Abstract · 17 pages, 3 figures, 11 tables

Recent advances in reasoning-oriented large language models (LLMs) have motivated increasing evaluation of their ability to perform professional decision tasks. Insurance claim adjudication is one such task, requiring models to connect case evidence, insurance rules, intermediate judgments, and payout calculations across a structured decision process. We introduce InsClaimBench, an end-to-end benchmark for evaluating insurance claim adjudication across the decision chain. Grounded in real claim materials and structured insurance rules, InsClaimBench contains 3,780 cases in 375 case families across auto, property, and health insurance, comprising 86,656 atomic rule judgments. It evaluates each claim from atomic rules through adjudication modules to payout decisions and amounts, with controlled factual variants testing whether required changes are correctly propagated across levels. Evaluation of six LLMs reveals a progressive loss of reliability along the decision chain. Payout-decision accuracy ranges from 74.23--80.19%, while joint decision--amount accuracy drops to 47.54--73.15%. Strong local performance also fails to ensure case-level correctness: atomic-rule accuracy reaches 95.48%, whereas rule-vector exact match peaks at only 36.90%, and the most frequent module errors are not necessarily those most associated with final-decision failure. Under factual changes, these inconsistencies further become propagation failures: module updates are less reliable than rule updates, correct local judgments can still yield incorrect payouts, and correct payouts can conceal intermediate errors. These results show that reliable claim adjudication requires consistent composition and propagation across the decision chain.

0.36

The Role of Insurance in Power-System Risk Management: A Critical Review

eess.SY math.OC ·2026-11-10 ·Jing Huang, Jiale Guo, Chenjia Gu, Chengcheng Shao, Yue Xiang +5 more
similarity 0.47
Abstract

Modern power systems are becoming more renewable-rich, digitalized, and interconnected, making risk propagation and economic consequences increasingly complex. Physical mitigation remains the primary means of risk control, but technical and economic limits leave residual risk. Insurance can complement these measures by transferring associated economic losses and influencing power-system decisions through risk-responsive terms. Despite growing interest, the literature remains fragmented across power-system engineering, actuarial science, and risk finance. This review develops an integrated physical-financial perspective for reviewing insurance in power systems. It examines how power system risks generate residual economic losses and the conditions under which these losses can be insured and transferred. It then develops an actuarial framework for insured-loss assessment and pricing. Insurance-aware decision-making is synthesized through four coupling levels describing how financial protection interacts with power-system decisions. Further progress is constrained by weak physical-financial loss validation, incomplete representation of systemic and evolving portfolio risk, and limited empirical and actuarial grounding of insurance-decision feedback. Research priorities include stronger physical-financial data linkage, forward-looking portfolio assessment, multi-timescale decision feedback, and empirical validation. Addressing these priorities would help move power-system insurance from fragmented applications toward a more coherent approach to residual-risk management in future power systems.

0.26

Tabular foundation models are not a shortcut to calibrated clinical risk prediction: a pre-registered simulation against the true risk

cs.LG stat.ME ·2026-10-28 ·Ebrahim Khaled Ebrahim
code/data similarity 0.46
Abstract · 37 pages, 7 figures, 1 table; Supplementary Information (55 pages) as an ancillary file. Pre-registered on OSF Registries (doi:10.17605/OSF.…

Tabular foundation models are pretrained networks that predict risk from a table without fitting a model. Whether their risks are correct (calibrated) has been judged on real data, where true risk is unknown. In a pre-registered simulation with known true risks, we compared TabPFN-3.5, TabICLv2 and Mitra-v2 with Firth logistic regression with intercept correction (FLIC) in 58 scenarios and 1,000 random designs, then on four clinical data sets. Foundation models were not a shortcut to calibration. Their calibration slope matched FLIC's within the pre-registered margin in 36 or 37 of 48 core scenarios and was better only at n = 200 with a 3% event rate. Even 3,000 patients were often not enough: with FLIC, TabPFN-3.5 or Mitra-v2, 63%-83% of samples gave risks close to the truth in average, intercept and slope at event rates of 10% and 30%, and 35%-50% at 3%. TabICLv2 did worse (8%-39% and 1%-3%). Across the random designs, foundation models had a lower true calibration error than FLIC beyond the margin in 25%-38% and a higher one in none, though small losses were predicted at n = 3000. On real data, no model resisted a change in event rate between populations; recalibration on 500 local patients largely repaired it.

0.41

Credibility Clustering for Experience Rating: An Automated Approach to Risk Group Allocation in Group Life Insurance

cs.LG q-fin.RM ·2026-11-04 ·Thom van Rijn, Frank Weber, Michael Merz
benchmarkunusual similarity 0.44
Abstract

In insurance, experience rating plays a crucial role in mitigating adverse selection by adjusting premiums according to historical claims experience. A key step in this process is the classification of insured collectives into homogeneous risk groups. Within group life insurance, this classification traditionally relies on manual decisions and arbitrary thresholds, which may lead to inefficiencies and inconsistent outcomes. This paper proposes a data-driven methodology for automating risk group allocation based on a combination of the multidimensional Bühlmann-Straub model and k-means clustering -- referred to as credibility clustering. By incorporating credibility weights, the method accounts for the varying statistical significance of experience data and ensuresthat risk classifications are both actuarially sound and practically implementable. Empirical results based on real-world group life insurance data from a major European insurer demonstrate that the proposed framework outperforms the two k-means benchmark variants considered in the empirical application in terms of viability, temporal stability and accounting for statistical reliability.

0.27

Insurance Reserve Intelligence Platform

cs.AI ·2026-09-25 ·Anugya A, Saket Mohanty, Abhilash Timmapur, Somya Rai
unusual similarity 0.44
Abstract

Insurance reserve estimation is a fundamental actuarial task supporting premium pricing, solvency assessment, financial reporting, capital planning, and risk management. Classical reserve methods based on Thiele's differential equation provide a rigorous and interpretable foundation for life insurance valuation, but repeated reserve calculations become computationally expensive in sensitivity analysis, optimization, and large-scale scenario evaluation. This paper presents an Insurance Reserve Intelligence Platform for term-life reserve modelling that combines a classical Thiele-equation solver with a Physics-Informed Neural Network (PINN) enhanced by Knowledge-Informed Neural Network (KINN) losses. The framework includes synthetic policy generation, risk-adjusted premium calculation, classical reserve trajectory generation, reserve-ratio dataset construction, configurable neural training, validation diagnostics, sensitivity and elasticity analysis, prototype optimization workflows, and interest-rate scenario testing. A key refinement is the use of premium ratio and the explicit separation of pricing-time and scenario-time interest-rate semantics. The final model uses seven features: elapsed time, issue age, pricing interest rate, scenario interest rate, premium ratio, sum assured, and mortality intensity. It predicts a standardized reserve ratio instead of raw reserve values, improving numerical stability across policies with different sums assured. The model achieved an R2 of 0.9887, MAE of 785.48, and RMSE of 1212.76 on the test set. On 200 policies, PINN/KINN inference was approximately 119.53 times faster than the classical solver. Results show strong predictive accuracy, physics consistency, and boundary performance, while highlighting remaining limitations in monotonicity and out-of-distribution generalization.

0.26

From Explaining to Enabling: Actionable Transparency in Algorithmic Insurance Pricing

cs.LG ·2026-10-25 ·Agathe Fernandes Machado, Fei Huang
position similarity 0.43
Abstract

Machine learning (ML) systems increasingly make consequential decisions about individuals, including credit, hiring, and insurance. Research on ML-driven insurance pricing has asked how the pricing mechanism itself can be made accountable. Yet it remains unclear how an individual policyholder's algorithmically determined premium should be explained to them. We argue that a useful explanation must be valid, actionable, and reliable. A valid recommendation lowers the premium according to the model. An actionable recommendation changes only characteristics the policyholder can control. A reliable recommendation has an actual outcome that is likely to meet the target, even in sparsely observed regions of the feature space where the model is uncertain. We formalize these three requirements as axioms and develop a method that turns an algorithmic premium into recommendations that meet them. The method meets the third requirement with a Conformal Prediction constraint, which screens out recommendations that the model is too uncertain about and thereby bounds the rate of unreliable recommendations. We apply four Counterfactual Explanation techniques to 57,832 real Florida flood-insurance claims and 98,058 synthetic driver-telematics policies. We adapt these techniques for insurance applications, so that their recommendations change only controllable characteristics and resemble policyholders observed in the data. In our illustrations, the constrained recommendations for high-risk policyholders are both more reliable and associated with larger predicted risk reductions than the unconstrained ones. These results suggest that insurers can give policyholders explanations that are both actionable and trustworthy. The work contributes to research on algorithmic accountability and offers implications for insurers and regulators.

0.24