CS Paper Radar

Regularised Iterative Generalised Least Squares with Optimal Selection of the Hyper-Parameter for Identifying Nonlinear Phenomenological Models

Mark Cary, Charles Bokor

cs.LG stat.MEeess.SY ·submitted 2026-08-19 09:50 UTC · v1

Abstract

In some fields currently dominated by empirical approaches, such as state of health (SoH) prediction for lithium-ion batteries, phenomenological models motivated by quasi-physical thinking contain parameters to be estimated from experimental data. Often the structure of such models yields fully or partially confounded parameters, which are difficult or even impossible to estimate reliably. To preserve the desired model formulation and simultaneously improve the numerical conditioning for the problem we introduce a ridge regression scheme. An automated method is provided, based on information theoretic measures of model performance, which optimises the ridge regression hyper-parameter at each iteration. The formulae presented require fixed point iteration to solve for the hyper-parameter. Given a suitable starting value, analysis demonstrates convergence is very rapid. The optimal hyper-parameter selection mechanism is incorporated within an efficient regularised iterative generalised least squares mechanism, capable of fitting both heteroscedastic and serially correlated data as required. Simulation confirms the efficacy of the overall method.

Comment
18 pages, 5 figures, 2 tables

Closest papers

Nearest neighbours by meaning across the whole index.

A Repeated Measurements Approach to $SoH$ Battery Modelling of Cyclic Aged Data in a Laboratory Environment

cs.LG stat.MEeess.SY ·2026-08-20 ·Mark Cary, Charles Bokor
similarity 0.68
Abstract · 17 pages, 9 figures, 2 tables

This document describes the application of a first order linearised nonlinear repeated measurements approach to the analysis of battery cell ageing profiles generated under controlled conditions in a laboratory. The primary advantage of the model is it reflects the obvious structure in the data. Consequently, it is a two-component of variance model: variation within ageing profiles (measurement noise) and variation among ageing profiles (test-to-test or cell-to-cell) variation. Novel regularised iterative generalised least squares parameter identification schemes, with optimal hyper-parameter re-estimation, are used to identify the hierarchical nonlinear model. The training data comprised $SoH$ profiles for 10 cells aged at various constant discharge and charge current cycles at a fixed chamber environmental temperature of 25 [$^\circ$C]. Each cell $SoH$ profile is modelled using a simple power law expression, whereas the variation in ageing parameters is modelled using a single knot cubic B-spline. $SoH$ is accurately predicted to $\pm 0.191\%$ for $SOH \in [0,20]$.

0.24

System Identification for Nonlinear Stochastic State-Space Models Using Ensemble Kalman Inversion with Application to Lithium-Ion Batteries

eess.SY ·2026-10-19 ·Farzaneh Barat, Rachel Carter, Sara Wilson, Huijeong Kim, Xinfan Lin +1 more
similarity 0.60
Abstract · 16 pages, 8 figures, 3 tables

Nonlinear state-space system identification has attracted decades of interest, yet remains challenging because of the interplay among unknown parameters, nonlinear dynamics, and latent state variables. Its difficulty increases dramatically when the state and parameter dimensions increase. To address this challenge, we develop an ensemble Kalman inversion (EnKI)-based approach. This approach leverages EnKI to perform maximum a posteriori parameter estimation through successive local Gaussian approximations, enabling an iterative and incremental search for unknown parameters. The search combines Monte Carlo sampling with Kalman-type updates to evolve an ensemble of parameter samples, thereby offering empirical stability and the ability to handle strongly nonlinear models. The EnKI search is coupled with state estimation conditioned on the latest parameter estimates. This enables parameter identification along with latent state recovery. To improve scalability for large datasets, we further develop a cascaded EnKI (CasEnKI) method, which assimilates subdatasets sequentially to accelerate computation. We validate the proposed methods using a lithium-ion battery model with ten state variables and 18 unknown parameters. Simulation results show that the EnKI approach offers high identification accuracy and empirical stability in parameter search. Further, experimental results illustrate the computational efficiency and scalability of the CasEnKI method for large battery datasets.

0.12

Closed-loop domain generation enhances battery health diagnosis

eess.SY ·2026-10-09 ·Yue Wu, Ziyu Mo, Jinze Dai, Ziqing Xia, Shengyu Tao +2 more
similarity 0.58
Abstract

Reliable electrode-level degradation diagnosis is essential for accurate health estimation and non-destructive monitoring in advanced battery management. Diagnosis models developed under controlled laboratory conditions can fail when operating conditions change, while acquiring sufficient full-lifespan data in new target domains remains prohibitively time-consuming and practically unfeasible. Here, we propose a closed-loop domain generation framework to enable cross-domain battery health diagnosis under dynamic conditions. Physics-constrained domain generation is achieved through Variational Autoencoder-based latent extrapolation, which maps the source data and few-shot early-life target domain data into a shared latent space and generates cross-domain samples within physical boundaries. Bayesian optimization closes the generation-diagnosis loop by automatically calibrating the sampling, latent regularization, extrapolation, perturbation, and generation-volume hyperparameters using leakage-free development validation, thereby strictly excluding later-life target data from optimization and ensuring the quality and quantity of generated data. Numerical results demonstrate that, across four cross-domain cases, the proposed framework achieves average root mean square errors of 1.53%, 2.15%, and 2.02% for positive electrode active material loss, negative electrode active material loss, and lithium inventory loss, respectively, whereas traditional methods suffer from notably higher errors or even complete failure. This framework provides a general pathway for onboard and physics-consistent electrode-level degradation diagnosis, independent of downstream diagnosis models.

0.17

Recursive Parameter Identification of Nonlinear Stochastic State-Space Models via Sequentialized Ensemble Kalman Inversion

eess.SY ·2026-09-19 ·Farzaneh Barat, Rachel Carter, Sara Wilson, Huazhen Fang
publishedbenchmark similarity 0.58
Abstract · Accepted for publication in the 2026 65th IEEE Conference on Decision and Control (CDC)

Recursive parameter identification in nonlinear stochastic state-space models is challenging because unknown parameters affect the measurements through latent-state dynamics. This paper develops a sequentialized ensemble Kalman inversion method for recursive parameter identification from streaming measurements. The proposed method represents the parameter posterior by an evolving ensemble and updates it sequentially as new measurements become available. For each parameter ensemble member, implicit particle filtering is used to approximate the predictive observation statistics required for parameter correction. This formulation enables recursive parameter learning. The method is evaluated on a strongly nonlinear benchmark, with comparison to several existing methods, and then on a nonlinear double-capacitor lithium-ion battery model. The numerical results demonstrate accurate recursive parameter identification and latent-state estimation.

0.30

Functional linear regression from sparse to dense designs: a pooling-ridge method and minimax optimality

cs.LG stat.MEmath.STstat.ML ·2026-08-26 ·Shunxing Yan, Fang Yao
similarity 0.54
Abstract · The Annals of Statistics

Functional data analysis is an important statistical field that treats data as random functions. In practice, the random functions are often not fully observed but instead measured at discrete times. While simpler problems, such as mean and covariance estimation, have been widely studied for discretely observed data, optimal estimation of linear regression for this data type has remained unsolved for over two decades. To tackle this fundamental challenge, we propose a novel approach, referred to as pooling ridge estimation, which combines the advantages of pooling strategy and RKHS-based method by incorporating the unbiased estimation of operators based on discretely observed measurements from all subjects. This unified estimation framework enables us to achieve minimax optimality in prediction risk in arbitrary sampling schemes ranging from sparse to dense designs, for both scalar-on-function and function-on-function regression models. Such methodological and theoretical advances are obtained for the first time and accurately reveal the influence of discrete sampling. For scalar-on-function regression, the phase transition occurs once, separating the convergence behavior into two distinct regimes. Remarkably, for function-on-function regression, up to three phase transitions may occur, determined by the sampling frequencies of the predictor/response functions. Finally, simulation experiments and two real data examples provide empirical support for the proposed methods.

0.44

Robust State-Parameter Estimation in Second-Order Thévenin Batteries

eess.SY math.OC ·2026-11-09 ·Wissam Khennoune, G. Q. Bao Tran, Thach Ngoc Dinh, Jérémy Van Gorp, Mathieu Moze
similarity 0.54
Abstract · Under review for European Control Conference (ECC)

We propose a scheme for estimating the full states and parameters of a second-order Thévenin battery model, using distinct features of the measured current. An identification step, run during suitable rest intervals, identifies the resistances and capacitances of the two RC branches from the voltage relaxation by linear least squares, without knowledge of the open-circuit voltage (OCV) map. An online estimator then runs continuously: the polarization voltages are estimated by open-loop observers; the series resistance is updated at current jumps using least squares; the state of charge (SOC) is propagated by Coulomb counting using the current capacity estimate, and both estimates are updated periodically by a sliding-window regression. We show that the identification is exact under a mild rank condition, that the series resistance is recovered at the first current jump, and that the online state and capacity estimates converge exponentially under verifiable excitation conditions. We also establish robustness of the online estimator under bounded process disturbances and measurement noise.

0.21

A Hybrid State Space-Attention Architecture for Forecasting the Trajectories of Battery Degradation

cs.AI physics.chem-ph ·2026-11-14 ·Shrey Patel, Bhargav Srinivas Rao, Samet Ayhan
benchmark similarity 0.53
Abstract

Early-life battery degradation trajectory forecasting aims to predict a battery cell's full state-of-health (SOH) trajectory from its initial charge-discharge cycles, potentially reducing cell qualification and evaluation time from months to days. Despite recent advances, accurate forecasting remains challenging for emerging battery chemistries, data-scarce domains, and cells exhibiting degradation behaviors beyond those observed during training. Existing state-of-the-art approaches increasingly rely on model scaling, large language model-derived aging-condition embeddings, and extensive fold-specific hyperparameter tuning, raising concerns about computational efficiency, reproducibility, and generalization. This work introduces DecayFormer, a compact hybrid state-space and attention architecture designed for early-life degradation trajectory forecasting. DecayFormer combines cycle-level selective recurrence, using a single scalar state per channel, with an attention mechanism queried by the recurrent state. It further incorporates state-of-charge (SOC) interval statistics and a master curve head that jointly estimates a scalar lifetime and a monotonically non-increasing SOH profile parameterized by normalized lifetime. We evaluate DecayFormer on the BatteryLife benchmark using all 22 aging-condition-exclusive folds, with a single run per fold and one fixed configuration across all folds, without fold-specific tuning. DecayFormer achieves mean test MAPE values of 2.25% on Li-ion, 2.76% on CALB, 0.95% on Na-ion, and 7.19% on Zn-ion. These results demonstrate the potential of compact sequence models to deliver accurate early-life degradation forecasts across diverse battery chemistries and aging conditions, without relying on extensive model scaling or per-fold optimization.

0.08

Real-Time State-of-Health Estimation and Online Degradation Prognosis from Partial Battery Discharge Using Physics-Informed Neural Networks

cs.LG ·2026-08-14 ·Begoña Ispizua, Serio Gil-López, Leire Arrizabalaga, Ibai Laña
similarity 0.53
Abstract

With the increasing integration of renewable energy sources, energy storage systems have become essential, making the accurate estimation of their State of Health (SOH) and degradation behavior critical. In this work, we propose a physics-informed deep learning approach for lithium-ion battery SOH prediction using incomplete discharge curves extracted from arbitrary voltage ranges, thereby reflecting realistic and heterogeneous operating conditions. The proposed method combines data-driven learning with physically motivated degradation dynamics to ensure consistent and reliable SOH estimation from partial discharge information, achieving a MAPE below 4$\%$. In addition, a real-time degradation trend estimation strategy is introduced to detect key aging transitions without requiring prior knowledge or historical data, making it applicable to a wide range of batteries. Overall, our approach enables SOH estimation from arbitrary discharge segments and a real-time degradation forecast that continuously integrates all usage, overcoming previous methods that rely on fixed protocols or early, non-adaptive predictions.

0.04