CS Paper Radar

Observable functions of rational ODE models and how to find them

Alexander Demin, Gleb Pogudin, Christopher Rackauckas

cs.MS math.DScs.SCeess.SY ·submitted 2026-09-05 15:05 UTC · v3
code/dataunusual

Abstract

Consider a parametric ODE control model. A function of the states and parameters is called observable if its value can in principle be reconstructed from input-output data. The observable functions form a field, called the observation field, represented naturally by a set of generators. Even when the model is not fully observable, this field captures the information still accessible from input-output data. We present an algorithm for computing a concise generating set for the observation field of a model with rational dynamics. The algorithm relies on two new results: one allows observable functions to be extracted from the coefficients of repeated Lie derivatives of the outputs, while the other reduces the required orders of differentiation by exploiting identifiable parameter combinations. We implement the resulting algorithm in StructuralIdentifiability$.$jl (https://github.com/SciML/StructuralIdentifiability.jl). For computational efficiency, we employ recent techniques for differential elimination and rational function field simplification. Using models from epidemiology, chemical kinetics, and cancer modeling, we show that the algorithm produces generators with domain-specific interpretations that can inform model analysis and development.

Closest papers

Nearest neighbours by meaning across the whole index.

Practical Algebraic Parameter Estimation for Noisy Data via Gaussian Process Regression

eess.SY cs.MSmath.OC ·2026-09-24 ·Oren Bassik, Alexander Demin, Alexey Ovchinnikov
benchmark similarity 0.56
Abstract

Parameter estimation for ordinary differential equation (ODE) models is a fundamental task that is often complicated by the limitations of conventional optimization-based methods. In theory, differential-algebraic approaches offer an appealing alternative: they reduce the problem to polynomial system solving and do not require user-supplied initial guesses for parameter values. In practice, however, algebraic methods have been limited by their sensitivity to measurement noise, because they require accurate derivatives of observed outputs. In this work, we integrate Gaussian Process Regression (GPR) into the differential-algebraic method and derive a first-order error analysis in terms of noise level and algebraic sensitivity. We evaluate the method across several noise levels on a benchmark of 25 dynamical systems arising in applications including mechanical engineering and systems biology. The proposed method achieves the highest aggregate performance among the methods considered, recovering all sought parameter values and initial conditions to within 10% relative error in 88.5% of runs. These results demonstrate that robust derivative estimation can make differential-algebraic parameter estimation practical for dense, noisy synthetic data while retaining key advantages of the algebraic formulation.

0.35

Ghost tasking for parametrized Gaussian Processes solving linear differential equations

cs.LG physics.comp-ph ·2026-10-08 ·Johanna Moser, Christopher Albert, Sascha Ranftl
theorycode/data similarity 0.55
Abstract · 46 pages, 14 figures, for reproducibility: https://github.com/moserjo/GhostTask

Physics-informed machine learning has gained significant attention in recent years. In regimes of limited data, parametrized Gaussian processes have become popular. Existing approaches, however, often face limitations, such as requiring parametrizable (also called controllable) systems or a large number of output tasks. In this work, we introduce a systematic procedure we call "ghost tasking", using auxiliary tasks to circumvent these limitations. We prove that such ghost tasks can render any non-parametrizable system effectively parametrizable, enabling algorithmic construction of parametrized Gaussian Processes while keeping the number of required tasks (i.e. output dimensions) and latent functions low. We find that ghost tasking performs especially well in an inverse problem setting, even with very few available data. We show the usage and power of ghost tasking in three experiments, providing systematic comparisons to the only other currently available method applicable to all experiments. We provide necessary syntax and explications for two computer algebra programs that compute parametrizations for systems with polynomial or rational coefficients. Our theoretical results extend to systems with meromorphic functions.

0.53

Automating Observable Closure Analysis for Graph Transformation Models with MolFoundry

cs.LO cs.DMq-bio.MN ·2026-10-14 ·Marcel Friedrichs, Addie Jordon, Juri Kolčák, Daniel Merkle
code/data similarity 0.52
Abstract · 30 pages, including appendices. Software: https://github.com/dmerkle/molfoundry-observables . Interactive examples and executable notebooks:…

Graph transformations model changing systems, with applications in software, biology and chemistry, among others. We introduce MolFoundry, a graph transformation framework, and present a workflow for observable analysis that tracks the dynamics of local patterns through rule composition. Analysing rule compositions avoids the need to enumerate a potentially infinite state space. Building on rule-algebraic stochastic rewriting, MolFoundry's kernel composes rules with nested application conditions, including missing-edge constraints. Given rules, rates and query patterns, the algorithms iteratively identify auxiliary pattern counts and search for closure. Using exact counting identities supplied by graph-family backends, successful searches yield closed ordinary differential equations for average counts or, with justified individual jumps, finite event models describing joint changes and rates. We evaluate conditional composition and automated discovery of auxiliary observables against published calculations and independent rule application. Applications to aldol addition, copolymerization and chlorination show how the framework yields quantitative predictions directly from molecular graph rules.

0.38

Efficient Closure Learning in Dynamical Systems: A Comparison of Data-Assimilated and Embedded Approaches

cs.LG math.DSstat.ML ·2026-11-02 ·Rileigh Bandy, Teresa Portone, Mohammad Khalil, Eric Crislip, Kyle Neal
similarity 0.52
Abstract

Increased computing power has transformed computational science and improved predictive capabilities for complex systems, but many phenomena still exceed current simulation capabilities or require rapid evaluations for fast design iterations. Closure models address this challenge by approximating unresolved effects in reduced or incomplete dynamical systems. Data-driven closures offer a flexible mechanism for improving model accuracy and applicability, but approaches that embed the closure within a computational model for construction and training phases can be computationally expensive and cause numerical instabilities in the computational model during training. To avoid the challenges posed by embedded approaches, staged approaches to closure-model learning have been developed. The first stage uses data assimilation to infer state and closure trajectories from observations. The second stage trains a machine learning closure model offline using the assimilated data, thereby avoiding repeated simulator calls during training. In this work, we investigate the cost and accuracy tradeoffs between embedded and staged data-driven closure modeling approaches for a synthetic epidemiological SIQR model with a nonlinear state-dependent quarantine closure. The results illustrate a practical accuracy-efficiency trade-off: for this exemplar, embedded training provides the strongest average accuracy, while the staged approach yields comparable qualitative behavior with a moderate increase in error, substantially fewer model evaluations, and improved optimization robustness.

0.25

Data-driven discovery of intrinsic Lie point symmetries of differential equation systems

cs.LG math.DGmath.DSmath.GR+1 ·2026-11-05 ·Ilker Gurcan, Kadir Ustun, Ramazan Gokberk Cinbis
benchmark similarity 0.52
Abstract · 63 pages, 10 figures. Code and data availability statements are included in the manuscript

Discovering continuous symmetries directly from differential-equation data can reveal geometric structure for model reduction and scientific machine learning without symbolic determining equations or a closed-form representation of the governing system. We formulate intrinsic Lie point-symmetry discovery as an operator-theoretic problem on sampled jet-space data. Admissible generators are identified from a sampled determining operator and separated from redundant, solution-dependent, and geometrically trivial directions. The framework combines prolongation, sequential subspace restrictions, and a fixed nonlinear dictionary linear in trainable coefficients. A rank-stabilization preflight test diagnoses systems whose represented intrinsic symmetry algebra does not stabilize under dictionary refinement. On a controlled differential-equation benchmark with an analytically known 11-dimensional represented intrinsic symmetry algebra, the method recovers the complete represented generator set, reproduces its Lie-bracket structure to numerical precision, and approximates a known generator beyond the training domain. Here we show that explicit intrinsic continuous-symmetry generators can be recovered from data obtained from exact or approximate differential systems.

0.20

Identifiability Guarantees for Drivers and Dynamics of Delayed Physical Systems

cs.LG stat.MLmath.DS ·2026-09-29 ·Julien Boussard, Antoine Debouchage, Théo Saulus
benchmark similarity 0.52
Abstract · 46 pages, 2 figures

A wide range of methods have been proposed, including physics-informed neural networks, which are powerful but do not guarantee identifiability of the dynamics, symbolic regression, which requires a set of precomputed operations, and causal discovery, which is more principled but usually relies on strong assumptions that physical systems may violate. In this work, we develop a theory-grounded method and prove that under a set of permissive assumptions, the structural drivers and drift of stochastic delayed differential equations are identifiable. Our method outperforms others on a benchmark for driver identifiability, and on a second benchmark to evaluate physical consistency of the learned dynamics.

0.33

Identifying ODEs from Unstructured Data with Causal Representation Learning

cs.LG cs.AIstat.ML ·2026-09-29 ·Alessandro Trenta, Riccardo Massidda, Davide Bacciu, Sara Magliacane
similarity 0.52
Abstract

We study the problem of recovering the governing ODE of a dynamical system from unstructured, high-dimensional observations such as images. Existing methods for ODE discovery typically assume direct measurements of the variables, or do not provide theoretical guarantees on the learned variables and equations. While Causal Representation Learning (CRL) methods provide guarantees on identifying variables from high-dimensional observations up to component-wise diffeomorphisms, we show that in general these variables cannot be used directly as input to equation discovery methods, which typically assume that the variables will lead to sparse equations. So we introduce SParse Equivalent Equation Discovery AutoEncoder (SPEED-AE), a framework that combines a pretrained CRL method with a component-wise autoencoder that learns transformations of variables that are amenable to sparse ODE discovery. We show that for polynomial ODEs, this additional step allows us to restrict the identifiability of each variable from polynomial to monomial diffeomorphisms. Experiments on Lotka-Volterra, Lorenz, and a two-pendulum system show that SPEED-AE improves on the disentanglement of the CRL methods and that it recovers ODEs that are closest to the ground truth, while achieving state-of-the-art forecasting performance.

0.32

On Parameters of Nonlinear Scalar Dynamics from Video: Invariants, Calibration, and Identifiability

cs.LG ·2026-09-30 ·Wenjie Wang, Yuanyuan Wang, Zixiang Jiang, Shaoan Xie, Mingming Gong
unusual similarity 0.51
Abstract

Physical parameter estimation from video aims to recover the parameters of a known family of governing dynamical equations from pixel observations. Existing identifiability theory for this setting has focused on linear time-invariant (LTI) second-order systems, leaving open what can be identified for nonlinear scalar dynamics. We develop an identifiability theory for nonlinear scalar second-order ODEs, organized by how their velocity dependence interacts with changes of the learned state coordinate. Under a shared non-collapsed state map and explicit same-state velocity-coverage conditions, we show that parameter identifiability depends on the ODE family: some parameters are uniquely identifiable, while in other families only invariant parameter combinations are identifiable or external physical calibration is required. For laws that are at most linear in velocity, compatibility forces affine coordinate alignment, yielding explicit parameter relations, invariants, and calibration conditions. This affine conclusion extends to broader finite velocity-feature families when coordinate curvature can be separated from the declared velocity dependence. For families admitting a squared-velocity term, nonlinear coordinate ambiguity can remain; a law-derived normalization instead enables affine comparison between canonical laws. Experiments on synthetic systems and real pendulum and free-fall videos support the predicted parameter relations, coverage effects, and calibration requirements.

0.24