CS Paper Radar

Subspace Based Identification of Errors-in-Variables Linear Descriptor Systems

Deepanjhan Das, Shankar Narasimhan

eess.SY ·submitted 2026-08-31 05:08 UTC · v1
published

Abstract

The identification of linear descriptor systems (DAEs) from noise-corrupted data makes two critical assumptions: requirement of an \textit{a priori} classification of variables into inputs and outputs, and a pre-specified structural assumption with respect to the index of the system. This paper proposes a data-driven methodology for identifying index-0 and index-1 DAEs within an errors-in-variables framework. We extend a subspace-based iterative PCA (SMI-IPCA) approach to the behavioral setting, treating all measured variables as a unified augmented vector to avoid classification bias. This method enables systematic estimation of the noise variances, the number of algebraic and differential output variables, while simultaneously identifying the algebraic constraints and kernel representation of the dynamic system corresponding to its minimal realization order without prior structural knowledge. Simulation studies on index-0 and index-1 systems demonstrate the effectiveness of the proposed approach and its practical applicability.

Comment
Accepted for publication in the 8th International Symposium on Advanced Control of Industrial Processes (IEEE AdCONIP 2026), University of Auckland, New Zealand. There are 6 pages and 3 figures in this draft

Closest papers

Nearest neighbours by meaning across the whole index.

Multivariate linear regression without prior assumptions

eess.SY stat.APstat.CO ·2026-09-09 ·Mayank S. K. Gupta, Deepanjhan Das, Arun K. Tangirala, Shankar Narasimhan
benchmark similarity 0.58
Abstract · The manuscript is under further processing. Important modifications might take place in further versions. There are 32 pages containing 10 f…

Recovering the linear relationships that govern a system from noisy measurements is a basic task across the physical and engineering sciences. Because every measured variable may carry an unknown amount of noise, classical regression must commit in advance to a set of structural assumptions: ordinary least squares requires a declared input-output partition with input variables being noise-free, total least squares assumes equal noise variance across all variables, and generalized total least squares additionally requires the noisy-variable partition and variances to be known beforehand. Kalman~\cite{Kalman:1982} showed that any procedure returning a unique linear model from inexact data must rest on such unverifiable a priori assumptions -- ``prejudices'' -- that cannot be checked against the data itself, and that removing them leaves the identification problem fundamentally indeterminate. Whether these prejudices can instead be resolved directly from the data has remain unresolved. Here we show that an iterative generalized-eigenvalue algorithm, QZ-IPCA, recovers the noisy-variable partition, noise variances, number of linear relations, and regression coefficients of a multivariate linear system simultaneously, using only the raw data. Across all possible exhaustive noise configurations of a five-variable benchmark network, QZ-IPCA correctly identifies model structure and recovers coefficients with error below 6.4\%. It outperforms ordinary least squares even when given the best partition, and succeeds in rank identification precisely where standard total least squares falls once noise variances differ across variables. These results show that the assumptions conventionally required for multivariate regression are not necessary, recasting model identification as a problem solvable from data geometry alone.

0.26

The asymptotic variance of the Hermite-Domain Predictor-Based Subspace Identification method

eess.SY eess.SP ·2026-10-04 ·Enrico Barbiero, Marco Lovera
published similarity 0.58
Abstract · Accepted for presentation at the 2026 IEEE Conference on Decision and Control (CDC). 6 pages, 3 figures

This paper derives analytical expressions for the asymptotic variance of the Hermite-Domain Predictor-Based Subspace Identification (HD-PBSID) method. Unlike continuous-time subspace approaches that rely on intermediate-domain transformations, HD-PBSID identifies continuous-time state-space matrices directly. The derivation first establishes the uncertainty of the estimated state-space matrices and then exploits these results to obtain asymptotic variance expressions. These expressions provide analytical uncertainty bounds for system eigenvalues, which are invariant under similarity transformations and therefore uniquely characterize the identified dynamics. The proposed formulas are first validated in an ideal Hermite-domain setting, where the conditions underlying the derivation are satisfied, and then assessed on noisy time-domain data through Monte Carlo simulations. The predicted bounds show very good agreement with the eigenvalue distributions in the ideal setting and acceptable agreement in the time-domain case when the innovation sequence is enforced to be white.

0.36

Towards Identifiable Representations under Misspecified Structure

cs.LG ·2026-09-27 ·Yuke Li, Yujia Zheng, Ziyi Chen, Kun Zhang, Heng Huang
theory similarity 0.55
Abstract

The presence of noise that depends on the latent variables poses a fundamental challenge to identifiability. Existing results rely on conditional independence among the observations given the latent variables. We study a more general \emph{misspecified structure}, where this conditional factorization does not hold, and establish both precise and approximate identifiability guarantees. We characterize structural misspecification as a perturbed factor analysis problem. For precise identifiability, we establish subspace identifiability under spectral separation and controlled perturbation, followed by component-wise identifiability under structural sparsity. When the precise condition is not guaranteed, we derive an approximate subspace-identifiability theorem. Based on these results, we develop an unsupervised variational estimator for recovering latent variables. Experiments demonstrate the effectiveness of the proposed framework.

0.27

Sparse Orthogonal Regression Technique: A Spectral Framework for Equation Discovery, Approximation, and Integration

cs.LG ·2026-08-13 ·Sabin Roman, Ljupco Todorovski, Saso Dzeroski
published similarity 0.52
Abstract · 15 pages, 4 figures. Accepted for oral presentation at the 29th International Conference on Discovery Science (DS 2026), Mainz, Germany, Oct…

We develop the Sparse Orthogonal Regression Technique (SORT), a sparse spectral framework for learning orthonormal-basis expansions from noisy and irregularly sampled data. SORT estimates expansion coefficients directly from observations using L1-regularized regression, avoiding explicit quadrature or analytic inner-product evaluation. The central application is data-driven discovery of ordinary differential equations: vector fields are represented in chosen orthogonal bases and learned as sparse coefficient expansions. This provides a complementary route to symbolic regression, grammar-based discovery, and SINDy-style sparse identification by first recovering a compact spectral representation, which can later guide searches for simpler analytic forms. Across the dynamical-system experiments, SORT matches or improves upon library-based sparse-regression baselines when the basis is well adapted to the problem, and shows more stable degradation under sparse sampling, noisy derivative estimates, and representation mismatch. Specific examples illustrate why this representation is useful: if a finite library misses the problem-specific nonlinearity, the resulting model can fail. SORT is not immune to mismatch, but it shifts the problem away from brittle selection among generic terms to basis design adapted to the problem domain. The experiments also show that dominant low-order coefficients persist as model order increases, supporting order-consistent model growth. Beyond equation discovery, the same learned expansion supports nonlinear approximation and estimation of complex, high-dimensional integrals by coefficient readout. Overall, SORT provides a reusable intermediate representation for system identification, approximation, and integration, while making basis design an explicit part of the scientific modeling problem.

0.28

Multirate Data-Driven Predictive Control: Rank Obstructions, Identifiability, and Noise Conditioning

eess.SY math.OC ·2026-11-01 ·Robert Vrabel
similarity 0.51
Abstract

We develop rank, identifiability, and noise-conditioning results for compact input--output predictors in multirate data-driven predictive control. The inverse of a square zero-input response matrix used in an existing compact-lifting construction is shown to be undefined under its observability and minimal-polynomial assumptions. We derive exact replacements using rank-complete data, characterize all predictor extensions, and establish the minimum-norm and minimax Euclidean noise properties of the canonical Moore--Penrose extension. A joint predictor is identified directly from mixed experiments with arbitrary initial states. Deterministic perturbation bounds quantify reconstruction errors through informative singular-value margins, while a positive-definite reduced weighting preserves the nominal quadratic cost. Sampling-rate observability and event-triggering analyses identify additional conditions needed for reconstruction and stability guarantees.

0.30

Weak and Strong Data Informativity with Structural Priors for System Analysis

eess.SY ·2026-10-28 ·Yuan Zhang, Wenxuan Xu, Yun Feng, Keke Huang, Keyou You
similarity 0.51
Abstract

When measurement data are insufficient for unique system identification, data informativity evaluates whether a dataset determines a property across all systems consistent with the data. This paper introduces a unified framework distinguishing between weak and strong data informativity under prior structural knowledge described by affine constraints: data are weakly informative if at least one system consistent with the data and prior knowledge possesses the target property, and strongly informative if every consistent system satisfies it. The latter is consistent with the notion of data informativity in the existing literature. By explicitly parameterizing all consistent systems as affine functions of free parameters via the Moore-Penrose pseudoinverse, we characterize these notions for fundamental system properties-including controllability, stabilizability, and stability. This formulation establishes that verifying weak and strong informativity, when tractable, reduces to rank tests of matrix pencils constructed from the data and prior knowledge. Our findings show that structural priors can lower data-excitation requirements and enable reliable analysis even when data fail to be strongly informative. Finally, the framework is extended to a class of noisy data.

0.32

A Functional SVD Framework for Regularized Multivariate Functional PCA with Dual Penalization

cs.LG stat.MLstat.ME ·2026-09-13 ·Yue Zhao, Hossein Haghbin, Rebecca Sanders, Mehdi Maadooliat
similarity 0.51
Abstract

This paper introduces a novel framework for Regularized Multivariate Functional Principal Component Analysis (ReMFPCA) via Functional Singular Value Decomposition (SVD). The proposed method extends existing MFPCA approaches by incorporating a generalized functional SVD within a Hilbert space framework, enabling simultaneous regularization of both functional principal components (PCs) and their associated PC scores. A key innovation of this framework is the inclusion of a sparsity penalty on the PC scores, which enhances interpretability by filtering out irrelevant subject-specific variations. This dual-penalization strategy represents a significant advancement beyond existing covariance-based eigen decomposition methods, which penalize only the functional PCs. Two power algorithm implementations, sequential and joint, are proposed, together with a cross-validation approach based on iterative regression for optimal smoothing parameter selection. Comprehensive simulation studies and real data applications demonstrate that the proposed framework substantially improves the extraction of informative and interpretable components, offering methodological and practical benefits for analyzing multivariate functional data across diverse domains.

0.34

Functional dynamic mode decomposition: Learning infinite-dimensional systems from data

cs.LG math.DSstat.ML ·2026-09-24 ·Stefan Klus, Eirini Ioannou
similarity 0.50
Abstract

Dynamic mode decomposition (DMD) is a data-driven method that computes the best linear approximation of the underlying dynamical system and decomposes the dynamics into a superposition of characteristic spatiotemporal patterns. Originally introduced by the fluid dynamics community, DMD and its extensions have found widespread use in many other research areas such as molecular dynamics, climate science, engineering, finance, and neuroscience. Applications include dimensionality reduction, forecasting, system identification, control, and spectral clustering. In order to apply DMD to partial differential equations, the spatial domain is typically first discretized using finite difference or finite element techniques, thus implicitly rendering the problem finite-dimensional. We extend projected and exact DMD to infinite-dimensional systems. Rather than estimating matrices from vector-valued observations, our DMD variants learn finite-rank operators from functional data such as observables, densities, or wavefunctions. We show that conventional DMD algorithms can be regarded as special cases of their functional DMD counterparts. All results will be illustrated with the aid of guiding examples. We focus in particular on Koopman, Perron-Frobenius, and Koopman-von Neumann operators associated with graphons, ordinary differential equations, and stochastic differential equations.

0.17