CS Paper Radar

$H_2$-optimal model order reduction using hyperbolic geometry

Andrea Angino, Tamás Dózsa, Matthias Voigt

eess.SY math.NA ·submitted 2026-10-12 06:23 UTC · v1
benchmark

Abstract

We revisit the problem of approximating a linear time-invariant LTI model by a reduced-order model (ROM) in an $H_2$-optimal sense. A widely used method for computing such ROMs is the iterative rational Krylov algorithm (IRKA). However, in practice, the stability of the resulting ROM is not generally guaranteed. In this work, we develop a novel framework that can be used to obtain $H_2$-optimal models of single-input single-output LTI systems while enforcing stability of the ROM. We use Malmquist-Takenaka orthogonal expansions in the corresponding $H_2$-spaces and their connection to hyperbolic geometry to develop an equilibrium function. We show that the poles of an $H_2$-optimal ROM transfer function are defined by the zeros of this equilibrium function. The resulting nonlinear root-finding problem is solved using a Newton-type method formulated on the products of Poincaré disk manifolds, where updates are performed along hyperbolic geodesics ensuring that the stability constraint is satisfied at every iteration. We present numerical experiments on benchmark systems for both discrete- and continuous-time LTI MOR problems, including examples where IRKA produces unstable reduced models while the proposed method preserves stability throughout the iteration.

Closest papers

Nearest neighbours by meaning across the whole index.

Stable Rational Approximation of PDE Transfer Functions with $H_\infty$ Error Bounds

eess.SY math.AP ·2026-10-06 ·Aleksandr Talitckii, Matthew M. Peet
unusual similarity 0.55
Abstract

Transfer functions of Partial Differential Equations (PDEs) are irrational and difficult to obtain. Unlike for rational transfer functions, only a few methods are available for the control and analysis of irrational transfer functions. Thus, for robust analysis and control of PDEs, we need to use a rational approximation of the transfer function, preferably with provable $H_\infty$ error bounds. In this paper, we extend Krylov subspace model reduction to infinite-dimensional systems modeled by Partial Integral Equations (PIEs) -- an equivalent representation of PDEs. First, we propose a state transformation of the PIE system that allows us to compute a controllability matrix. Then, to obtain a rational approximation, we project the PIE states onto the vector space spanned by the truncated controllability matrix. Next, we show that sufficient conditions for exponential stability and well-posedness of the PIE system guarantee the exponential stability of the reduced-order system and provide constructive finite-frequency $H_\infty$ error bounds. Finally, we provide four illustrative numerical examples to demonstrate the performance of the proposed method.

0.25

Parallel Broyden Methods for Efficiently Evaluating Nonlinear State Space Models

cs.LG math.NA ·2026-11-10 ·Ian Christopher Tanoh, Scott W. Linderman
top venuetheory similarity 0.55
Abstract · Accepted at NeurIPS 2026

Nonlinear state space models are typically evaluated sequentially, limiting their ability to exploit modern parallel hardware. Recent work has shown that state space models can be evaluated in parallel by reformulating evaluation as a root-finding problem, which can be solved with a parallel form of Newton's method. However, exact Newton methods require expensive multiplication of dense Jacobian matrices, and quasi-Newton methods based on diagonal approximations, while more scalable, are often slow to converge because they neglect interactions across state dimensions. We introduce a novel quasi-Newton approach based on Broyden's method, which captures coupling terms with diagonal-plus-low-rank approximations to blocks of the Jacobian. We construct the approximations from trajectory secants, avoiding automatic differentiation while retaining the favorable scaling of diagonal approximations and remaining compatible with parallel scan through rank compression. We prove finite-step recovery of the exact trajectory under the compressed scan, and show that convergence is tracked by the compression error and by the block approximation error along the current trajectory error, rather than in spectral norm. Empirically, we show that our method is advantageous when interactions are approximately low rank or when Jacobian evaluation is expensive: on low-rank RNNs, parallel MCMC algorithms, and denoising diffusion models, it converges in fewer iterations than other quasi-Newton methods and is the fastest parallel method when Jacobian evaluation is expensive or state dimensions are large.

0.45

The De Cock--De Moor Conjecture: Proof, Normal Form, and Indefinite Angles

eess.SY math.OC ·2026-08-30 ·Jeffrey Humpherys
theory similarity 0.52
Abstract

De Cock and De Moor conjectured that two matrices built from the solutions of three coupled Lyapunov equations always share their eigenvalues, an identity linking principal angles between model subspaces with the canonical correlations between the past and future of a stochastic process. The conjecture was recorded as Problem 9.1 of \emph{Unsolved Problems in Mathematical Systems and Control Theory}. We prove it under the natural nonresonance condition, without stability or diagonalizability, and show that the two matrices are similar. The proof exposes a Cauchy-matrix structure created by the rank-one perturbation and reduces the problem to rational interpolation, and the main theorem has also been verified in the Lean~4 proof assistant. The same structure gives a normal form that depends only on the poles and zeros of the model. Off the stable set the eigenvalues become squared cosines of angles in an indefinite metric. We prove an inertia theorem for them and show that reflecting a pole or a zero across the unit circle acts on the angles by a principal pivot transform. For several inputs and outputs, where the conjecture fails, we identify the subspaces whose angles do give the canonical correlations. We also relate our approach to the independent proof of Gillberg and Löfberg.

0.21

Norm-optimal model order reduction in reproducing kernel Hilbert spaces

cs.LG math.NAeess.SY ·2026-10-20 ·Tamás Dózsa, Andrea Angino, Rolf Krause, Matthias Voigt
theory similarity 0.51
Abstract · 92 pages, 7 figures

We consider the problem of model order reduction (MOR) in reproducing kernel Hilbert spaces (RKHSs). We prove generalizations of well-known necessary interpolatory conditions for norm-optimal reduced-order models, originally stated for rational functions in $H_2$ Hardy-Hilbert spaces. We construct an alternative to the iterative rational Krylov (IRKA) algorithm for RKHSs with differentiable kernels to obtain norm-optimal reduced-order models. Then, we introduce generalized Malmquist-Takenaka (GMT) functions that can be used to define orthonormal bases in an arbitrary RKHS. Using GMT functions, we propose unitary transformations between separable RKHSs. This allows us to extend our optimality conditions and subsequent algorithms to MOR problems posed in RKHSs with non-differentiable kernels. The potential and versatility of the proposed MOR framework is demonstrated in several numerical experiments. We perform norm-optimal MOR on various machine learning models such as support vector machines and deep ReLU networks. In addition, we show how the proposed MOR framework can be used to solve seemingly unrelated problems. In particular, we provide an example for fitting high degree polynomials to data and also obtain a FEM-like method for solving partial differential equations (PDEs) with an optimal kernel basis.

0.33

Floating-point, exact and certified computation for control: paradigms, pitfalls, and how to combine them

cs.SC ·2026-11-11 ·Christina Katsamaki, Fabrice Rouillier
similarity 0.51
Abstract

Many questions in linear systems theory have a discrete answer: is a polynomial Hurwitz, is a 2-D system structurally stable, is the peak gain finite, which solution of a Riccati equation is stabilizing? Algorithms implemented in floating point usually answer such questions, but often with a limited, or even no, guarantee on the result, which depends on a tolerance fixed a priori. Computer algebra and interval arithmetic provide other ways of computing, which give guarantees on the result, but usually at a higher cost. In this paper, we propose a short guide to these approaches: floating-point, exact, multiprecision and interval arithmetic, certified root isolation and certified Newton methods. Using small examples from control theory (each of them runs in a few seconds), we show what each approach guarantees and in which situations it fails, and how several approaches can be combined, for example by certifying a numerical solution, or by reducing a problem exactly before solving it with certified real solving. We then revisit the structural stability of 2-D systems (with and without parameters) and the computation of the $H_\infty$ norm, and we list the available implementations. The main examples are given as reproducible worksheets based on the PACE ecosystem.

0.32

Hyperbolic Graph Representation Learning: Embed in One Metric, Optimize with Another

cs.LG stat.ML ·2026-10-05 ·Federico Larroca, Paola Bermolen, Marcelo Fiori, Bernardo Marenco
similarity 0.51
Abstract · 7 pages, 2 figures

Hierarchical graphs embed in hyperbolic space with lower distortion than in Euclidean space owing to its negative curvature. However, their gradient-based learning is hampered at large radii, where the Poincaré ball and the Lorentz hyperboloid models fail numerically. Polar coordinates avoid this problem, but the hyperbolic metric scales the angular step by the hyperbolic sine of the radius, freezing angular motion. We observe that this factor is a choice, silently fixed by existing implementations: the Euclidean tangent parametrization, for instance, uses the radius itself. We show that other choices are not only possible but preferable. They are endpoints of a one-parameter family of optimization preconditioners with curvatures from $-1$ to $0$, while the embedding remains at curvature $-1$. We show that since the Euclidean preconditioner rearranges a layout but refines it poorly, while an intermediate one refines far better once a layout is in place, combining them in two stages reduces the loss on real-world trees by 46-74% over the best single curvature.

0.20

JAXIGA - A software framework for GPU-enabled and differentiable isogeometric analysis

cs.MS math.NA ·2026-10-06 ·Cosmin Anitescu, Yongjie Jessica Zhang
benchmarkcode/dataunusual similarity 0.50
Abstract

In this paper, we present JAXIGA, an open-source library for isogeometric analysis based on JAX. The library separates the construction of the mesh from the computations which are traced for compilation and differentiation. This allows geometry evaluation, assembly and the supported solvers to be combined in a just-in-time compiled program, for which first-order reverse-mode derivatives can be computed. We consider three numerical methods obtained from a single pointwise energy density. The Galerkin and energy-minimization methods use the same discrete potential and have the same stationary points, while collocation enforces the corresponding strong form. The sensitivities of a converged solution are obtained by solving one adjoint problem, and their accuracy depends on the tolerances of both the primal and adjoint problems. We also describe hierarchical extraction for local refinement of the variational methods and the use of smooth spline spaces for fourth-order problems. The numerical results are compared with analytical solutions and independent FEniCSx and JAX-FEM computations. For the reported GPU benchmark with 36,448 unknowns, assembly is twenty-four times faster than on the host CPU. When the conjugate-gradient solver is also run on the GPU, the total solution time is reduced from 31.8 to 1.38 seconds, and the result agrees with the direct solution to $5\times10^{-11}$. These results show that the choice of solver and the reuse of compilation are important for obtaining an overall reduction in computational cost.

0.35

The Hyperbolic Surface Distance, Diameter, and Dirichlet Problems

cs.CG ·2026-09-09 ·Vincent Despre, Auguste Gezalyan, Marc Pouget
similarity 0.49
Abstract

Despite the prominence of hyperbolic surfaces in mathematics, basic algorithmic questions about them, even computing the distance between two points, have remained open, leaving many features of these surfaces inaccessible. The classical machinery assumes a polyhedral structure absent on a smooth surface. We remove these obstacles. We begin with an efficient $O(g^2)$ algorithm for the distance between two points, where $g$ is the genus of the surface. Building on it, we obtain an $O(g^2 \log g)$ method for answering distance queries from a fixed source and, as a consequence, for recentering a Dirichlet domain around an arbitrary point. This understanding of distances on the surface then lets us approximate the diameter to within any $\eps$ in time $O(g^3 \log g / \eps^2)$. We further show that the diameter, a single real number encoding a great deal about the surface, is exactly computable. Its hyperbolic cosine is an algebraic number over the field encoding the coefficients of the hyperbolic isometries defining the surface.

0.14