CS Paper Radar

Data-driven control of linear systems using quantized data

Zhenghao Li, Guosong Yang

eess.SY math.OC ·submitted 2026-10-05 03:16 UTC · v1

Abstract

This paper studies data-driven stabilization of unknown discrete-time linear systems using only quantized state measurements that take values in finite sets. The proposed approach consists of two stages. In the controller design stage, we collect quantized data while maintaining a prescribed quantization error bound and use them to formulate a semidefinite program (SDP). We establish a verifiable condition under which any feasible solution to the SDP yields a stabilizing feedback gain, and show that a stabilizing gain can always be obtained when the quantization error is sufficiently small. In the stabilization stage, a Lyapunov-based quantizer update rule is developed to guarantee exponential convergence under quantized state feedback. As a key feature, the number of quantization cells remains finite in both stages and constant during stabilization. Simulation results illustrate the effectiveness of the proposed approach.

Closest papers

Nearest neighbours by meaning across the whole index.

Rate-cost Trade-offs in H-infinity Control with Initial State Uncertainty

eess.SY ·2026-09-18 ·Vikrant Malik, Victoria Kostina, Babak Hassibi
theory similarity 0.58
Abstract

We consider the problem of H-infinity control in the presence of a digital communication channel between the observer and the controller and investigate the fundamental trade-off between the required communication data rate and H-infinity performance. The system follows linear dynamics and has no additive internal noise, so that the uncertainty is confined to the initial state. For the scalar system, using a deterministic time-zero covering argument, we establish a lower bound on the required data rate for a given H-infinity cost and demonstrate why logarithmic quantization (Elia, 2000) is a natural choice. We further develop an achievability scheme and show that, for the scalar system, its rate matches the converse asymptotically in the high-data-rate limit.

0.23

Operator-based data embedding for data-driven control of continuous-time systems from noisy data

eess.SY math.OC ·2026-08-18 ·Masashi Wakaiki
theory similarity 0.55
Abstract · 24 pages

We propose a data-driven method for designing state-feedback gains that achieve stabilization, $H_2$-control, and $H_\infty$-control for continuous-time systems. The state-input data are assumed to be corrupted by process noise, measurement noise, and input disturbances. We first characterize the set of all systems consistent with the noisy data using operator-based data embedding. This characterization yields necessary and sufficient conditions for data informativity under a certain class of noise. These conditions are formulated as linear matrix inequalities, and the feedback gains are constructed from their solutions. To enable direct controller design from noisy sampled data for continuous-time systems, we also obtain an upper bound on the reconstruction error of continuous-time signals.

0.28

Universal Quantizer Design for Identification of Systems with Memory

eess.SY ·2026-11-16 ·Yibo Shi, Ying Wang, Karl H. Johansson, Cristian R. Rojas
similarity 0.55
Abstract · 8 pages

In system identification from quantized observations, the quantizer determines how much information about the parameters the observations retain, and hence the achievable estimation accuracy. Quantizer design can be guided by the Fisher information matrix (FIM), which assesses the parameter information retained by candidate quantizers. Existing methods, however, typically rely on closed-form expressions of the FIM. This paper proposes a universal quantizer design method for general systems with memory. Its core is a universal FIM estimator that evaluates the information per bit from simulated trajectories, and the thresholds are designed by maximizing the estimated criterion under a bit budget. For unknown parameters, the design is implemented through a two-stage procedure. Numerical studies on a quantized ARX system yield designs close to the reference optimum, while a nonlinear cascaded-tanks example reduces the identification error by about 50% relative to a single median threshold.

0.31

Data-Driven LQR with Uncertainty Refinement and Domain Randomization---Part~II: Fisher-Majorized Certified Policy Iteration

eess.SY ·2026-10-24 ·Hamidreza Modares
theory similarity 0.55
Abstract

Building on the uncertainty description developed in Part~I, this paper introduces a Fisher-majorized domain-randomized generalized policy iteration framework for data-driven linear quadratic regulator (LQR) synthesis. At each iteration, partial Bellman evaluation over a fixed batch of uncertainty realizations produces a structured Sylvester policy-improvement step. A residual-weighted Fisher curvature controls the policy-induced variation in the stationary covariance and converts the Sylvester model into a certified upper bound on the cost change, thereby guaranteeing descent for every accepted step. A check-and-correct mechanism then certifies stability over the entire uncertainty support, rather than only over the sampled realizations. Consequently, every iterate is robustly stabilizing and monotonically decreases the fixed-batch objective. The Fisher truncation and stability correction become inactive after finitely many times. The objective gap then contracts linearly to a floor determined by the dispersion of the realization-wise Riccati targets and by measurement noise. In the absence of measurement noise, this floor vanishes when the realization-wise targets coincide.

0.30

Adaptive Quantization Preserves Fast Rates for TD Learning over Rate-Limited Channels

cs.LG ·2026-11-09 ·Sreejeet Maity, Aritra Mitra
theory similarity 0.54
Abstract

Motivated by reinforcement learning subject to communication constraints, we study a policy evaluation problem with linear function approximation over a rate-limited channel. In our setup, an agent interacting with an unknown environment (modeled as a Markov Decision Process) transmits quantized estimates of a temporal-difference (TD) learning update direction to a server over a finite-capacity channel. Our goal is to investigate to what extent one can preserve the statistical convergence rates achievable when the channel has infinite capacity. To that end, we propose a new algorithm called Batched Adaptively Quantized TD (BAQ-TD), which uses batching to reduce the variance of the transmitted information, and adaptive quantization to encode innovations. We prove a high-probability finite-time error bound for BAQ-TD, and show that, above a certain finite channel capacity, BAQ-TD preserves the convergence rate of unquantized TD up to logarithmic factors. Specifically, for a $d$-dimensional value function parameter, we establish that transmitting a total of $\mathcal{O}(d \log(T))$ bits over a horizon of length $T$ suffices to achieve the order-optimal rate of $\tilde{\mathcal{O}}(1/T)$, marking an exponential improvement in communication-complexity over prior work.

0.25

Optimal Dynamic Quantizers for Periodically Time-Varying Systems via Cyclic Reformulation

eess.SY math.OC ·2026-11-16 ·Hiroshi Okajima
theory similarity 0.54
Abstract · Submitted to Automatica

This paper addresses the design of optimal dynamic quantizers for discrete-time linear periodically time-varying (LPTV) plants with discrete-valued inputs. Optimal dynamic quantizers, which minimize the worst-case output error caused by quantization, are well established for linear time-invariant (LTI) plants, whereas the corresponding design for plants with periodically time-varying dynamics has not been addressed. For square LPTV plants having relative degree one at every time phase, this paper derives an optimal periodic dynamic quantizer in closed form. The quantizer is constructed by applying the LTI theory to the cycled plant obtained by cyclic reformulation and reading off its periodic coefficient matrices block by block; its optimality is then verified directly, showing that it attains a performance lower bound determined by the largest instantaneous input-to-output gain over the time phases. The worst-case output error of general periodic dynamic quantizers is also characterized. The optimal quantizer is shown to be stable if and only if all invariant zeros of the cycled plant lie in the open unit disk, which is the condition that governs stable causal inversion of LPTV plants. A numerical example with comparisons to conventional quantizers illustrates the results.

0.29

Q-MINO: A Minimal-Norm Method for Quantization-Aware Training

cs.AR math.OCcs.LG ·2026-09-30 ·Don Li
similarity 0.54
Abstract

The Straight-Through Estimator (STE) is a widely used heuristic for Quantization-Aware Training (QAT), but its surrogate gradients can exhibit substantial mismatch with the underlying quantized objective, leading to noisy updates and parameter oscillations, particularly in ultra-low-bit regimes. We propose the Quantization-Aware Minimal-Norm Optimizer (Q-MINO), a temporal bundle method that combines gradient consensus, state-drift regularization, and an alignment constraint to construct stabilized, minimum-norm update directions from recent optimization states. Q-MINO solves the resulting constrained subproblem using a warm-started Frank--Wolfe procedure with a feasible fallback initialization. Theoretically, via a stochastic Lyapunov Kurdyka--Łojasiewicz (KL) framework, we show that Q-MINO achieves asymptotic neighborhood convergence. Moreover, we detail numerical experiments with Q-MINO at various quantizations.

0.17

Data-Driven Policy Iteration Without an Initial Stabilizing Policy: A Finite-Horizon Bootstrap Method

eess.SY ·2026-09-15 ·Jiacheng Wu, Yang Zhu
similarity 0.54
Abstract

This article investigates data-driven policy iteration (PI) for continuous-time linear systems without requiring an initially stabilizing policy. Standard infinite-horizon PI is not self-starting because its policy-evaluation step is well posed only when the feedback gain is stabilizing. However, verifying this property is difficult when the system matrices are unknown. To remove this requirement, we develop a finite-horizon bootstrap method. The key idea is to perform policy evaluation over a compact interval for a shifted system, where the evaluation equation is well defined for arbitrary bounded time-varying policies. We show that, for a sufficiently long horizon, the initial-time optimal gain of the shifted finite-horizon problem, when applied as a constant feedback gain, achieves a prescribed stability margin for the original system. We then derive a data-driven implementation from an off-policy identity evaluated along trajectories of the original plant. We use basis-function approximations to reconstruct the finite-horizon value matrix and policy, and we characterize the resulting error through a perturbed policy-improvement recursion. A data-driven Lyapunov certificate is further introduced to verify admissibility of the candidate gain before it is used to initialize infinite-horizon PI. Numerical studies of a batch reactor and a two-mass-spring system demonstrate the effectiveness of the proposed bootstrap method.

0.15