CS Paper Radar

Rate-cost Trade-offs in H-infinity Control with Initial State Uncertainty

Vikrant Malik, Victoria Kostina, Babak Hassibi

eess.SY ·submitted 2026-09-18 03:33 UTC · v1
theory

Abstract

We consider the problem of H-infinity control in the presence of a digital communication channel between the observer and the controller and investigate the fundamental trade-off between the required communication data rate and H-infinity performance. The system follows linear dynamics and has no additive internal noise, so that the uncertainty is confined to the initial state. For the scalar system, using a deterministic time-zero covering argument, we establish a lower bound on the required data rate for a given H-infinity cost and demonstrate why logarithmic quantization (Elia, 2000) is a natural choice. We further develop an achievability scheme and show that, for the scalar system, its rate matches the converse asymptotically in the high-data-rate limit.

Closest papers

Nearest neighbours by meaning across the whole index.

Adaptive Quantization Preserves Fast Rates for TD Learning over Rate-Limited Channels

cs.LG ·2026-11-09 ·Sreejeet Maity, Aritra Mitra
theory similarity 0.58
Abstract

Motivated by reinforcement learning subject to communication constraints, we study a policy evaluation problem with linear function approximation over a rate-limited channel. In our setup, an agent interacting with an unknown environment (modeled as a Markov Decision Process) transmits quantized estimates of a temporal-difference (TD) learning update direction to a server over a finite-capacity channel. Our goal is to investigate to what extent one can preserve the statistical convergence rates achievable when the channel has infinite capacity. To that end, we propose a new algorithm called Batched Adaptively Quantized TD (BAQ-TD), which uses batching to reduce the variance of the transmitted information, and adaptive quantization to encode innovations. We prove a high-probability finite-time error bound for BAQ-TD, and show that, above a certain finite channel capacity, BAQ-TD preserves the convergence rate of unquantized TD up to logarithmic factors. Specifically, for a $d$-dimensional value function parameter, we establish that transmitting a total of $\mathcal{O}(d \log(T))$ bits over a horizon of length $T$ suffices to achieve the order-optimal rate of $\tilde{\mathcal{O}}(1/T)$, marking an exponential improvement in communication-complexity over prior work.

0.25

Data-driven control of linear systems using quantized data

eess.SY math.OC ·2026-10-05 ·Zhenghao Li, Guosong Yang
similarity 0.58
Abstract

This paper studies data-driven stabilization of unknown discrete-time linear systems using only quantized state measurements that take values in finite sets. The proposed approach consists of two stages. In the controller design stage, we collect quantized data while maintaining a prescribed quantization error bound and use them to formulate a semidefinite program (SDP). We establish a verifiable condition under which any feasible solution to the SDP yields a stabilizing feedback gain, and show that a stabilizing gain can always be obtained when the quantization error is sufficiently small. In the stabilization stage, a Lyapunov-based quantizer update rule is developed to guarantee exponential convergence under quantized state feedback. As a key feature, the number of quantization cells remains finite in both stages and constant during stabilization. Simulation results illustrate the effectiveness of the proposed approach.

0.24

Sharp Critical Minimax Laws and No-Learning Thresholds in Continuous-Time Adaptive Control

cs.LG math.OC ·2026-09-27 ·Chen Jia
theory similarity 0.56
Abstract

We study episodic continuous-time control with an unknown vector control gain, scalar state, quadratic action cost, and smooth convex terminal cost. In the scalar Gaussian experiment, let $Δ(H)$ denote the minimax improvement over zero control and set $δ=\sqrt2H^2-1$. We prove the critical law $$ Δ(H)\asymp δ^4\sqrt{\log(1/δ)} \qquad (δ\downarrow0), $$ with a matching lower and upper bound. The lower bound follows from a uniform deficit--energy inequality valid for fully adaptive controls with unbounded amplitudes, while a moving soft-threshold feedback attains the rate. For local parameters $θ=N^{-1/4}h$, $|h|\le H$, we show that the normalized minimax regret over $N$ episodes is within $O(N^{-1/2})$ of a fixed-horizon Gaussian sequential control problem, without an additional dimension factor. The terminal task enters the limit only through $c_g=\operatorname{Var}(g(Z))$. The Gaussian problem exhibits an exact no-learning phase transition: $$ C_d^T(H)=TH^2/2 \iff H^4T\le d^2/2, $$ yielding the asymptotic task boundary $c_gH^4=d^2/2$.

0.27

Finite-Memory Control of POMDPs: Fundamental Limits and Efficient Design

cs.LG cs.IT ·2026-11-02 ·Emrecan Kutay, Atilla Eryilmaz, Ness Shroff
top venuetheory similarity 0.56
Abstract · Accepted at NeurIPS 2026

Optimal control of partially observable Markov decision processes (POMDPs), in general, requires a complete history. The belief state, a distribution over hidden states, summarizes this history and provides the classical sufficient statistic to control POMDPs. However, the continuous nature of the belief space generally prevents a finite-memory controller from maintaining it exactly. This raises the question we address in this work: what must the available finite memory preserve to achieve near-optimal control performance? We study this question through an information-theoretic converse that gives a fundamental lower bound on the loss of any finite-memory controller. The analysis introduces the concept of a decision witness that characterizes belief states whose confusion would lead to unavoidable loss. Motivated by this bound, we propose RECAP, a constructive quantization method for designing representative memory states. We prove an upper bound on the optimality gap of any RECAP codebook and use the components of this bound together with the converse analysis to define the codebook objective. Experiments on 11 POMDP benchmarks demonstrate that RECAP improves over finite-memory representation baselines under the same memory budget.

0.32

Single-Letterization of Rate-Cost Tradeoffs in Static Time-Invariant Control (STIC) Systems

cs.IT math.OC ·2026-10-16 ·Eray Unsal Atay, Venkat Chandrasekaran, Victoria Kostina
similarity 0.54
Abstract · 38 pages, 9 figures

In settings such as online recommendation platforms, medical decision-making with interim summaries, and stochastic control with static plants, the underlying system is often static so that the next state depends only on the most recent action. Moreover, the true system state is high-dimensional and cannot be observed directly, so actions must be selected based on information received through a rate-limited communication link, which constrains the control performance. This leads to a fundamental rate-cost tradeoff$\unicode{x2014}$the minimum communication rate required to achieve a prescribed average control cost. We study this tradeoff for a class of static systems we term static time-invariant control (STIC) systems, namely, control systems in which the next state depends on the history only through the most recent control action via a time-invariant kernel. For general control systems$\unicode{x2014}$not necessarily static or time-invariant$\unicode{x2014}$our prior work characterized this tradeoff through the limit of a sequence of directed-information minimization problems. However, the dimension of these problems grows with the time horizon, making the limiting formulation computationally intractable. In the present paper, we show for STIC systems that this growing-size formulation admits a single-letter characterization. This identifies STIC systems as the control-side counterpart of Noisy Output is the STate (NOST) channels$\unicode{x2014}$one of the few channel models whose feedback capacity admits a single-letter characterization. This yields, to our knowledge, the first constant-size convex characterization of the rate$\unicode{x2013}$cost tradeoff beyond linear quadratic Gaussian (LQG) control.

0.30

Sparse Stabilization of Continuous-Time Linear Dynamical Systems

eess.SY ·2026-11-15 ·Kondapi V. S. Krishna Praveen, Chandra R. Murthy
theory similarity 0.54
Abstract · 15 pages, 9 figures, 3 tables

Efficient use of communication resources is crucial for stabilizing a networked control system. Employing \emph{sparse inputs} and event-triggered control are efficient ways to utilize communication resources in networked control systems. This work considers the problem of stabilizing a continuous-time linear dynamical system (LDS) using $s$-sparse inputs. For this purpose, we consider \emph{switched} linear feedback control, where we construct a finite number of feedback matrices with at most $s$ nonzero rows. Using switched systems theory, we show that there exists an $s$-sparse input for any sparsity level $s \geq 1$ that ensures stability when the continuous-time LDS is stabilizable. In addition, using our approach, we can compute the required feedback matrices with minimal overhead even if the sparsity budget $s$ varies over time. We also minimize the maximum Frobenius norm of the feedback matrices, yielding sparse inputs with reduced control energy. We show that an upper bound on the control energy required for stabilization using an $s$-sparse input is inversely proportional to $s^2$, while maintaining the same exponential stability rate. Finally, we combine the design of the \emph{sparse inputs} with the event-trigger rule to further reduce communication resource consumption. Our sparse and event-triggered control strategy ensures that any stabilizable continuous-time LDS can be stabilized using $s$-sparse inputs under both state feedback and output feedback, for any $s\geq 1$. We illustrate our theoretical results for the task of stabilizing a mass-spring system.

0.26

Online Constrained Control of Storage Systems via Simplex Disturbance-Action Policies

eess.SY ·2026-09-07 ·Kamiar Asgari, Michael J. Neely
theory similarity 0.54
Abstract

We study online control of a scalar storage system with nonnegative adversarial resource arrivals and state-dependent action constraints. The adversarial, time-varying cost depends on both state and action. At each time, the controller selects a feasible action before the current resource arrival and cost are revealed. To handle the coupling between feasibility and online learning, we introduce Simplex Disturbance-Action Control (SDAC), whose policies have $H$ nonnegative parameters summing to at most one. Every fixed SDAC policy is feasible by construction. Our online SDAC controller updates these parameters using entropic online mirror descent while preserving feasibility along the time-varying trajectory. We prove a regret bound of $O\!\left(\sqrt{T\log(H+1)}\right)$ relative to the best fixed SDAC policy and a minimax lower bound showing that the dependence on $T$ is tight. We also introduce infinite-memory SDAC policies, which include every feasible fixed-fraction policy. SDAC policies approximate this class with an error that decreases geometrically with $H$. For a suitable choice $H=Θ(\log T)$, the resulting regret against infinite-memory SDAC policies is $O\!\left(\sqrt{T\log\log T}\right)$. The framework applies to energy-harvesting batteries and other storage-constrained resource systems.

0.48

Spatiotemporal Response Decay for Near-Optimal Distributed LQR via System Level Synthesis

eess.SY math.OC ·2026-10-08 ·Chenchen Zhou, José Matias
theorycode/data similarity 0.53
Abstract · 31 pages, 8 figures. Code and data: https://github.com/Daakuang/spacetime-sls

Distributed control requires choosing how far information travels and how long it is retained. For networked linear quadratic regulation (LQR), we use System Level Synthesis to bound these resources for a specified performance loss per node relative to centralized control. For locally coupled systems under uniform regularity assumptions, including stabilizability and detectability, we prove that the centralized optimal state and input responses to disturbance impulses satisfy exponential decay bounds in both time and spatial distance. On networks with polynomial neighborhood growth, sufficient communication ranges and memory horizons grow logarithmically with the inverse tolerance, independently of network size. Truncating these responses gives local finite-memory filters with stability and performance guarantees under a computable small-gain condition. Under an additional uniform local feedback condition, we also obtain controllers that confine nominal disturbance effects in space and eliminate them in finite time. Numerical experiments illustrate how performance and disturbance containment requirements guide architecture selection.

0.39