CS Paper Radar

Single-Letterization of Rate-Cost Tradeoffs in Static Time-Invariant Control (STIC) Systems

Eray Unsal Atay, Venkat Chandrasekaran, Victoria Kostina

cs.IT math.OC ·submitted 2026-10-16 01:01 UTC · v1

Abstract

In settings such as online recommendation platforms, medical decision-making with interim summaries, and stochastic control with static plants, the underlying system is often static so that the next state depends only on the most recent action. Moreover, the true system state is high-dimensional and cannot be observed directly, so actions must be selected based on information received through a rate-limited communication link, which constrains the control performance. This leads to a fundamental rate-cost tradeoff$\unicode{x2014}$the minimum communication rate required to achieve a prescribed average control cost. We study this tradeoff for a class of static systems we term static time-invariant control (STIC) systems, namely, control systems in which the next state depends on the history only through the most recent control action via a time-invariant kernel. For general control systems$\unicode{x2014}$not necessarily static or time-invariant$\unicode{x2014}$our prior work characterized this tradeoff through the limit of a sequence of directed-information minimization problems. However, the dimension of these problems grows with the time horizon, making the limiting formulation computationally intractable. In the present paper, we show for STIC systems that this growing-size formulation admits a single-letter characterization. This identifies STIC systems as the control-side counterpart of Noisy Output is the STate (NOST) channels$\unicode{x2014}$one of the few channel models whose feedback capacity admits a single-letter characterization. This yields, to our knowledge, the first constant-size convex characterization of the rate$\unicode{x2013}$cost tradeoff beyond linear quadratic Gaussian (LQG) control.

Comment
38 pages, 9 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Sparse Stabilization of Continuous-Time Linear Dynamical Systems

eess.SY ·2026-11-15 ·Kondapi V. S. Krishna Praveen, Chandra R. Murthy
theory similarity 0.60
Abstract · 15 pages, 9 figures, 3 tables

Efficient use of communication resources is crucial for stabilizing a networked control system. Employing \emph{sparse inputs} and event-triggered control are efficient ways to utilize communication resources in networked control systems. This work considers the problem of stabilizing a continuous-time linear dynamical system (LDS) using $s$-sparse inputs. For this purpose, we consider \emph{switched} linear feedback control, where we construct a finite number of feedback matrices with at most $s$ nonzero rows. Using switched systems theory, we show that there exists an $s$-sparse input for any sparsity level $s \geq 1$ that ensures stability when the continuous-time LDS is stabilizable. In addition, using our approach, we can compute the required feedback matrices with minimal overhead even if the sparsity budget $s$ varies over time. We also minimize the maximum Frobenius norm of the feedback matrices, yielding sparse inputs with reduced control energy. We show that an upper bound on the control energy required for stabilization using an $s$-sparse input is inversely proportional to $s^2$, while maintaining the same exponential stability rate. Finally, we combine the design of the \emph{sparse inputs} with the event-trigger rule to further reduce communication resource consumption. Our sparse and event-triggered control strategy ensures that any stabilizable continuous-time LDS can be stabilized using $s$-sparse inputs under both state feedback and output feedback, for any $s\geq 1$. We illustrate our theoretical results for the task of stabilizing a mass-spring system.

0.33

Minimum-Energy Control for Stochastic Linear Systems

eess.SY math.OC ·2026-10-09 ·Vaishnavi Sharma, Vaibhav Katewa
theory similarity 0.56
Abstract

The open-loop minimum-energy control (MEC) problem asks for control inputs that minimize the control energy while ensuring the terminal state reaches a desired value. In this paper, we study the open-loop MEC problem for stochastic linear time-invariant systems. We consider a variety of stochastic constraints that enforce the terminal error to be \emph{small}, and show that Stochastic MEC (SMEC) problem can be formulated as a QCQP. We obtain the optimal solution for SMEC and show that it generalizes the well-known Deterministic MEC problem by introducing novel stochastic variants of controllability and Gramian matrices. Finally, we show that there exists a fundamental lower bound on the optimal control energy which cannot be overcome by increasing the time horizon of the problem.

0.44

Optimal Regret for Online Storage Control via Cumulative Policies

eess.SY math.OC ·2026-09-18 ·Kamiar Asgari, Michael J. Neely
theory similarity 0.55
Abstract

We study online control of a scalar storage system with adversarial nonnegative arrivals, known retention coefficient, and convex costs depending on both state and action. Each action must respect current resource availability and is chosen before the current arrival and cost function are revealed. For the existing simplex disturbance-action policy class, we give an exact reparameterization by cumulative allocation fractions and a decay-weighted projected subgradient update. The resulting regret bound is independent of policy memory length. For fixed retention coefficient and cost constants, the controller achieves $O(\sqrt T)$ regret against the best fixed infinite-memory policy in this class, using $O(\log T)$ memory and arithmetic operations per round and one cost-subgradient query. A storage-specific block construction gives a matching lower bound against every causal feasible controller, including randomized controllers. Writing $τ=(1-α)^{-1}$, the minimax expected regret is $Θ(\sqrt T\min\{T,τ\}^{3/2})$ for every finite-memory simplex policy class and its infinite-memory extension, when $α\in[1/2,1)$, $T\ge4$, and the positive cost constants are fixed. This identifies the joint horizon and retention-time dependence for these policy benchmarks.

0.10

Online Constrained Control of Storage Systems via Simplex Disturbance-Action Policies

eess.SY ·2026-09-07 ·Kamiar Asgari, Michael J. Neely
theory similarity 0.54
Abstract

We study online control of a scalar storage system with nonnegative adversarial resource arrivals and state-dependent action constraints. The adversarial, time-varying cost depends on both state and action. At each time, the controller selects a feasible action before the current resource arrival and cost are revealed. To handle the coupling between feasibility and online learning, we introduce Simplex Disturbance-Action Control (SDAC), whose policies have $H$ nonnegative parameters summing to at most one. Every fixed SDAC policy is feasible by construction. Our online SDAC controller updates these parameters using entropic online mirror descent while preserving feasibility along the time-varying trajectory. We prove a regret bound of $O\!\left(\sqrt{T\log(H+1)}\right)$ relative to the best fixed SDAC policy and a minimax lower bound showing that the dependence on $T$ is tight. We also introduce infinite-memory SDAC policies, which include every feasible fixed-fraction policy. SDAC policies approximate this class with an error that decreases geometrically with $H$. For a suitable choice $H=Θ(\log T)$, the resulting regret against infinite-memory SDAC policies is $O\!\left(\sqrt{T\log\log T}\right)$. The framework applies to energy-harvesting batteries and other storage-constrained resource systems.

0.49

Joint Communication-Control Strategy Optimization with Partially Nested Information Structures: The Linear-Quadratic Case

eess.SY cs.MAmath.OC ·2026-08-13 ·Haoyi You, Kaiqing Zhang
published similarity 0.54
Abstract · Preliminary version accepted to IEEE CDC 2026

In this paper, we formalize a joint communication-control strategy optimization (JCCO) problem in multi-agent linear systems with quadratic costs, under the common-information-based (CIB) framework from decentralized stochastic control. For computational tractability, we focus on such JCCO problems with partially nested (PN) information structures (ISs). In particular, with a baseline communication protocol that leads to a PN IS, we establish a series of conditions under which the partial nestedness is preserved under the (additional) communication strategies to be optimized, while violating them may cause nonlinearity of the optimal strategies in general, with open-loop communication strategies. We then develop a dynamic-programming-based approach to compute the optimal control strategies of JCCO with open-loop communication strategies, which yields a set of closed-form Riccati Equations. As a byproduct of independent interest, such an approach also offers a way to solve decentralized linear-quadratic control with PN ISs and output feedback, under the CIB framework. Finally, we extend such an approach to JCCOs with closed-loop communication strategies, yielding a more tractable dynamic program than an infinite-dimensional CIB-belief-based one.

0.19

Fundamental Tradeoffs in Sampling, Transmission and Information Freshness: Instantaneous Feedback

cs.IT cs.NIeess.SY ·2026-11-16 ·Subhankar Banerjee, Sennur Ulukus
theory similarity 0.54
Abstract

We study a time-slotted generate-at-will status-update system over an erasure channel with transmission success probability $q$, subject to average sampling- and transmission-rate constraints $f_s$ and $f_r$, respectively. The sampler-transmitter pair jointly decides whether to idle, retransmit a stale packet, or replace it with a fresh sample. We derive a universal lower bound on the optimal average age of information, analyze a class of stationary randomized policies, and obtain an optimal policy within this class that provides a $4$-approximation guarantee. The joint problem reduces to the sampling-constrained problem when $f_s\leq qf_r$ and the transmission-constrained problem when $f_s\geq f_r$. For $qf_r<f_s<f_r$, we formulate a constrained Markov decision process (CMDP) and introduce the class $\barΠ$ of $(W,R)$ policies, where $W$ specifies a waiting threshold for transmission and $R$ specifies a packet-replacement threshold. We prove that, for every choice of Lagrange multipliers, the corresponding Lagrangian-relaxed Markov decision process admits an optimal policy in $\barΠ$. We then formulate a linear program (LP) over distributions of $(W,R)$ policies and prove that choosing a policy according to an optimal LP solution yields an optimal CMDP policy. Moreover, there exists an optimal LP solution assigning positive probability to at most three $(W,R)$ policies. Since $\barΠ$ is countably infinite, for every $ε>0$ we construct a finite subset $\barΠ_ε\subset\barΠ$ and show that the LP restricted to this set yields an $ε$-optimal policy. Finally, we derive a stronger pair of lower bounds by considering systems with only the sampling-rate or transmission-rate constraint. Using these bounds, we construct a policy randomizing among four $(W,R)$ policies with a $2$-approximation guarantee for $qf_r<f_s<f_r$.

0.11

On the Optimality of Implicit Feedback in Markov Decision Processes over Imperfect Links

eess.SY ·2026-11-04 ·Romain Planchon, Federico Chiariotti, Federico Mason, Andrea Zanella, Deniz Gunduz
hot direction similarity 0.54
Abstract · Submitted to IEEE INFOCOM 2027

Goal-oriented communication protocols are explicitly designed to support the objectives of target applications, such as the monitoring and control of remote processes, while minimizing data traffic. This study considers a transmitter node that observes the environment state and sends it to a remote agent, which then performs control actions. This problem can be modeled as a remote Partially Observable Markov Decision Process (POMDP), a subclass of decentralized POMDPs. Existing studies limit transmissions through communication costs, but neglect the effect of channel impairments and non-ideal or delayed feedback. In this work, we study the optimal joint transmission and control policies over lossy forward channels without explicit acknowledgments. We introduce \emph{revealing} policies, under which the receiver's action, observed directly by the transmitter, discloses the outcome of the forward transmission, keeping the two agents synchronized without a feedback channel. We derive sufficient conditions for the optimality of time-invariant policies in this implicit feedback regime for general POMDPs, along with strictly weaker sufficient conditions in the special case of contextual bandits. Our simulations over a family of remote POMDPs show that these conditions are conservative, and revealing policies are optimal over a substantially wider parameter range than the conditions warrant.

0.34

Sparse One-Step-Ahead Optimal Control of Time-Varying Affine Opinion Networks: Tracking and Competitive Games

eess.SY cs.GT ·2026-09-17 ·Gabriel Gentil, Amit Bhaya
similarity 0.54
Abstract · 18 pages, 8 figures, 9 tables, under review by European Journal of Control

This paper studies resource-limited external influence in time-varying opinion networks when a controller must choose both a small set of agents and a scalar intervention at each update. We use the affine free response, which includes DeGroot and Friedkin--Johnsen dynamics, followed by a direct sparse action. Eliminating the scalar action reduces the one-step problem to a cardinality-constrained support objective whose global optimum is obtained from the largest or smallest residual components. Hence exact sparse one-step-ahead optimal control requires one sort and \(O(|\mathcal T|\log|\mathcal T|)\) operations, where \(\mathcal T\) is the support set. For periodic affine dynamics, the resulting state-dependent low-rank feedback admits cycle-based ultimate bounds and exact tracking of model-invariant targets. The DeGroot and Friedkin--Johnsen specializations expose the role of target invariance and the affine mismatch term. With several competing external players, each sparse best response retains the same sorting structure and the complete binary--continuous stage game is an exact potential game, so a pure-strategy equilibrium exists at every frozen state. Same-state welfare benchmarks separate loss due to scalar competition from the additional loss due to strategic support selection. Numerical examples validate exact support selection and illustrate switching-order effects, DeGroot/Friedkin--Johnsen tracking, resource tradeoffs, and competitive implementations.

0.35