CS Paper Radar

Entropy-Regularized Optimal Transport for Time-Varying Multi-Agent Coverage Control

Italo Napolitano, Mario di Bernardo

eess.SY math.OC ·submitted 2026-09-09 07:35 UTC · v1
unusual

Abstract

This paper addresses time-varying coverage control for multi-agent systems, formulated as the tracking of an evolving target density via entropy-regularized semi-discrete optimal transport. Unlike the hard Laguerre partition of the unregularized formulation, entropic regularization assigns fractions of the mass at each point to all agents, simplifying the design and numerical implementation of the control law. We derive a feedback-feedforward controller that tracks the evolving first-order optimality conditions with exponential convergence, and we investigate the role of the regularization parameter, which, above a critical threshold, renders the fully collapsed configuration locally optimal. Numerical experiments validate the theory: for moderate regularization, the proposed approach has performance comparable to the unregularized formulation and outperforms the corresponding Voronoi-based coverage baseline.

Closest papers

Nearest neighbours by meaning across the whole index.

Time-Varying Coverage via Diffeomorphic Coverage Control

eess.SY ·2026-11-16 ·Joshua Keene, Chris Manzie, Airlie Chapman, Peter M. Dower
published similarity 0.63
Abstract · 8 pages, 5 figures, accepted into Conference on Decision and Control 2026

This paper addresses a structured class of time-varying coverage control in which region-density evolution is parameterised by a time-varying diffeomorphism acting on a static region-density pair. We refer to this setting as diffeomorphic coverage control. Such trajectories arise naturally in mass-conserving transport flows and in density-driven formation control. We propose decentralised diffeomorphic coverage controllers for both continuous- and discrete-time dynamics that achieve time-varying coverage by solving a related time-invariant coverage problem in a nominal domain. The resulting controllers are asymptotically stable with respect to a variant of a popular coverage metric under corresponding time-varying regions and densities. Further analysis shows that diffeomorphic coverage corresponds to a time-varying non-uniform coverage problem over a non-Euclidean metric. Simulations demonstrate effectiveness of the proposed control strategy under affine diffeomorphisms in a formation control task, achieving performance comparable to a popular centralised coverage control law. Coverage performance is also demonstrated under non-affine diffeomorphisms.

0.39

Nonlinear Density-Driven Optimal Control (D2OC) for Multi-Agent Spatial Coverage via Sequential Convex Programming

cs.MA cs.ROeess.SYmath.OC ·2026-10-03 ·Julian Martinez, Kooktae Lee
similarity 0.56
Abstract

This paper presents a nonlinear extension of Density-Driven Optimal Control (D2OC) for multi-agent spatial coverage with prescribed density distributions. Rather than assigning individual target locations, D2OC drives the collective spatial distribution of agents toward a desired density through a Wasserstein-based objective. We extend this framework to multi-step finite-horizon control for discrete-time control-affine nonlinear systems using sequential convex programming. At each control update, the nonlinear dynamics are locally linearized over the prediction horizon, yielding a strictly convex quadratic program that preserves the Wasserstein barycentric structure while directly incorporating input constraints. We further characterize the effect of constrained control deviations and nonlinear Taylor remainders on the accuracy of the local linear prediction, establishing an explicit finite-horizon error bound and a two-step specialization for receding-horizon implementation. The resulting method retains the decentralized, distribution-driven nature of D2OC while providing a computationally efficient optimization procedure for nonlinear multi-agent systems. Simulations with unicycle and quadrotor teams show coverage performance comparable to nonlinear model predictive control, while substantially reducing computation time. These results demonstrate a tractable and theoretically characterized framework for density-driven spatial coverage under nonlinear dynamics.

0.21

Distributed area coverage path planning subject to the inclusion of a headland path

cs.RO ·2026-10-11 ·Mogens Plessen
similarity 0.55
Abstract · 9 pages, 8 figures

A deterministic method for the problem of distributed area coverage path planning subject to the inclusion of a headland path is presented. Given a, in general, non-convex area to be covered that may, in general, include obstacle areas, multiple robots, at least one robot depot, and constraints on each machinery such as a working width, work capacity limits, travel capacity limits, nonholonomic dynamical constraints and, possibly, a robot start and end depot assignment, distributed paths for each machinery are calculated that collectively enable full area coverage. Variations are discussed, in particular, a scenario where unconstrained depots assignment can attain a global optimal solution to the problem. The importance of inclusion of a headland path for area coverage, as well as the benefits in comparison to an alternative Boustrophedon-pattern based approach are highlighted.

0.41

Pareto-Optimal Entropy-Regularized Trajectory Optimization

cs.RO eess.SY ·2026-10-06 ·Dimitrios S. Georgiou, Augustinos D. Saravanos, Evangelos A. Theodorou
similarity 0.52
Abstract · 9 pages, 3 figures

Trajectory optimization (TO) under nonlinear dynamics, actuation limits and collision avoidance constraints is a fundamental problem in robotics, albeit especially challenging due to its highly non-convex nature. For this setting, Differential Dynamic Programming (DDP) is an efficient second-order shooting method, yet its local structure renders it vulnerable to suboptimal basins. Sampling-augmented variants mitigate this susceptibility through stochastic exploration, but often sample only around the few trajectories they retain for reoptimization, based solely on their cost which restricts exploration breadth. We introduce Pareto-Optimal Entropy-Regularized DDP (PER-DDP), an entropy-regularized population framework derived from the free-energy/relative-entropy inequality. Our method combines prior-guided sampling that shapes exploration around each retained trajectory, with expanded rollout evaluations that probe these sampling policies beyond the few retained candidates, and Pareto filtering for preserving task-constraint alternatives across iterations. This decouples sampling effort from the optimization population size and broadens exploration without sacrificing the second-order structure that makes DDP effective. Across multiple systems and hundreds of environments, PER-DDP achieves higher success rates than state-of-the-art sampling-augmented TO methods and finds reliable solutions in environments beyond the reach of all baselines.

0.31

Fast and Scalable Multi-Agent Distribution Matching via Partitioned Optimal Transport

cs.MA cs.ROeess.SYmath.OC ·2026-09-30 ·Kooktae Lee, Ruchika Singh
theory similarity 0.51
Abstract

This paper presents a scalable optimal-transport-based framework for terminal distribution matching in multi-agent systems. While optimal transport provides a natural way to measure distributional mismatch and assign agents to a desired spatial distribution, global discrete transport can become computationally expensive for large-scale systems. We address this bottleneck by partitioning agents and target samples into spatially corresponding blocks and solving smaller local transport problems. Under a mass-balance condition, the resulting restricted coupling remains feasible for the global problem and provides an upper bound on the Wasserstein cost. The local assignments generate target locations for finite-horizon agent control, applicable to both linear and nonlinear dynamics. By alternating local assignment and control, we establish a cycle-to-cycle descent guarantee for the resulting transport surrogate. The proposed framework therefore enables scalable terminal distribution matching while retaining a rigorous connection to the Wasserstein objective. The technical soundness of the proposed results is validated through simulations.

0.27

Last-Iterate Convergence for Constrained MDPs: From Dual Descent to Primal-Dual

cs.LG ·2026-10-29 ·Michael Lu, Max Qiushi Lin, Mo Chen, Sharan Vaswani
theory similarity 0.50
Abstract

We study policy optimization for infinite-horizon, discounted constrained Markov decision processes. While primal-dual ($\texttt{PD}$) methods are widely used in practice, their theoretical guarantees typically hold for an impractical mixture policy. In contrast, dual descent ($\texttt{DD}$) methods output a single policy ("last iterate") with guarantees on its performance. However, such methods require iteratively solving entropy-regularized MDPs in an inner-loop, limiting their practical effectiveness. Moreover, existing analyses rely on strong coverage assumptions that are difficult to satisfy in practice. Consequently, we first provide a new analysis of $\texttt{DD}$ methods that does not require coverage assumptions. We then employ entropy-regularized natural policy gradient and dual regularization to eliminate the inner loop, resulting in an efficient $\texttt{PD}$ algorithm. We develop a novel tracking analysis which shows that, compared to existing methods, the proposed algorithm achieves improved last-iterate convergence guarantees. Furthermore, our theoretical framework allows us to analyze a truncated bilevel method that interpolates between $\texttt{DD}$ and $\texttt{PD}$ methods. Finally, we generalize our analysis to handle linear function approximation. Compared to prior last-iterate methods, we prove stronger guarantees under less restrictive assumptions.

0.14

Constrained minmax density transportation for linear parabolic PDEs: a numerical optimal control perspective

eess.SY math.OC ·2026-08-19 ·Siddhartha Ganguly, Vaibhav Upadhyay, Kenji Kashima, Debasish Chatterjee
similarity 0.49
Abstract · Revised version of a journal submission; 15 pages (2-col)

This article introduces a numerical optimal control framework for minmax constrained density control for a class of noisy linear parabolic partial differential equations (PDEs), in particular the noisy heat equation. The goal is to transport an initial density to a target density while minimizing a specified cost with respect to control actions and maximizing it with respect to disturbances, all within a fixed time horizon while satisfying given convex path constraints. To address this, the spatial derivatives in the PDE are discretized using finite-difference approximations, transforming the problem into a system of ordinary differential equations in time. The admissible space of control and disturbance trajectories is then finitely parametrized, and the resulting optimal control problem is formulated as a convex semi-infinite program (SIP) under mild assumptions. By leveraging new numerical tools from convex SIP theory, we establish guarantees for exact solutions that account for constraint satisfaction under an infinite family of disturbance realizations, and we establish an optimization-based computationally efficient algorithm to recover these solutions. Comprehensive numerical examples to demonstrate and validate our findings are included.

0.18

Multiscale distributed MPC for Optimal Transport

eess.SY ·2026-10-14 ·Guillem Pascual, Yu-Jen Huang, Sonia Martínez
similarity 0.49
Abstract · 9 Pages, 1 Figure, Submitted to American Control Conference 2027, under review

In this paper, we present a novel multiscale formulation for the Optimal Transport (OT) of large swarms. The scheme is divided in two levels, a top-level OT formulation with a terminal penalty cost to handle time-varying densities, and a low-level, Model Predictive Controller (MPC) that allows agents to track the nominal velocity under control affine dynamics and rejects external disturbances. We show that the terminal-penalty dynamic formulation reduces to a regularized static dual, which agents solve in a distributed way to compute the nominal velocity.We also prove distributional input-to-state stability in the $1$-Wasserstein metric of the density flow with respect to the mismatch that the low-level and the target motion introduce, so that the tracking error only perturbs the macroscopic flow by a bounded, quantifiable amount. Finally, we demonstrate via simulations the effectiveness of the proposed method handling time-varying targets and state perturbations.

0.25