CS Paper Radar

Convex Pursuit-Evasion Games for Spacecraft Proximity Operations on Circular and Elliptical Orbits

Omer Burak Iskender

eess.SY math.OCastro-ph.IMmath.DS ·submitted 2026-09-13 06:55 UTC · v1
published

Abstract

Inspecting or servicing a non-cooperative spacecraft is a two-player game: the target can thrust to defeat the inspector's plan. Hamilton-Jacobi-Isaacs reachability answers such games exactly but its cost grows exponentially with state dimension, while learning-based controllers scale yet certify nothing. Convex formulations are the usual escape, typically cast as convex-concave saddle-point problems. That framing fails in the terminal-distance orbital game: with effort regularization, the payoff is convex in both controls, so no pure open-loop saddle point need exist. In its place we derive two exact one-sided guarantees read from the players' terminal reachable sets via support functions: an escape certificate proving the target can hold a guaranteed standoff, and a security strategy bounding the miss distance the inspector can force. Together they bracket the engagement without assuming player rationality, and over two hundred perturbed trials the escape certificate separated capture from escape without error. A projected extragradient method supplies a strategy pair in about 25 ms, certified in place by best-response gaps. The construction carries unchanged to elliptical reference orbits via Yamanaka-Ankersen dynamics, where the orbital phase moves miss distance by nearly a factor of two, reproduced by nonlinear Keplerian propagation. Under receding-horizon play the inspector captures in half of ten representative engagements. Angles-only navigation error, keep-out zones, multiple pursuers, and closed-loop play are treated as extensions.

Comment
38 pages, 10 figures, 19 tables (9 in appendices); accepted at Aerospace Science and Technology, 11 September 2026; ID: AESCTE-D-26-03480R1

Closest papers

Nearest neighbours by meaning across the whole index.

Where Planning Changes the Outcome of Orbital Games

cs.MA cs.AIcs.ROeess.SY ·2026-10-16 ·Duncan Eddy, Mahdi Al-Husseini, Mykel J. Kochenderfer
similarity 0.70
Abstract · IEEE Aerospace Conference 2027

This paper introduces OrbitalGym, a simulation environment for studying when planning algorithms or system design determine the outcome of adversarial orbital encounters. In an orbital game, two non-cooperative teams of satellites maneuver during rendezvous and proximity operations to win a differential-reward objective. Advances in terrestrial game playing have prompted many methods for orbital games, but studies typically evaluate one method in one scenario, often against a passive or random defender. It is unclear whether better planning matters once vehicle capability (maneuverability, sensing, communications) and adversarial responses are considered. OrbitalGym is a JAX-based environment supporting varying numbers of agents, state representations (position, velocity, attitude, fuel), explicit or implicit communication, and proximity or conical field-of-view sensors. It compiles games to batched GPU code, enabling large-scale parallel simulation of policies across many configurations. This identifies regimes where policy choice affects outcomes and regimes where system capability dominates. We study two close-range games: pursuit-evasion, where one spacecraft tries to capture another, and lady-bandit-guard, where a guard prevents an attacker from reaching a protected asset. We compare PD, LQR, model predictive path integral control, and Monte Carlo tree search over ratios of thrust and propellant, initial separation, game duration, sensor capability, and the definition of capture. In pursuit-evasion the propellant ratio decides most encounters: against five of six evader policies, pursuer policy changes capture probability by 10 percent or more in at most 15 of 90 capability configurations. In lady-bandit-guard, policy matters more: against bandits able to reach the asset, a better guard policy raises defense probability by at least 10 percent in 56 to 74 of 90 configurations.

0.15

Robust Game-theoretic Motion Planning over Extended Time Horizons

cs.MA eess.SY ·2026-09-26 ·Bennet Outland, Vishala Arya
similarity 0.66
Abstract

This work presents a solution to nonconvex, game-theoretic motion planning problems subject to disturbances over long time horizons. The problem is posed as a partially-decoupled generalized Nash equilibrium problem, in which each agent's dynamics depend only on its own state and control, admitting fast solution methods for competitive multi-agent motion planning. An algorithm, WOLF, is developed that applies receding-horizon model predictive control to an open-loop differential games solver based on sequential convexification. In contrast to robust formulations that fix the uncertainty description offline, the robustness tube here is itself a dynamic state, co-optimized with the trajectory, and its thickness directly sets the tightening of the shared coupling constraints. A sufficient condition is derived under which a nominal trajectory satisfying constraints tightened against all agents' error bounds remains feasible for every admissible disturbance realization. The method is demonstrated on two adversarial on-orbit games with coupled translational-attitude dynamics: a stealthy co-orbital jamming game under an active detection-probability bound, and a sun-blocking game in which an adversary disables an evader by decreasing solar power

0.25

Certifiable Explicit Model Predictive Control for Spacecraft Rendezvous under Bounded Disturbances

eess.SY ·2026-08-23 ·Diogo Silva, Daniel Silvestre
similarity 0.62
Abstract · 12 pages, 5 figures, 2 tables. Submitted to IEEE Transactions on Control Systems Technology

Two properties of optimization-based controllers such as model predictive control (MPC) limit their use in space flight. The online computing time varies and can exceed the sampling period, and the closed-loop behavior carries no formal guarantee. Explicit MPC, where a parametric solution of the optimization problem is computed, replaces the on-board optimization with a lookup table of piecewise-affine functions with a fixed execution time. However, it has been regarded as only applicable to small horizons, since the number of regions bounds the memory the table occupies and admits only an exponential bound in the horizon. This paper builds on recent developments in parametric solutions of quadratic programs and nonconvex reachability analysis to provide an entire pipeline for spacecraft rendezvous controllers under the Clohessy-Wiltshire dynamics. For this application, efficient data structures can be constructed to encode the control law, both from a computing time and a memory standpoint. In addition, the controller can be verified offline with a guaranteed closed-loop stability certificate by resorting to reachability analysis with hybrid zonotopes. At a 51-step horizon the rendezvous law occupies 10.5 MB and is evaluated in under 300 ns. The occupied memory would fit for instance the CubeSat flight computer ARM9-class AT91RM9200 meaning that the horizon limitation does not hold when the partition is built with the parametric solvers and data structures shown in this paper.

0.16

Two-impulse Rendezvous Planning about Thrusting Spacecraft on SE2(3)

eess.SY ·2026-09-23 ·Micah Condie, Abigaile Woodbury, James Goppert
hot direction similarity 0.61
Abstract

The classical Hill--Clohessy--Wiltshire equations assume an unforced Keplerian reference trajectory, an assumption that is violated by missions requiring continuous thrust. We formulate spacecraft relative motion on the $\mathrm{SE}_2(3)$ Lie group, which encodes position, velocity, and attitude in a single geometric state, linearize the gravity and body-frame control mismatches between the two vehicles, and derive analytic bounds on every neglected term. Under circular coasting Keplerian assumptions the framework recovers the Hill--Clohessy--Wiltshire equations exactly. For thrusting references the state transition matrix acquires thrust-induced attitude--translation coupling blocks that, when the two vehicles share body-frame inputs, are exact in log coordinates and independent of the attitude error, and a mismatch between the vehicles' inputs re-centers the linearization at their mean. A two-impulse rendezvous planner follows directly. A scalar coupling ratio, computable before planning, separates two regimes. Where it exceeds unity, the planner reduces the terminal error of coupling-blind planners by more than an order of magnitude, and somewhat above unity it is also more accurate than a Cartesian planner of the same computational structure; well below unity, simpler planners are adequate or better. Simulations confirm the recovery to machine precision and validate every bound along the transfer.

0.33

Horizon-Dependent Tube MPC for Elliptical-Orbit Rendezvous Under Mass Uncertainty

eess.SY astro-ph.IMphysics.space-ph ·2026-08-27 ·Omer Burak Iskender, Keck-Voon Ling
publishedbenchmark similarity 0.61
Abstract · 19 pages, 12 figures, 8 tables. Accepted for presentation at the 77th International Astronautical Congress (IAC 2026), Antalya, Turkiye, 5-9…

A spacecraft closing on a target from three hundred kilometres to contact flies one guidance law across five orders of magnitude of range, and a controller that is provably safe at close range can lose that guarantee completely at long range while continuing to fly as though nothing were wrong. This paper derives the range at which the guarantee lapses and uses it as a design rule. The bound compares the prediction model's own linearisation error against the disturbance set the controller was built to reject, and needs only the sampling period, the orbit and that disturbance bound, so it can be evaluated before any simulation. On a Mars Sample Return approach it disqualifies the homing phase, where most of the propellant is spent, and clears the other two. Re-posing the disqualified phase in relative orbital elements restores the guarantee; re-posing a phase the rule already clears, in a frame two orders of magnitude more accurate, changes propellant by under a tenth of one per cent, and it is that second prediction that makes the rule falsifiable rather than descriptive. The constraint tightening also ties the prediction horizon to feasibility, so the horizon search limit becomes a mission parameter rather than a solver setting. Against a reimplementation of a published benchmark that reproduces its propellant to within one per cent, over five hundred dispersed Monte Carlo transfers per case on matched seeds, the controller saves 29% of the propellant on a circular target orbit and 40% on an eccentric one, docking inside the 0.20 m capture requirement on essentially every draw at a median miss near 5 cm. Two results run the other way: the saving is bought with time of flight and computation, and it comes from what the guarantee demanded of the terminal condition rather than from better disturbance rejection. Recursive feasibility and asymptotic stability are not claimed.

0.61

Reachability-Informed Reinforcement Learning for Multi-Impulse Interplanetary Transfers

cs.LG math.OCeess.SY ·2026-10-01 ·Yashdeep Chaudhary, Roberto Armellin, Harry Holt
benchmark similarity 0.60
Abstract · Preprint. 23 pages, 10 figures

Reinforcement learning offers the prospect of a reusable sequential decision-making mechanism for spacecraft trajectory design, motivating policy interfaces that connect learned decisions to the underlying maneuver geometry. This paper develops Reachability Analysis-Informed Reinforcement Learning (RARL) for deterministic multi-impulse interplanetary transfers, placing intermediate waypoint selection at the center of the learned decision process. Local first-order reachability maps bounded velocity perturbations into an ellipsoidal set of next-node positions, within which the policy selects its waypoint. Lambert reconstruction then determines the corresponding maneuver to reach this selected waypoint along a dynamically consistent ballistic arc, coupling learned transfer-geometry selection with classical astrodynamics. A terminal two-impulse reconstruction completes the rendezvous, supported by a linear maneuver-demand assessment used for reward shaping. Numerical studies characterize this interface on a two-body Earth-Mars benchmark. Across three independent training runs, RARL achieves a mean maneuver cost of 10.23 km/s, 1.72% above a validated local sequential convex programming reference. Training over dispersed initial states extends policy reuse across a departure family with fixed target state and transfer duration. Each of the three independently trained multi-state policies completes all 10,000 held-out Monte Carlo departures without impulse-cap violations, compared with a mean feasibility rate of 6.49% for single-state policies. This broader sampled feasibility is accompanied by a 0.61% increase in mean nominal maneuver cost, without further training across departures. These results demonstrate that a reachability-informed decision interface supports benchmark-quality trajectory construction and policy reuse across dispersed departure conditions.

0.29

Minimum-Time Escape from the Conic Field of View of a Reeds-Shepp Pursuer: Classification and Game Value for a Slower or Equally Fast Evader

cs.RO math.OC ·2026-10-20 ·Ubaldo Ruiz
theory similarity 0.60
Abstract · 30 pages, 5 figures, 2 tables

We study minimum-time escape of an omnidirectional evader from the forward conic field of view of a Reeds-Shepp pursuer with minimum turning radius $r$. For speed ratio $ν$ and cone half-angle $0<α<π/2$, we prove a global escape/holding classification: straight reversal holds the whole cone for $ν\le\sinα$, escape is confined to a barrier-bounded dart for $\sinα<ν\le1$, and escape is possible from every state for $ν>1$. For the slower or equally fast evader, $\sinα<ν\le1$, we construct the solution with Isaacs' characteristics and verify it in feedback form, using a Filippov pursuer relay and a one-sided evader branch. The finite escape time is the first root of one scalar equation, and the holding region is bounded by the nonusable parts of the rays and a barrier that closes with a convex corner on the front axis. Sample-and-hold counter-controls show that this escape time is the value of the game in nonanticipative strategies at every state except the corner. There the two strategy values differ: the pursuer's is infinite, whereas an evader that chooses which barrier branch to cross from the initial germ of the pursuer's control escapes before the barrier time $τ_I$, which is the evader's exact strategy value. An independent level-set solver, refined on fixed comparison points, agrees with the closed-form escape time and reproduces the holding region at the tested parameters.

0.41

Optimal Competitive Ratios for Chasing Convex Functions with Quadratic Growth

cs.LG ·2026-11-05 ·Linzhe He, Sifan Yang, Wei Jiang, Lijun Zhang
theory similarity 0.60
Abstract

Chasing convex function has attracted much attention in recent years, which can be formulated as a game between a learner and an adversary. In each round, the adversary reveals a convex function, and the learner selects a decision and incurs a hitting cost and a movement cost for changing its decision. The performance of the learner is measured by the \emph{competitive ratio}, which compares its cumulative cost with that of an optimal offline decision sequence. For Euclidean movement, existing upper and lower bounds for $κ$-well-conditioned functions exhibit a polynomial gap. For squared Euclidean movement, dimension-free competitive guarantees have been established under quadratic growth, but the optimal competitive ratio remains unclear. In this paper, we establish optimal dimension-free competitive ratios for convex function chasing under two types of movement costs. For Euclidean movement, we propose Clipped Proximal Descent (CPD), which combines a balanced proximal step with a clipped correction toward the current minimizer. CPD achieves an $O(κ^{1/3})$ competitive ratio for smooth convex functions satisfying quadratic growth, improving the previous $O(\sqrtκ)$ upper bound and matching the existing $Ω(κ^{1/3})$ lower bound. For squared Euclidean movement, we establish the exact optimal dimension-free competitive ratio for convex functions satisfying quadratic growth. Our result is based on a new tight competitive analysis of Regularized Online Balanced Descent (R-OBD) and a matching lower bound against randomized algorithms.

0.20