CS Paper Radar

Learning-Based Adaptive MPC for Magnetorquer-Only Satellite Attitude Control

Patrick Schwartz, Abhishek Cauligi

cs.RO ·submitted 2026-10-14 14:38 UTC · v1
published

Abstract

Nanosatellites (e.g., CubeSats) have the potential to carry out useful science and exploration activities for outer solar system exploration, but their small size leads to tradeoffs between attitude control and science capabilities. Magnetorquers offer a unique compromise as compact actuators that enable three-axis attitude control, but suffer from a loss of control authority and require full knowledge of the planetary magnetic field. In this work, we present a learning-based adaptive model predictive control (MPC) algorithm that plans rotational trajectories for the satellite while accounting for this loss of control authority. Key to our approach is the inclusion of a learned magnetic field model that is trained in simulation using low-fidelity magnetic field data. Using measurements collected online, our proposed algorithm adapts this learned magnetic field model using a simple last-layer update scheme, allowing the MPC controller to quickly adapt to the true planetary magnetic field model and more effectively plan attitude trajectories. We demonstrate the results of our proposed approach for two use cases, (1) Earth-orbit and (2) Uranus-orbit, and show that our learning-based adaptive MPC algorithm improves controller success for these system simulations by 5% and 61%, respectively.

Comment
8 pages, 8 figures, 1 table, Accepted for publication at the International Conference on Space Robotics (iSpaRo) 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Trajectory-Planning Attitude Control System for Satellites with Magnetic Attitude Control and One Reaction Wheel

eess.SY math.OC ·2026-10-27 ·Patrick McKeen, Alex Meredith, Kerri Cahoy
similarity 0.63
Abstract · 19 pages, 26 figures in 14 groups, AAS/AIAA Astrodynamics Specialist Conference

Selecting attitude actuators for spacecraft in low earth orbit (LEO) often involves a trade between reaction wheels and magnetorquers. Reaction wheels generally have higher size, weight and power as well as cost, compared with magnetorquers, but have performance advantages. We consider a hybrid system relying on a single reaction wheel and three magnetorquers, using a trajectory planning control method that focuses on meeting pointing goals and minimizing the need to desaturate the reaction wheel. The use of planning allows for intelligent use of the reaction wheel and accommodates time-changing goals and orbit-varying magnetic fields. Preliminary results show trajectories with fractional-degree-accuracy, as well as management of reaction wheel momentum and avoidance of stiction. We also compare to a magnetorquer-only planning-based control system and show better convergence and faster slews.

0.34

A Modular Open-Source Python Framework for Small Satellite Attitude Determination and Control

eess.SY ·2026-11-02 ·Patrick McKeen, Niclas Scheuer, Kerri Cahoy
code/data similarity 0.61
Abstract · 8 pages, 4 figures, SmallSat Europe 2026

Advanced attitude determination and control (ADCS) techniques can be difficult for small satellite teams to adopt: tightly coupled implementations require substantial code changes to evaluate different actuators, sensors, orbits, mission goals, and control laws. Existing tools often emphasize orbit mechanics or flight software rather than closed-loop ADCS. This paper presents an open-source, modular ADCS framework in pure Python for rapid development, repeatable testing, and flight-oriented integration across heterogeneous spacecraft. The package supports torque- and command-level control, bound-respecting allocation, and full- and reduced-attitude objectives. Interchangeable estimation, control, planning, and actuator/sensor modules are reconfigured through configuration changes. Integrated simulation includes attitude and orbit propagation, sensor and actuator bias and noise, and environmental disturbances. An actuator-aware planner supports underactuated architectures, while hardware-in-the-loop (HIL) capability enables testing on mission-representative computers. Case studies include a 3U CubeSat with three magnetorquers and one reaction wheel, a magnetorquer-only 1U, and a 6U with three reaction wheels and thrusters. These demonstrate actuator and sensor failures, full- and reduced-attitude goals, and momentum management. HIL testing on a Raspberry Pi uses the same package. Adapting a published control law to a new actuator configuration requires fewer than five lines of configuration changes. The framework underpins flight software for an Earth-observing CubeSat with visible and long-wave infrared imagers, three magnetorquers, and one reaction wheel, without star trackers or propulsion.

0.39

MagServo: Uncertainty-Resilient Hierarchical Magnetic Servoing via Learned Latent Representations

cs.RO ·2026-10-05 ·Yuhan Tan, Yameng Zhang, Pei Liu, Yao Zhong, Zhongliang Jiang
similarity 0.59
Abstract

Magnetic navigation provides contact-free and line-of-sight-independent feedback for robotic systems, yet existing approaches typically rely on explicit pose estimation or direct use of raw magnetic measurements, making accurate control susceptible to modeling errors, measurement noise, and disturbances. This work presents MagServo, a hierarchical learning-based framework for robust 6-DoF magnetic servoing directly using the learned latent magnetic feature. MagServo learns uncertainty-resilient magnetic representations through masked reconstruction and captures state-dependent interaction dynamics between robot motion and latent magnetic transitions without analytical magnetic models or explicit Jacobian supervision. Based on the learned dynamics, a hierarchical controller combines nonlinear model predictive control for coarse approach with local Jacobian inversion for precise fine regulation. Extensive physical experiments demonstrate submillimeter and subdegree accuracy, achieving mean terminal errors of 0.386 mm and 0.479 degree for 6-DoF pose reaching. MagServo further outperforms a localization-based control baseline in complex trajectory tracking and maintains robust performance under unseen magnetic-source configurations without retraining. A supplementary video of the real-robot experiments is available at https://youtu.be/rZt1NUP1Mr0.

0.38

Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPC

cs.RO cs.LGeess.SY ·2026-09-01 ·Baha Zarrouki, Arslan Thobani, Jasper Hoffmann, Mattia Piccinini, Rudolf Reiter +4 more
similarity 0.57
Abstract · Submitted to IEEE Transactions on Robotics (T-RO). 18 pages, 13 figures

In Model Predictive Control (MPC), cost-function weights shape closed-loop behavior, yet changing conditions often make fixed parametrizations suboptimal and motivate context-dependent online adaptation. Learning such policies is difficult because behavior depends implicitly on numerical MPC solutions, producing nonlinear, potentially nonsmooth, long-horizon dependencies on policy parameters. This creates a bias-variance tradeoff: Reinforcement Learning (RL) optimizes realized closed-loop return from environment samples but is sample-inefficient, whereas Gradient-Based Policy Learning (GB-PL) uses low-variance solver gradients from differentiable MPC to optimize surrogate losses on predicted trajectories but can be biased under model mismatch. We propose Solver-Gradient Guided Reinforcement Learning (SG-RL), a solver-sensitivity augmentation for RL-based online MPC cost-weight adaptation. SG-RL keeps sampled closed-loop return as the objective and uses bounded solver-derived gradients as auxiliary guidance to improve stability and sample efficiency. We instantiate SG-RL in Proximal Policy Optimization (PPO) with four modular algorithms that inject solver-gradient guidance into actor-update scaling, policy loss, advantage estimation, and value-function learning. On two full-scale autonomous racing platforms with intentional model mismatch, SG-RL reaches PPO's best closed-loop return with up to 70.6% fewer samples, outperforms GB-PL baselines by at least 54% in closed-loop return, and generalizes zero-shot to unseen environments.

0.41

Physics-based Online Adaptive Koopman Model Predictive Attitude Control for Combined Spacecraft with Dynamic Uncertainties

eess.SY ·2026-09-02 ·Yicheng Sun, Yueyong Lyu, Yuhan Liu, Yanning Guo, Wei Pan
top venue similarity 0.56
Abstract · 16 pages, 13 figures, 3 tables

This paper proposes a physics-based adaptive Koopman Model Predictive Control (MPC) strategy for combined spacecraft attitude stabilization under inertia uncertainties and active target maneuverability. A novel, quaternion-based Koopman model is constructed from a set of analytical lifting functions derived from the quaternion kinematics, which provides a more compact and physically interpretable linear representation of the nonlinear dynamics compared with the conventional black-box EDMD and higher-dimensional DCM-based model. Leveraging the linear structure of this nominal model, a gradient descent-based update law is employed to efficiently identify time-varying inertial uncertainties from real-time input/output data. By integrating this adaptive linear model into the MPC framework, the optimal control problem reduces to a computationally efficient Quadratic Program (QP), thereby significantly lowering the online computational burden compared to nonlinear adaptive MPC. Recursive feasibility and regional input-to-state stability are formally established through the design of terminal ingredients for the MPC. The effectiveness and superiority of the proposed strategy are validated through comparative simulations of an attitude stabilization task for combined spacecraft in a high-fidelity 3D simulator.

0.48

GPU-Accelerated Astrodynamics World Models for Spacecraft Rendezvous and Proximity Operations

cs.RO eess.SY ·2026-09-02 ·Duncan Eddy, Isaac R. Ward, Grace Ra Kim, Mykel J. Kochenderfer
publishedcode/data similarity 0.56
Abstract · 20 pages, 12 figures, 5 tables, Presented at Advanced Maui Optical and Space Surveillance Technologies Conference 2026

World models are an emerging paradigm in representation learning in which an agent jointly learns state-action dynamics and observation models from offline trajectory data, enabling multi-step planning and trajectory prediction with uncertainty estimates. They have shown strong results in robotics and game environments, but, to the best of our knowledge, have not previously been applied to the space domain. This paper introduces a world model-based approach to cooperative and non-cooperative spacecraft rendezvous and proximity operations. First, we introduce an open-source, JAX-based International Space Station (ISS) docking environment supporting parallel GPU simulation of spacecraft orbit and attitude dynamics, generating the thousands of state-action transitions that world model training requires. Second, we introduce Out-of-this-World-Model, a transformer-based world model that encodes relative kinematic states and body-fixed camera imagery into a latent state and predicts its evolution under commanded thrusts and torques using one-step flow matching. It produces a distribution over future observations, capturing stochastic dynamics and per-timestep uncertainty, and outperforms DreamerV3-style posterior-correction baselines with fewer trainable parameters and hyperparameters. Third, we apply the approach to a capsule autonomously docking with the ISS under keep-out-zone constraints, demonstrating improved sample efficiency and task performance over reinforcement learning baselines (53% versus 29% docking success across ports), better out-of-distribution generalization (on held-out ports the world model more than doubles baseline success, 40% versus 17%), and detection of anomalous objects encountered during approach with 98% classification accuracy. We open-source the simulation environment and model architecture to enable further study of this paradigm.

0.53

world2vec: Mechanistic world models through latent dynamics learning

cs.LG ·2026-10-29 ·Tobias Schmidt, Rodrigo Gonzalez Laiz, Krisztián Szuppinger, Steffen Schneider
benchmark similarity 0.56
Abstract · https://worldmodels.science/

World models can achieve strong control performance without faithfully capturing the dynamics of their environment, limiting their potential for mechanistic interpretability and scientific discovery. Here, we introduce world2vec to learn mechanistic world models without reward information directly from observations and actions. World2vec learns latent dynamics that faithfully reproduce the true system over long prediction horizons, with at least one order of magnitude fewer parameters than DreamerV3, TD-MPC2 and LeWM. This enables state of the art performance in controlling continuous environments from pixels and accurate system identification across a benchmark of 71 attractors, demonstrating how world models are amenable to scientific discovery.

0.23

Optimal Control with Learned Critics under Unmodeled State Dependencies

cs.RO cs.AI ·2026-10-04 ·Philipp Schoch, Markus Ryll
published similarity 0.55
Abstract · Keywords: Model Predictive Control, Model-Based Reinforcement Learning, iLQR, Value Function Approximation. Presented at 10th Conference on …

Model Predictive Control (MPC) provides a structured and constraint-aware mechanism for decision-making, but its reliance on optimization-friendly analytical dynamics models limits its use in tasks with contacts and other hard-to-model state dependencies. Model-free reinforcement learning avoids explicit modeling assumptions but typically requires large amounts of interaction data. We present a learning-based MPC framework that combines the data efficiency and structure of local model-based planning with learned components that compensate for incomplete dynamics and finite-horizon myopia. The method augments a nominal analytical model with a residual dynamics network that learns missing state-dependent effects from data and combines the resulting planner with a learned action-value critic that injects long-horizon MDP structure into the local iLQR optimization. To make this practical at reinforcement-learning scale, we develop a GPU-accelerated batched iLQR solver that evaluates learned dynamics and critic networks inside the optimal-control loop and solves thousands of trajectory-optimization problems in parallel. The complete system is integrated into a robotics simulator, enabling scalable model-based reinforcement learning under incomplete dynamics. Experiments on biased and incompletely modeled control tasks show that the approach improves closed-loop control performance while preserving the model-based structure needed for efficient constrained trajectory optimization.

0.33