CS Paper Radar

Optimal Control for Cancer Chemotherapy Using Hybrid Quantum Particle Swarm Optimization

Bereket Sitotaw Kidane, Md Samiul Haque Motayed, Shuo Wang

eess.SY math.OC ·submitted 2026-09-10 08:05 UTC · v1
published

Abstract

Optimal control in cancer chemotherapy is challenged by tumor heterogeneity and mutations, which complicate treatment effectiveness. Traditional methods, such as Pontryagin's maximum principle (PMP), are often hindered by their reliance on an initial guess for the costate equation, affecting accuracy and convergence. To address these limitations, this work introduces a hybrid quantum particle swarm optimization (QPSO) method based on regularization. QPSO is employed for global exploration to approximate the optimal control trajectory, followed by a regularization-based refinement to ensure smoothness and consistency with optimality conditions. The Hamiltonian function is used for first- and second-order optimality checks, verifying solution quality. Numerical case studies explore various drug effectiveness functions, demonstrating the role of periodic and localized drug delivery in achieving robust tumor suppression and providing insights into the impact of different drug combinations on optimal chemotherapy strategies.

Comment
6 pages, 6 figures. Published in the 2025 IEEE 64th Conference on Decision and Control (CDC)
Journal ref
2025 IEEE 64th Conference on Decision and Control (CDC), pp. 3799-3804, 2025
DOI
10.1109/CDC57313.2025.11312610

Closest papers

Nearest neighbours by meaning across the whole index.

Optimal chemo-immunotherapy scheduling: A hybrid QPSO-SQP approach with Michaelis-Menten pharmacodynamics

eess.SY math.OC ·2026-09-10 ·Bereket Sitotaw Kidane, Md Samiul Haque Motayed, Shuo Wang
publishedtheory similarity 0.68
Abstract · 23 pages, 6 figures, 3 tables. Published in Discrete and Continuous Dynamical Systems - Series B

Optimal scheduling of combined chemo-immunotherapy is often formulated as a control-affine optimal control problem, which generically yields boundary-selected (bang-bang-type) protocols unless singular arcs occur. This structure, while convenient, neglects saturating pharmacodynamics at high dose rates. We incorporate Michaelis-Menten saturation directly into the therapy channels, making the dynamics non-control-affine and the Hamiltonian nonlinear in each control. With strictly positive exposure penalties, the Hamiltonian admits an explicit three-regime pointwise minimization law: each input is chosen at the lower bound, the upper bound, or as a unique interior minimizer. On interior intervals the strict Legendre condition holds, so continuously modulated dosing arises as a regular interior extremal rather than a singular-arc or smoothing artifact. The resulting transcription is nonconvex; we therefore use a hybrid Quantum Particle Swarm Optimization (QPSO)-Sequential Quadratic Programming (SQP) pipeline, where QPSO provides a constraint-aware warm start and SQP enforces feasibility and Karush-Kuhn-Tucker (KKT) optimality on a collocation grid. Costate reconstruction corroborates the Pontryagin Minimum Principle (PMP) structure and the predicted boundary/interior regime transitions.

0.47

Adaptive Chemotherapy Control under Tumor Heterogeneity via Reinforcement Learning

cs.LG eess.SY ·2026-09-10 ·Bereket Sitotaw Kidane, Md Samiul Haque Motayed, Shuo Wang
publishedbenchmark similarity 0.56
Abstract · 6 pages. Published in the 2026 American Control Conference (ACC)

Designing effective chemotherapy regimens is hindered by tumor heterogeneity and drug resistance, which complicate the deployment of patient-specific model-based optimal control across diverse populations. We develop and compare closed-loop deep reinforcement learning (DRL) dosing policies with continuous (TD3) and discrete (DQN) action spaces trained on a high-dimensional heterogeneous tumor model. The DRL policies are benchmarked against a Pontryagin's Maximum Principle (PMP)-derived open-loop benchmark. We assess generalization under parametric heterogeneity using a 100-patient virtual cohort with plus or minus 10 percent uniform perturbations in growth and drug-sensitivity parameters. Across this cohort, TD3 achieves higher average tumor reduction, while DQN yields tighter inter-patient dosing consistency, revealing a clear efficacy-consistency trade-off in this study. Our simulations assume full observation of all tumor subpopulations; translation to sparse and noisy clinical measurements will require partial-observability formulations and/or state estimation. Overall, the results show that simulation-trained DRL can learn state-dependent feedback dosing policies that complement open-loop optimal control benchmarks.

0.33

Behavioral Cloning Outperforms Entropy-Regularized RL: Critic-Driven Failure of Actor-Critic Methods on Adaptive Tumor Treatment

cs.LG ·2026-09-06 ·Aleksandar Dimitrov, Giacomo Spigler
similarity 0.55
Abstract · 9 pages, 3 figures

Adaptive dosing requires policies that reduce tumor burden without excessive toxicity. Learned dosing policies are typically judged against historical or heuristic comparators, which cannot show whether a policy has found the best behavior available. We instead study a three-population tumor-control ODE in which optimal-control analysis fixes the form of a good schedule -- bang-bang dosing punctuated by a singular arc -- and construct a numerical controller of that form as a proxy for near-optimal behavior. Judged against this reference under a sustained-cure criterion -- 200 consecutive days below 5% carrying capacity -- Soft Actor-Critic (SAC) trained from scratch never reaches cure. Behavioral cloning (BC) of the reference reproduces it (100% sustained cure, 30/30 seeds), but SAC fine-tuning of the cloned policy destroys it across five entropy coefficients, and TD3 and BC-regularized SAC fail identically; the pattern persists under multiplicative pharmacokinetic action noise. Along curative trajectories the post-collapse critic ranks the collapsed-policy action above the reference action in 96% of states, concentrated in the maintenance phase, and the policy settles into a non-curative adaptive-therapy equilibrium. The reference is what makes this legible: against a heuristic comparator the fine-tuned policy would read as a competent controller rather than a failure.

0.29

Diffusion-Based Multiple-Shooting Indirect Optimal Control for Fuel-Optimal Spacecraft Trajectory Generation

eess.SY cs.LG ·2026-09-12 ·Saeid Tafazzol, Ehsan Taheri, Ryne Beeson
benchmarkcode/data similarity 0.52
Abstract · Submitted to IEEE Control Systems Letters (L-CSS) for possible publication

Diffusion-based generative models (DMs) have found applications in control problems, and in particular robotics, where the DMs enable exploration of possible control solutions. A critical shortcoming of these applications is that they have lacked optimality guarantees. This is a problem for their potential use in fuel-optimal spacecraft trajectories that are characterized with long time-horizons and bang-bang profiles. Alternatively, indirect optimal control methods ensure explicit satisfaction of necessary conditions, but are highly sensitive to the initial costate estimation needed to solve the resulting Hamiltonian boundary-value problems (HBVPs). To alleviate this sensitivity and enlarge the convergence domain of HBVPs, advanced indirect methods have been developed that use smoothing approaches and continuation. We propose a diffusion-based multiple shooting indirect control method that combines the exploration capability of DMs with indirect method to generate fuel-optimal spacecraft trajectories. We benchmark our method against an advanced indirect method on a fuel-optimal Earth-Mars low-thrust transfer problem, showing higher convergence robustness than the advanced indirect method that is based on random costate initialization. Code and visualizations are available at https://saeidtafazzol.github.io/Diffusion_Indirect_Control/.

0.21

A Bilevel Neurodynamic Approach for Distributed SCAD-Regularized Sparse Least Squares

cs.MA math.OC ·2026-11-05 ·Juntao Li, Qihang Guo, Deyuan Meng
unusual similarity 0.51
Abstract

This paper proposes a bilevel particle swarm optimization (PSO)-neurodynamic method for solving the distributed sparse least-squares problem regularized by the smoothly clipped absolute deviation (SCAD) penalty to global optimality. The SCAD penalty is nonsmooth and nonconvex, so existing distributed neurodynamic methods have not been extended to it directly. Through two-time-scale singular perturbation analysis, a rigorous full-trajectory convergence theory with explicit convergence rates is established for the inner collaborative multi-agent neurodynamic system without requiring the second-order sufficient condition. A theory-guided inner-outer collaborative optimization framework is further developed, in which a red-light green-light sensitivity mechanism is embedded in the outer PSO search to enhance global search while concentrating computational effort on the SCAD shape parameters, thereby improving recovery accuracy and computational efficiency. Simulation results on four sparse-recovery scenarios demonstrate that the proposed method accurately recovers the true sparsity pattern and achieves faster convergence and lower relative error than competing neurodynamic methods.

0.32

Schrödinger Bridges over Kinetic Swarming Models

eess.SY math.OCmath-phstat.ML ·2026-08-26 ·Asmaa Eldesoukey, Md Zulfiqur Haider, Italo Napolitano, Yongxin Chen, Abhishek Halder
similarity 0.51
Abstract

Paradigmatic interaction models explain how collective behaviors can emerge in complex systems from interactions among the constituent agents. In bio-inspired swarms, however, interactions alone may not suffice to bring the population to a desired aggregate configuration within a prescribed time horizon, as needed in applications ranging from targeted therapy to collective transport and emergency evacuation. In the present work, we consider finite-horizon minimum-energy collective steering for inertial swarms that are subject to stochastic disturbances. We focus on the mean-field representations of these multi-agent systems driven by Cucker--Smale alignment or Morse attraction--repulsion interactions. Our objective is to steer the swarm between prescribed endpoint distributions using a state-feedback control, where the endpoint specifications can be full phase-space distributions (positions and velocities) or position marginals alone. Our formalism is rooted in the theory of Schrödinger bridges, which has inspired contemporary developments spanning statistical inference, biological modeling, stochastic control, and generative learning. Within the bridges framework, the uncontrolled interacting stochastic dynamics are viewed as a prior model, and the optimal control as the minimum-energy corrective drift needed to realize the prescribed distributions. We derive nonlinear, coupled necessary optimality systems with a time-symmetric structure reminiscent of classical Schrödinger bridges, and propose nested fixed-point schemes to numerically solve them. Numerical examples show that the obtained optimal control (corrective drift) can dynamically exploit or counteract the interaction forces, depending on whether the latter are favorable or adversarial to the steering task.

0.52

Stochastic Control Policies for Robust Molecular Transition Path Sampling

cs.LG ·2026-08-13 ·Jingqian Liu, Yu-Hsiang Wang, Yanru Qu, Ge Liu
similarity 0.51
Abstract

Transition path sampling (TPS) aims to efficiently generate rare molecular transition trajectories between metastable states and is essential for understanding biomolecular mechanisms. Beyond traditional molecular dynamics (MD)-based sampling, machine learning has become central to state-of-the-art TPS. One major class of methods learns control forces during explicit MD rollouts. By preserving the underlying molecular dynamics, these methods tend to produce more physically plausible trajectories than endpoint-conditioned generators that construct paths directly. However, rollout-based control methods have been reported to exhibit unstable and strongly seed-dependent performance. We recast rollout-based control as learning a path-space proposal distribution and investigate stochasticity placement as a design choice for improving exploration and optimization robustness. We develop two stochastic policies: FS-TPS, which directly parameterizes a state-dependent Gaussian distribution over the control policy output, and LaS-TPS, which samples a compact latent control variable and decodes it into structured, cross-atom-correlated force variation. We conduct extensive multi-seed experiments on three biomolecular systems of increasing size: alanine dipeptide, chignolin, and BBL, a fast-folding protein. Stochastic policies consistently improve transition success and path quality over deterministic-policy baselines while substantially reducing sensitivity to random initialization.

0.04

Robust Reinforcement Learning for Dynamic Treatment Regimes under Model and Measurement Uncertainty

cs.LG ·2026-10-15 ·Chengze Xie, Xuan Wang, Ying Ding, Hairong Wang, Yan Li
similarity 0.50
Abstract

We develop a robust reinforcement learning (RL) framework for learning adaptive treatment policies that generalize across patients and remain reliable under errors in the measured biomarker and shifts in the disease dynamics. By modeling the patient as a hidden context, we address generalization and robustness in a unified manner through robust contextual Markov decision processes. Applying our framework to adaptive therapy for metastatic prostate cancer in a simulator calibrated to clinical data, we obtain generalizable and robust policies that substantially outperform the existing adaptive therapy method. In particular, we attain robustness with almost no loss of performance when the biomarker is accurate and the disease evolves as anticipated, and find that the resulting policy Pareto-dominates the existing method across a diverse array of scenarios. Our findings suggest that robust RL holds great promise as a principled methodology for learning reliable adaptive treatment policies.

0.17