CS Paper Radar

PoKER: A Probability of Kill Estimation Rate Model for Air-to-Air Missiles Using Machine Learning on Stochastic Targets

Joao P. A. Dantas, Andre N. Costa, Diego Geraldo, Marcos R. O. A. Maximo, Takashi Yoneyama

cs.LG cs.AI ·submitted 2026-10-23 16:34 UTC · v1
publishedcode/datahighly cited

Abstract

This work introduces PoKER, a novel probabilistic model engineered to optimize missile launch effectiveness in air-to-air scenarios, specifically within Beyond Visual Range (BVR) air combat. Unlike conventional Weapon Engagement Zone (WEZ) models that delineate zones based on static distances such as maximum, minimum, and no-escape ranges, PoKER applies machine learning to predict kill probabilities more accurately by integrating the stochastic behaviors of targets and missile miss distances. This model dynamically evaluates target behavior, greatly expanding the predictive capabilities of engagement analysis. By factoring in elements such as warhead lethality, target and shooter orientations, and the specific conditions of engagement, PoKER provides important insights into engagement dynamics and quantifies success probabilities. Consequently, it can potentially be an important tool for BVR air combat pilots, improving operational decision-making within this specialized combat domain.

Comment
Accepted manuscript. 18 pages, 10 figures, 5 tables. Code available at https://github.com/jpadantas/poker
Journal ref
The Journal of Defense Modeling and Simulation: Applications, Methodology, Technology (2025)
DOI
10.1177/15485129241309675

Closest papers

Nearest neighbours by meaning across the whole index.

BVR Sim: An Open and High-Throughput Environment for Heterogeneous Air-Combat Reinforcement Learning

cs.MA cs.LG ·2026-08-26 ·Haocheng Sun, Mulai Tan
code/data similarity 0.59
Abstract · 9 pages, 4 figures, 4 tables. Code and reproducibility artifacts available at the project repository

Beyond-visual-range (BVR) air combat is a challenging reinforcement-learning domain characterized by partial observability, long-horizon decision making, energy management, and limited weapons. We present BVR Sim, an open-source Gymnasium-style environment designed for heterogeneous air-combat reinforcement learning. BVR Sim supports multiple JSBSim aircraft models, including the F-15, F-16, F/A-18, and F-22, with configurable weapons, sensors, controllers, and opponents. A unified tactical action interface specifies desired heading, altitude, speed, and weapon release above aircraft-specific inner-loop controllers, enabling policies to operate across heterogeneous platforms. The environment provides interchangeable Python and accelerated C++ backends, entity-oriented observations, compositional rewards, scripted opponents, replay and visualization, and adapters for multi-agent learning frameworks. At a 0.4-s decision interval, the C++ backend achieves 104 simulated seconds per wall-clock second in 1-vs-1 and remains practical through 10-vs-10 scenarios. A policy trained only on the F-16 transfers without retraining to four unseen aircraft, reaching a 45.5% mean win rate with aircraft-specific controller adaptation. MAPPO and HAPPO experiments further verify end-to-end compatibility with standard multi-agent reinforcement-learning pipelines.

0.23

Reinforcement Learning for Target Jerk Estimation in Interceptor Homing Phase

eess.SY ·2026-11-11 ·Brian Gaudet, Dalton Durant, Roberto Furfaro
similarity 0.54
Abstract · Submitted to Journal of Spacecraft and Rockets

We demonstrate the use of reinforcement meta-learning (meta-RL) to optimize a target jerk estimation policy, which is then used as the target acceleration rate of change in the propagation model of an unscented Kalman filter (UKF). The policy is learned through simulated engagements of a terminal phase high-altitude endoatmospheric interception of a highly maneuverable target, with a hit-to-kill accuracy requirement. As benchmarks, we tuned both a standard UKF and an interacting multiple model (IMM) filter, where the IMM uses a different constant jerk assumption for each model. The benchmarks and the proposed augmented UKF with the target jerk policy are tested in a 6-DOF simulation environment, which has sufficient fidelity to capture most factors relevant to guidance, navigation, and flight control. The augmented UKF demonstrates significant improvement in target interception rate, with more challenging maneuvers giving the largest performance differential. The meta-RL jerk policy is then tested on an expanded engagement scenario, with increased initial state estimate uncertainty and novel target maneuvers, demonstrating that the meta-RL policy generalizes well to conditions not seen during optimization.

0.35

From Reconnaissance to Response: Quantitative Risk Parameterization and Game Theoretic Containment in Modern Enterprise Attack

cs.GT cs.CReess.SY ·2026-09-29 ·Shadeeb Hossain, Elias Calboreanu
similarity 0.54
Abstract · 10 pages, 5 figures

Modern Security Operations Centers struggle with delayed manual incident response, enabling adversaries to advance through the Cyber Kill Chain during early stage reconnaissance. While classical game theoretic defense models optimize strategic resource allocation, they rely on static utility matrices that fail to adapt to dynamic telemetry. This paper presents an integrated, metrics driven decision engine that bridges quantitative risk parameterization and continuous automated response time. Common Vulnerability Scoring Systems exploitability parameters are mapped to attacker success probabilities and evaluate defender log distributions via Factor Analysis of Information Risk Monte Carlo simulations. Real time SIEM logs streams are modeled as Poisson process arrival rates, dynamically updating defender posterior threat belief through sequential Bayesian filtering. A closed form threshold is derived by framing the interaction as a dynamic Bayesian Stackelberg game, where the expected unmitigated risk exceeds proactive containment cost. Parameterized against empirical data from the 2023 MGM Resorts and Caesars Entertainment cyber incident, simulation results demonstrate that the engine suppresses transient background noise while triggering automated SOAR network isolation within seconds of adversarial probing. Multi parameter sensitivity analysis confirms that the decision boundary dynamically adjusts to live perimeter vulnerability, offering a control theoretic foundation for sub minute automated threat containment.

0.22

Strategic Decision Focused Learning

cs.GT ·2026-09-14 ·Tinashe Handina, Yuehan Diao, Adam Wierman, Eric Mazumdar
similarity 0.53
Abstract

Machine learning (ML) predictions are increasingly being used to guide decision-making, giving rise to the problem of decision-focused learning (DFL) where predictors are optimized for downstream decision quality rather than accuracy alone. However, most existing work assumes a single decision-maker optimizing in isolation. This paper formalizes strategic decision-focused learning, where an ML system predicts an exogenous state that some agents observe before playing a game. For example, a park ranger may predict wildlife locations to allocate anti-poaching patrols against strategic poachers. While the exogenous state is unaffected by agent actions, predictions influence agents' strategies and the resulting equilibrium. We find that strategic considerations fundamentally change the learning problem. In particular, we show the prediction accuracy-equilibrium payoff landscape can be non-monotonic, i.e., better predictions can degrade performance. We propose algorithmic approaches to address these challenges and validate them across benchmarks in wildlife conservation and infrastructure protection. Our theory and experiments highlight the importance of accounting for strategic interactions when designing predictors.

0.17

Wind-Informed Rapid Flight-Planning in Complex Urban Topologies via Machine Learning and Experimental Validation

cs.RO physics.flu-dyn ·2026-08-10 ·Peter I. Renn, Alejandro A. Stefan-Zavala, Julian Humml, Sabera Talukder, Aysha AlMazrouei +6 more
similarity 0.52
Abstract

Advanced air mobility operations hold the potential to enhance and expand regional transportation of both people and goods in populated areas. However, hazardous flight conditions arising from interactions between wind and the built environment remain a significant challenge for aerial vehicles in urban settings. This work proposes a novel framework towards safe flight planning of aerial vehicles in windy urban environments. A learning-based surrogate model is trained to rapidly predict flow fields from readily available information such as building geometry and incident wind. This surrogate prediction is used to calculate a volumetric flight challenge scalar field based on critical flow parameters and proximity to structures. A safe, flow-informed flight trajectory is then identified through a cost-minimizing pathfinder. The complete system is demonstrated experimentally through flight tests of a micro aerial vehicle through a model urban geometry placed in a large fan-array wind tunnel. Comparing this approach to trajectories generated without knowledge of the wind field, we find the flow-informed approach reduces undesired vehicle displacement and improves flight stability. This work is among the first practical demonstrations of safe, wind-aware methodologies for advanced air mobility in urban environments.

0.34

RL-Guided PAC-NMPC for Probabilistically-Safe Perception-Based Navigation in Unknown Environments

cs.RO ·2026-09-30 ·Adam Polevoy, Dillon Capalongo, Katherine Tang, Mark Gonzales, Marin Kobilarov +1 more
similarity 0.52
Abstract

In this paper, we present an approach for combining stochastic nonlinear model predictive control (SNMPC) and reinforcement learning (RL) to enable probabilistically-safe perception-based navigation in unknown environments. Our method first uses RL to train probabilistic actor-critic and sensor prediction models. We then leverage these probabilistic models in a sampling-based SNMPC framework known as Probably Approximately Correct (PAC)-NMPC, which uses hard constraints to enforce finite-time statistical guarantees on the probability of collision and value function improvement. By ensuring that our finite-horizon SNMPC policies decrease the value function in expectation, we can approach the long-horizon performance of the RL approach while satisfying probabilistic safety constraints. Through simulation experiments, we show that our approach can improve the safety of perception-based RL navigation policies and scale to high dimensional systems with large sensor input spaces and complex nonlinear dynamics. We also demonstrate our approach through hardware experiments, showing improved performance for vision-based navigation with an agile fixed-wing aerial vehicle in unknown environments.

0.12

Learning High-Risk High-Precision Motion Control

cs.LG cs.RO ·2026-09-28 ·Nam Hee Kim, Markus Kirjonen, Perttu Hämäläinen
published similarity 0.51
Abstract · Project webpage: https://namheegordonkim.github.io/scoot-mig2022/

Deep reinforcement learning (DRL) algorithms for movement control are typically evaluated and benchmarked on sequential decision tasks where imprecise actions may be corrected with later actions, thus allowing high returns with noisy actions. In contrast, we focus on an under-researched class of high-risk, high-precision motion control problems where actions carry irreversible outcomes, driving sharp peaks and ridges to plague the state-action reward landscape. Using computational pool as a representative example of such problems, we propose and evaluate State-Conditioned Shooting (SCOOT), a novel DRL algorithm that builds on advantage-weighted regression (AWR) with three key modifications: 1) Performing policy optimization only using elite samples, allowing the policy to better latch on to the rare high-reward action samples; 2) Utilizing a mixture-of-experts (MoE) policy, to allow switching between reward landscape modes depending on the state; 3) Adding a distance regularization term and a learning curriculum to encourage exploring diverse strategies before adapting to the most advantageous samples. We showcase our features' performance in learning physically-based billiard shots demonstrating high action precision and discovering multiple shot strategies for a given ball configuration.

0.43

OmniRisk: Omnidirectional Trajectory-Risk Learning for Agile Quadrotor Dynamic Avoidance

cs.RO ·2026-09-16 ·Yifan He, Yang Liu, Wenhao Zhao, Hai Lin, Deping Zhang +6 more
code/data similarity 0.51
Abstract · 8 pages, 5 figures, 6 tables

Agile quadrotor avoidance of fast-moving obstacles requires anticipating collisions and selecting feasible maneuvers within short reaction windows. Reliable predictive avoidance remains challenging because sparse range observations do not directly reveal obstacle motion, while online trajectory optimizers either scale poorly with obstacle count or remain efficient at the expense of reliability in dense, high-speed encounters. We present OmniRisk, an omnidirectional planning framework that learns trajectory-level risk offline for efficient onboard evasion. A fixed-dimensional tensor combines LiDAR range panoramas, dynamic masks, and Cartesian surface velocities to represent geometry and motion jointly. We formulate an asymmetric risk field aligned with obstacle velocity that emphasizes approaching interactions and attenuates receding ones. Accumulating this risk along predicted relative trajectories provides dense supervision and discourages unnecessary hesitation after obstacles pass. A dual-branch circular convolutional network predicts terminal boundary states and dynamic risks for candidate primitives over an omnidirectional anchor lattice in a single forward pass, followed by selection and closed-form reconstruction of the selected candidate primitive. This formulation removes online risk accumulation along trajectories and makes risk-inference cost independent of obstacle count. OmniRisk enables efficient onboard avoidance, with real-world flights demonstrating consecutive evasive maneuvers at relative encounter speeds up to 15 m/s without fine-tuning. Code is available at https://github.com/VANdexj/OmniRisk.

0.37