CS Paper Radar

A Minimally Informed Black-Box Fake-Report Attack on DRL Traffic-Signal Control

Amro Saleh, Loukas Lazos, Mohammad J. Abdel-Rahman

cs.CR ·submitted 2026-10-28 09:53 UTC · v1

Abstract

Deep reinforcement learning (DRL) traffic-signal controllers may use vehicle-to-infrastructure (V2I) reports, exposing their perception layer to false-data injection. Existing demonstrations typically assume either white-box access to the controller's weights or full observability of the traffic state. We study the impact of a weaker and more realistic adversary who has no access to the RL model and whose traffic observations are limited to her own approach. This black-box, minimally informed attacker trains an imitation surrogate of the controller. She then crafts bounded fake reports, restricted to inflating vehicle counts on her own approach, that transfer to the real controller. We demonstrate that despite the loss of accuracy relative to an attacker who can observe the entire state and action space, this limited attacker can significantly increase the average waiting time for other approaches while barely changing the waiting time on her own approach, i.e. externalizing the added delay onto the other approaches. Because the only realizable move is to inflate one's own reported queue, we find that a zero-knowledge attacker that simply reports the maximum feasible queue is as damaging as the surrogate-based one, while an unstructured random inflation is not: the surrogate is not required to reproduce the degradation, and the exposed vulnerability is the V2I sensing channel itself. The surrogate's role is directional control, selecting a disruptive or a selfish objective at the same budget. The attack persists under +/-20% uniform demand variation. Finally, on a common per-lane budget we place the attacker on a knowledge ladder against white-box adversaries, and find the black-box surrogate matches a realizable white-box attacker that uses the victim's own gradients; only abandoning realizability raises the damage further.

Comment
7 pages, 3 figures, 5 tables. Submitted to IEEE VTC2027-Spring (under review)

Closest papers

Nearest neighbours by meaning across the whole index.

Boosting Transferable Adversarial Attacks against Deep Reinforcement Learning

cs.LG cs.AI ·2026-10-05 ·Zexin Li, Ruili Yao, Yiming Zeng, Xiaoxue Gao
similarity 0.68
Abstract · Accepted by AACL-IJCNLP 2026 Workshop TrustAudio

Most adversarial attacks on deep reinforcement learning (DRL) assume white-box access to the victim policy, which rarely holds in practice. This paper studies transfer-based black-box attacks on DRL: the attacker crafts observation perturbations on a white-box surrogate agent and feeds them to an unknown victim. We formulate the attack as return minimization under a per-step perturbation budget. We first show that transplanting transferable image-classification attacks (FGSM, MI-FGSM, and NI-FGSM) with a per-step objective yields perturbations that transfer but are no stronger than random noise of the same budget. We then propose a trajectory-level attack that optimizes a sequence of perturbations over a receding horizon through a differentiable model of the environment and a temperature-smoothed surrogate policy, with the same optimizers. On CartPole-v1 with ten DQN and DDQN agents and 100 surrogate--victim pairs, the trajectory-level attack outperforms per-step attacks and random noise in the white-box, cross-model, and cross-algorithm settings.

0.25

Deep Reinforcement Learning for Misbehavior Detection Under Partially Observable V2X Data

cs.NI ·2026-09-25 ·Roshan Sedar, Charalampos Kalalas
similarity 0.68
Abstract

Misbehavior detection in vehicle-to-everything (V2X) systems is essential for ensuring the semantic correctness of exchanged messages and preventing the dissemination of falsified information. Existing data-centric misbehavior detection approaches largely rely on statistical validation or supervised machine learning models under the implicit assumption of fully observable V2X streams. In practice, however, vehicular environments are inherently partially observable due to hardware failures, intermittent connectivity, and environmental occlusions. Moreover, missingness itself can be strategically exploited by adversaries to evade detection. In this paper, we study misbehavior detection under incomplete V2X observations and propose a deep reinforcement learning (DRL)-based detection framework that learns adaptive policies with incomplete data. We further introduce an adversarial threat model in which attackers exploit or deliberately induce missingness to evade detection, including evasion via natural occlusions and adversarial feature suppression. Extensive experiments conducted on the VeReMi dataset under various missingness patterns demonstrate that DRL significantly outperforms a powerful XGBoost baseline under natural partial observability. However, results also reveal a critical vulnerability: DRL policies can be highly susceptible to evasion attacks that strategically exploit natural missingness. In contrast, DRL exhibits more gradual degradation under direct feature suppression compared to static tree-based models.

0.24

Deep Learning Latency Attacks and Defenses: A Cross-Domain Survey of Availability Threats

cs.CR ·2026-09-29 ·Zonghua Gu, Zeyu Gao, Amin Saremi, Samarjit Chakraborty
surveycode/data similarity 0.67
Abstract

Adversarial machine learning has focused mainly on integrity, but availability is an increasingly consequential complement. Latency attacks (also energy-latency attacks) increase inference-time work, energy, or response time, causing deadline misses, throughput collapse, or resource exhaustion in vehicle controllers, interactive services, or battery-powered sensors, sometimes while preserving the nominal prediction. This survey unifies a fragmented literature spanning perception pipelines (including physical attacks on autonomous-driving detection and tracking), input-adaptive neural inference (sponge examples, dynamic networks), and autoregressive and agentic systems (output-length, verbose-image, and reasoning denial-of-service attacks on LLMs, VLMs, mixture-of-experts models, and tool-using agents). We organize attacks by exploited computational bottleneck rather than formulation, separating what makes a computation expensive from how the attacker triggers it; the delivery channel (input, prompt or retrieved content, message, poisoning, or weight tampering) is an orthogonal attribute. Many attacks share one mechanism, intermediate-work amplification, motivating a work-budget defense abstraction; we distinguish caps on the work entering an expensive stage from caps on the results leaving it. We further analyze when a model-level cost increase becomes a system-level availability failure, which depends on critical-path share, slack, existing ceilings, accumulation, resource sharing, and fallback policy, not on the amplification factor alone. We also provide a threat-model taxonomy, consolidated quantitative comparisons, a defense review by control mechanism, and open challenges such as standardized evaluation, physical realizability, and whole-system availability. Companion website: https://github.com/guzonghua/awesome-latency-attacks.

0.61

Model-Free Generative Stealthy Attacks on Safety-Critical Vehicle Cyber-Physical Systems

eess.SY ·2026-10-22 ·Qazi Mairaj ud din, Sidra Ghayour Bhatti, Qadeer Ahmed
similarity 0.67
Abstract

Existing stealthy attacks presuppose white- or grey-box access to the target system, unrealistic in practice. This paper develops a model-free stealthy attack framework that learns an attack policy directly from nominal measurement data, without knowledge of the system dynamics, estimator, or detector. We establish a certified residual-impact bound and an observable stealth budget around a stealth-consistent anchor, and show that recurrence and context conditioning are structural necessities for closed-loop, multivariate cyber-physical systems (CPS). The resulting attack generator, trained against a Wasserstein critic under a stealth-constrained impact objective, induces a hazardous 2.51 m lane departure while evading five intrusion detection systems, and, in real-time hardware-in-the-loop tests, a speed deviation of approximately 8 km/h while staying below the detection threshold. Results show that safety-critical CPS remain exposed without attacker access to privileged information, motivating offense-informed defenses.

0.28

FOE-Dreamer: Deployment-Efficient Learning of Cyber Defense Policies in Operational Networks

cs.LG cs.CR ·2026-11-11 ·Yinuo Du, Christopher Kiekintveld
published similarity 0.64
Abstract · 14 pages, 5 figures. To appear in the proceedings of the Annual Computer Security Applications Conference (ACSAC)

Autonomous cyber defense is widely studied with deep reinforcement learning, but most work trains policies inside simulators because learning requires many trial-and-error interactions. Simulator-based training carries a fidelity gap: trained policies face authentication delays, partial action failures, service dependencies, and user traffic patterns that the simulator did not represent, and degrade on transfer. Training directly in the network being defended removes the gap but makes every interaction slow and costly, so sample efficiency becomes the binding constraint. Model-based reinforcement learning has reduced sample requirements on games and physical robots by orders of magnitude by planning inside a learned world model, but it has not been applied to defenders trained in operational networks. We present FOE-Dreamer (Factored Opponent-Enhanced Dreamer), a model-based reinforcement learning framework that trains a defender online and directly in a network on cloud infrastructure, without a simulator stage. FOE-Dreamer separates three sources of variation in the latent state: a controllable component driven by defender actions, an exogenous component driven by benign user activity, and an opponent embedding inferred from defender-observable signals alone. Separating the components reduces the variance in policy gradients during planning in imagination. Against two scripted attacker profiles with user activity emulated by the GHOSTS framework on an 8-host OpenStack testbed, FOE-Dreamer trains within a 3-day budget on a single GPU and achieves about 2$\times$ better episode loss than Rainbow and IQN baselines under matched compute. Both the factoring and the opponent model contribute to the gain, and the learned latents are consistent with the intended separation.

0.38

Data Manipulation Attacks Against Machine Learning Integrated Cyber-Physical Systems

cs.LG ·2026-11-08 ·Soyon Choi, Scott Alfeld, Meiyi Ma
similarity 0.63
Abstract

There is a well-established body of work demonstrating that individual machine learning (ML) algorithms can be manipulated or deceived. However, in many real-world systems, multiple ML algorithms are composed to enable automated decision-making, particularly in Cyber-Physical Systems (CPS). Often such systems use a composition of vision, planning, and other ML models to affect their internal state and ultimate take actions in the physical world. While there is a huge literature on the (in)security of ML algorithms, it is not immediately clear how an attacker might leverage their ability to trick individual learners when attacking the composition as a whole. We develop methods for creating an attack policy (a mapping from state to attack) for a data-manipulating attacker affecting a CPS or other state-machine-based AI compositions. We describe our framework, a basic threat model and corresponding methods for computing an optimal attack policy, as well as planned extensions. The goal of this work-in-progress paper is to stimulate conversation and forge new collaborations regarding the security of compositional learning.

0.15

Inverting Self-Triggered Control: Adversarial Reinforcement Learning for Sparse Denial-of-Service Attacks

cs.LG eess.SY ·2026-09-10 ·Adam Haroon, Erick J. Rodríguez-Seda, Tristan Schuler, Cody Fleming
theory similarity 0.63
Abstract · 8 pages, 3 figures

Self-triggered reinforcement learning control (RL-STC) learns the sparsest control schedule that preserves Lyapunov-decreasing stability under a Run-Time Assurance (RTA) override. We invert this: an adversarial RL agent learns the sparsest jamming or Denial-of-Service (DoS) schedule that destabilizes the closed loop, with a Lyapunov-increase admissibility predicate mirroring the defender's safety certificate. We prove a plant-property lower bound on the minimum jam count required for an immediate hold-last medium-access-control adversary to force a crash against a self-triggered controller (STC) satisfying a Lyapunov contract, and recover a certificate-level analog of the consecutive-grouping optimality of prior count-budget DoS scheduling as a corollary. This extends the DoS-scheduling count-budget analysis from periodic and linear-time-invariant to STC controllers. Empirically, we train against four fixed defenders per plant (one Linear Quadratic Regulator (LQR) and three RL-STC) on Pendulum, CartPole, and Quadrotor2D. The learned adversary is the only adversary that crashes every defender on every plant at $100\%$: greedy misses Quadrotor2D LQR on $42\%$ of episodes and periodic misses Pendulum LQR on $97\%$. On jam-time-per-failure it beats baselines by up to $2.8\times$, and shows its widest absolute margin on Quadrotor2D LQR. Robustness ablations show that Gaussian observation noise exceeding the initial-state magnitude and position-only observation both preserve $100\%$ failure rate and keep the learned adversary strictly ahead of both baselines on jam-time-per-failure.

0.36

Model-Free Stealthy Attack on Vehicle Systems and Its Implications for ISO/SAE 21434 Risk Assessment

eess.SY ·2026-11-15 ·Qazi Mairaj ud din, Qadeer Ahmed
benchmark similarity 0.63
Abstract

This paper investigates a model-free stealthy adversary targeting in-vehicle networks and its implications for automotive cybersecurity risk assessment. Conventional stealthy false-data-injection (FDI) attacks often assume privileged knowledge of system dynamics, estimator parameters, or detector statistics, understating the feasibility of adversaries with limited system information. We develop a model-free FDI attack that uses a Vector Autoregressive model with Exogenous inputs (VARX), identified from passively recorded nominal measurements, to characterize a compromised channel and construct attack sequences within a data-calibrated residual envelope. The construction requires no vehicle dynamics model, estimator parameters, assumed noise distribution, or detector knowledge. In a closed-loop lane-keeping benchmark, the attack induces a 1.25 m lateral displacement, exceeding the specified 0.9 m half-lane width, and keeps the vehicle outside the lane corridor for 9.21 s. At a matched 1 % false-alarm operating point, attack-period alarm rates stay below 2.4 % across five learning-based intrusion detection systems (IDSs), a chi-squared residual monitor, and a liveness monitor, versus 66-100 % for conventional baselines. The proposed adversary matches the impact and evasion of a privileged model-based adversary while requiring 13 fewer attack-potential points, raising its assessed feasibility from Low to High under the considered ISO/SAE 21434 Threat Analysis and Risk Assessment (TARA). We further show that conventional impact-and-feasibility risk scoring can assign identical risk to attacks with substantially different detector responses, and introduce a detection-conditioned risk formulation to distinguish them. These findings highlight the importance of accounting for adversarial knowledge requirements and measured detectability when assessing risks in safety-critical vehicle systems.

0.04