CS Paper Radar

Digital-Twin-Referenced Belief-Guided Q-Learning for Jammer Identification and Beam-Power Control in a mmWave Model

Parmida Geranmayeh, Onur Günlü

cs.IT cs.CRcs.GT ·submitted 2026-10-12 13:27 UTC · v2

Abstract

Next-generation wireless networks are expected to support high data rates and reliable connectivity while meeting requirements for energy efficiency, resource management, and communication security. Digital Twin (DT) technology represents expected network behavior and enables the actual network state to be assessed against it. Integrating DT technology with reinforcement learning (RL) supports adaptive resource allocation and security-aware decision-making. This paper presents a simulation-based DT reference and a belief-guided Q-learning (BGQL) method for joint jammer identification and beam-power control in a site-specific 28-GHz network model. Receiver-level residuals between attack-free and attacked configurations are combined with candidate spatial jamming footprints and accumulated into a normalized suspicion vector. BGQL incorporates this vector into its state, reward, and exploratory beam-selection rule. Compared with SARSA, Greedy, and Random across 30 paired Monte Carlo runs per configuration, with known jammer counts, BGQL achieves link-rate scores of 437.4-564.2 Mbit/s, rate-to-device-power scores of 60.37-76.79 Mbit/J, and localization recall of 100% for one jammer and 78%-81% for two jammers. BGQL requires 80-130 s per run versus 5-14 s for SARSA. These findings provide a matched-model simulation proof of concept for DT-referenced belief-guided learning for security-aware beam-power control in 6G networks.

Closest papers

Nearest neighbours by meaning across the whole index.

Digital Twin-Assisted Fast Beam Alignment for mmWave MIMO Networks

cs.IT cs.LGcs.NI ·2026-10-31 ·Muhammad Kamran Saeed, Ashfaq Khokhar
hot direction similarity 0.60
Abstract

Millimeter-wave (mmWave) communication relies on directional beam sweeping for initial access, which incurs substantial latency and signaling overhead as antenna arrays grow large and deployments become denser. Machine-learning-based beam prediction can reduce this overhead, but its effectiveness depends on training data that accurately reflects the deployment environment, a requirement that is difficult to meet in practice. This paper presents a latency-aware beam management architecture that integrates digital-twin-assisted prediction, regionbased localization, weighted ensemble learning, and explainability-driven beam pruning into a unified framework. A digital twin (DT) generates site-specific ray-traced channel knowledge offline, enabling environment-aware beam prediction without exhaustive real-world measurements and supporting both initial access and beam tracking. The proposed ensemble learning scheme combines a base classifier and a specialist classifier through reliability-weighted fusion to improve prediction accuracy and robustness, while explainable artificial intelligence (XAI)-based attribution pruning reduces the beam codebook to a small subset of the most informative beams for beam allocation. To capture the distributional mismatch between the DT and real-world environments: the network was trained on imperfect digital-twin data but evaluated on real-world surrobase data. Results show that the proposed method achieves 96.80% top-1 and 98.36% top-3 beam prediction accuracy, while reducing over-the-air sounding overhead by nearly an order of magnitude relative to exhaustive sweeping, outperforming convolutional and deep neural network baselines from prior work.

0.34

Indirect Estimation of SINR via SSB and CSI-RS RSRP in 5G NR

cs.NI ·2026-09-03 ·Leonardo Spampinato, Mahamadou Togola, Matteo Bernabè, Azim Akhtarshenas, Lorenzo Mario Amorosa +1 more
published similarity 0.58
Abstract

Predicting user equipment (UE) performance is essential for proactive network control, resource management, and digital twin sandboxes. However, the inherent flexibility and complexity of beam-based 5G new radio (NR) networks make accurate performance forecasting highly challenging. This paper proposes a data-driven approach to predict the average downlink signal-to-interference-plus-noise ratio (SINR) relying exclusively on standardized reference-signal measurements, namely synchronization signal block (SSB) and channel state information-reference signal (CSI-RS) reference signal received power (RSRP). We formulate this prediction as a supervised learning problem and evaluate various input feature representations using a third generation partnership project (3GPP)-compliant synthetic dataset. Our analysis reveals that filtering measurements based on active CSI-RS beams significantly enhances prediction accuracy while reducing input dimensionality. This activity-aware strategy demonstrates the strong viability of machine learning models for proactive network optimization.

0.37

Energy-Driven Evaluation of Network Digital Twinning Applied to mmWave Beam Management

cs.NI ·2026-09-28 ·João Borges, Bruno Castro, Kleber Cardoso, Andrey Silva, Aldebaro Klautau
similarity 0.58
Abstract

Network Digital Twins (NDTs) are important enablers of 6G and future networks. However, there is a lack of studies regarding practical aspects, such as the impact of simultaneously changing twinning rate, fidelity, and other NDT operational parameters. For instance, works often consider the impact of operational parameters in isolation or with physical twin (PTwin) implementations relying on simulations. Therefore, the main contribution of this work is to provide an in-depth study on the performance impacts of both twinning rate and fidelity, using PTwins that rely on measurements obtained from hardware. We also investigate the optimization of these two operational parameters to minimize energy consumption, exploring a Bayesian Optimization (BO) method and what-if analysis. In this work, the NDT models an indoor propagation environment to optimize beam management. The virtual twin (VTwin) was implemented with the Sionna ray tracing (RT) simulator and the PTwin with our in-house setup composed of customized Wi-Fi radios with 32 antenna elements operating at 60 GHz. The study reveals important aspects of wireless channel NDTs, suggesting that fidelity levels vary throughout the experiment and with the what-if difficulty. Moreover, the twinning rate can be adjusted using sample-efficient methods, such as BO, even at lower fidelity levels.

0.29

Model-Adaptive and Risk-Constrained Frequency Hopping Against Predictive Jammers

cs.LG eess.SP ·2026-09-06 ·Yanbo Chen, Xinjing Zhou
similarity 0.57
Abstract

Adaptive frequency hopping against predictive jamming must address both model uncertainty and policy exposure: the context-loss relationship may vary across operating regimes, while persistent hopping patterns may expose high-probability channels to attack. We propose D-PACT-AFH, a model-adaptive and risk-constrained adversarial contextual-bandit framework in which a Tsallis-FTRL master combines a global linear learner with a partitioned local learner and selects the model class online. D-PACT-Hit incorporates channel-wise marginal hit risk into model selection, while D-PACT-Safe applies a minimum-Kullback-Leibler projection to enforce a per-slot risk budget. We establish estimator validity under non-anticipating attacks, an oracle decomposition relative to the better fixed base, and an exact conditional-risk guarantee for the Safe projection. Experiments across diverse channel regimes and jammer types demonstrate effective model adaptation and a controllable goodput-risk tradeoff: D-PACT-AFH recovers 95.5% of the local learner's gain under observable switching while avoiding 77.7% of its degradation in a negative-control regime.

0.35

Safe World Model for Joint Trajectory and Beamforming Design of Mobile Base Stations

eess.SY ·2026-10-21 ·Abdolrasoul Sakhaei Gharagezlou, Zeinab Askari Donbeh, Mehdi Monemi, Matti Latva-aho, Mehdi Rasti
similarity 0.56
Abstract

Mobile base stations (MBSs), including aerial and ground-based platforms, provide flexible wireless coverage through adaptive positioning. However, jointly optimizing their trajectories and digital beamforming is challenging because movement changes channel conditions and interference, while beamforming determines the resulting signal and interference powers. These coupled decisions also account for how current movements affect future positions and communication performance under mobility and safety constraints. We formulate this problem as a constrained Markov decision process that maximizes the time-averaged sum signal-to-interference-plus-noise ratio (SINR), subject to mobility, obstacle region avoidance, and transmit-power constraints. To support long-term planning and reduce the extensive environment interactions required by model-free reinforcement learning, we develop a SafeDreamer-based world model framework that learns latent system dynamics from experience and optimizes a joint trajectory and beamforming policy through imagined trajectories. Feasibility-preserving action mappings and safety cost signals incorporate operational constraints into policy learning. Simulation results demonstrate that the proposed framework achieves higher time-averaged sum SINR than the proximal policy optimization and deep Q-network baselines, while exhibiting improved sample efficiency and more reliable constraint satisfaction.

0.28

Adaptive Hybrid Optical RF Transmission Based on Deep Reinforcement Learning for Ultra-Reliable Low Latency Communication

eess.SP ·2026-10-03 ·Stella N. Arinze, Isidore U. Uche, Augustine O. Nwajana
similarity 0.56
Abstract · 7 pages, 9 figures, 2 tables

Ultra Reliable Low-Latency Communication (URLLC) demands submillisecond latency and reliability above 99.999%, which are difficult to guarantee under dynamic wireless and atmospheric conditions. Although free space optical (FSO) links provide high-capacity transmission, their performance degrades under turbulence and fog, while radiofrequency (RF) links offer robustness but limited bandwidth. This paper presents a reinforcement learning-based hybrid optical RF framework that adaptively selects transmission modes to satisfy stringent URLLC requirements. The hybrid decision process is modeled as a Markov Decision Process and optimized using a Deep Q Network (DQN) controller. Extensive simulations under varying attenuation and fading scenarios demonstrate up to 35% latency reduction and 25 to 30 % throughput improvement compared to RF-only and static hybrid schemes, while maintaining reliability above 99.999%. A laboratory-scale testbed operating at 1550 nm and 28 GHz further validates the approach, showing less than 6% deviation between simulated and measured results. The proposed framework demonstrates the practical feasibility of intelligent hybrid transmission for mission-critical next generation wireless networks.

0.37

A Multiarmed Bandit Approach for LTE-U/Wi-Fi Coexistence in a Multicell Scenario

cs.NI ·2026-10-14 ·Iago Diógenes do Rego, José M. de Castro Neto, Sildolfo F. G. Neto, Pedro M. de Santana, Vicente A. de Sousa +2 more
publishedhighly cited similarity 0.56
Abstract

Recent studies and literature reviews have shown promising results for 3GPP system solutions in unlicensed bands when coexisting with Wi-Fi, either by using the duty cycle (DC) approach or licensed-assisted access (LAA). However, it is widely known that general performance in these coexistence scenarios is dependent on traffic and how the duty cycle is adjusted. Most DC solutions configure their parameters statically, which can result in performance losses when the scenario experiences changes on the offered data. In our previous works, we demonstrated that reinforcement learning (RL) techniques can be used to adjust DC parameters. We showed that a Q-learning (QL) solution that adapts the LTE DC ratio to the transmitted data rate can maximize the Wi-Fi/LTE-Unlicensed (LTE-U) aggregated throughput. In this paper, we extend our previous solution by implementing a simpler and more efficient algorithm based on multiarmed bandit (MAB) theory. We evaluate its performance and compare it with the previous one in different traffic scenarios. The results demonstrate that our new solution offers improved balance in throughput, providing similar results for LTE and Wi-Fi, while still showing a substantial system gain. Moreover, in one of the scenarios, our solution outperforms the previous approach by 6% in system throughput. In terms of user throughput, it achieves more than 100% gain for the users at the 10th percentile of performance, while the old solution only achieves a 10% gain.

0.60

Benchmarking Unsupervised Jamming Detection in 5G Open RAN

cs.AI cs.LG ·2026-11-03 ·Sneihil Gopal, Fernando J. Cintron, Richard A. Rouil
similarity 0.55
Abstract

Radio Frequency (RF) jamming threatens fifth-generation (5G) networks. Open Radio Access Network (Open RAN) telemetry enables jamming detection without dedicated spectrum monitoring equipment, but labeled attack data are rarely available across deployments, motivating unsupervised detectors. Comparing such detectors across algorithmic families, however, remains difficult without ground-truth labels. This paper benchmarks statistical and reconstruction-based unsupervised jamming detectors using a symmetric evaluation interface that combines detection confidence and temporal interval coherence into a detector-independent composite score. We compare a Statistical Ensemble Method (SEM) detector against Vanilla, Long Short-Term Memory (LSTM), and Variational Autoencoder (VAE) baselines on Key Performance Indicator (KPI) telemetry from ten heterogeneous 5G environments with fixed and variable jamming bursts and dynamic jammer gains. Under leave-one-out (LOO) evaluation, SEM achieves a mean composite score of 0.906, compared with 0.688 for the best autoencoder (AE) per fold. Ground-truth validation yields a mean F1-score of 0.918 for SEM, compared with 0.521 for the best AE variant. The composite ranks SEM first in all environments, consistent with F1 rankings. However, in both within-trace and cross-trace evaluation, it fails for detectors that flag far fewer samples than the jamming prevalence, indicating that rankings are reliable only when detection rate matches the expected prevalence.

0.19