CS Paper Radar

Queue-Aware ISAC Power Allocation Under Imperfect CSI: Integer-Service Analysis and Anchored Lyapunov Look-Ahead

Hanyi Sun, Yifan Zhou, Yixiao Gu

cs.NI ·submitted 2026-10-18 14:40 UTC · v1

Abstract

We study power allocation for a multiuser integrated sensing and communication (ISAC) downlink with bursty queues and imperfect channel state information (CSI). Starting from a long-run utility--backlog objective, we derive its common task reward and online score. Integer departures are represented by threshold events of indefinite Gaussian quadratic forms, accounting for estimation error in both signal and interference. Their moments give the conditional one-slot task reward and characterize the error of an efficient plug-in score. An anchored quadratic Lyapunov look-ahead corrects its reward-greedy action with a bounded nominal loss. Across five CSI-error levels, the rule reduces mean queue exceedance by 27.4--43.9\% (0.49--0.99 percentage points) relative to the plug-in maximizer, with mean reward loss below 0.01 per slot. The rule achieves higher reward and lower exceedance than DPP, SAC and PPO; its advantage over freshly retrained learning baselines extends to five configurations with 9--23 power-allocation variables using fixed candidate budgets. For the seven-variable system, a fused implementation reproduces all 25 confirmation trajectories and achieves a one-core p99 decision time of 0.274--0.311\,ms.

Closest papers

Nearest neighbours by meaning across the whole index.

Sense Once, Serve Many: Common-Trace Factorized Constrained PPO for Online Sensing-Session Consolidation in Multi-Tenant ISAC Networks

cs.NI cs.LG ·2026-08-29 ·Dang-Dung Vu
similarity 0.64
Abstract · 13 pages, 4 figures, 6 tables

Integrated sensing and communication (ISAC) networks can serve compatible requests through shared sensing sessions, but consolidation couples admission, reuse, profile selection, sensing service-level agreements (SLAs), communication quality of service (QoS), and future commitments. We formulate this problem as a constrained Markov decision process and propose Common-Trace Factorized Constrained Proximal Policy Optimization (CT-PPO). During training, stochastic policy replicas share the same primitive workload trace; leave-one-out discounted Monte Carlo return contrasts provide reward credit to applicable actor factors, while constraint credit remains factor/prefix-specific. Across five training seeds and matched workloads, CT-PPO achieves the highest mean macro return, exceeding matched Joint-Credit PPO (JC-PPO) by 0.934 (95% confidence interval [0.702, 1.164]) and SLA-Aware Greedy by 1.847; versus JC-PPO, it reduces sensing-resource cost by 6.277 and raises accepted requests per created session by 0.0806. A four-way ablation shows that the factorized surrogate alone yields no detectable macro-return gain, whereas adding common-trace reward credit produces the dominant improvement. Without retraining, CT-PPO retains a return advantage at low, nominal, and high arrival loads, with the strongest gain under clustered arrivals. Deployment uses public observations and hard masks; CT-PPO's extra parameters are training-side, its actor footprint matches JC-PPO, and actor-only CPU latency is effectively unchanged.

0.38

Resource allocation in Distributed ISAC Systems: A Location Sensitive Mode Selection and Task Assignment Framework

eess.SP ·2026-09-30 ·Kwadwo Mensah Obeng Afrane, André B. J. Kokkeler, Yang Miao
theory similarity 0.61
Abstract

In this work we propose a region of interest (ROI)-aware mode selection and task assignment (RAMSTA) framework for distributed integrated sensing and communication (ISAC) systems. In realistic ISAC use-cases, the sensing performance requirement can be location dependent. Vehicular targets at a traffic intersection, unmanned aerial vehicle approaching a restricted airspace or a sparsely populated areas may require different levels of detection or localization accuracy. This warrants the design of location sensitive resource allocation to account for the varying sensing performance requirements. Thus, we design a sigmoid-based ROI proximity parameter to tune the communication-sensing trade-off in a weighted sum rate and position posterior Cramér-Rao lower bound minimization problem. The resulting mixed-integer non-linear program is solved by applying a penalized convex-concave procedure. We show that the ROI sensitivity thresholds allows the adaptive variation of the communication-sensing trade-off with respect to the predicted location of the target and relative to a predefined ROI.

0.28

SLA-Aware Task Offloading in the IoT Edge-Cloud Continuum: Class-Weighted Deep Reinforcement Learning Against an Exact Optimum

cs.AI cs.LGcs.NI ·2026-11-07 ·Shilpa Golla, Tharun Kumar Korine Palli, Urmila Bandaru
benchmark similarity 0.56
Abstract

Deep reinforcement learning (RL) is often used to decide where Internet of Things (IoT) tasks with different latency limits run in the edge-cloud continuum, yet some methods give every missed task the same penalty and few compare their agents with an optimal policy. This benchmark study builds four offloading systems small enough to solve exactly by dynamic programming and measures reward and learner against the optimum. A bonus for a met limit makes each miss cost its penalty plus the bonus, which shifts the class weights of published per-class rewards. A class-blind penalty stays 65% to 118% above the optimal cost even with a perfect learner, while a corrected per-class penalty comes within 0.13% of the optimum. With a per-class reward, tuned proximal policy optimization (PPO) agents come within 9% to 11% of the optimum in the smallest system, and the corrected one beats a tuned reservation rule in 9 of 10 seeds. In larger systems the agents stay 41% to 76% above the optimum, and a tuned rule beats their mean. Training ten times longer does not close this gap, and a PPO-Lagrangian agent with reachable targets does no better than the per-class reward.

0.19

AERIS: Offline Policy Improvement for Multi-UAV Integrated Sensing and Communication

cs.NI cs.LG ·2026-08-26 ·Ziyuan Wang, Yifan Sui, Wei Wei, Wenjie Xin, Zekai Zhang +3 more
theory similarity 0.56
Abstract

Unmanned aerial vehicle (UAV)-enabled integrated sensing and communication (ISAC) is a promising 6G paradigm, but dynamic multi-UAV ISAC control must jointly balance communication quality, sensing reliability, and flight safety under stochastic mobility. Existing optimization methods often require repeated global non-convex solving, while online reinforcement learning (RL) depends on risky trial-and-error flights that may cause sensing loss or collision-risk events. This paper proposes AERIS, an offline policy improvement framework for multi-UAV ISAC. AERIS learns from fixed flight logs under centralized training and decentralized execution, so each UAV acts from local histories while training uses logged global information to assess team-level effects. We further design STAR-CRDT, an offline multi-agent RL algorithm that performs support-aware local action rectification and distills only trusted improvements into the decentralized actor. We prove an offline-support policy improvement guarantee. Experiments show that STAR-CRDT improves the main ISAC objective return by 29.3% over the strongest baseline. It further improves communication sum rate, sensing pass rate, and sensing margin by 3.4%, 4.8%, and 69.1%, while reducing collision-risk events by 54.2%. On unseen real-road maps built from OpenStreetMap data, STAR-CRDT still obtains the best return.

0.22

Detection-Aware Rate--CRB Characterization for Resource Allocation in ISAC Systems

eess.SP ·2026-10-01 ·Sana Mazahir, Hina Tabassum
similarity 0.55
Abstract · 13 pages, 7 figures

Integrated sensing and communication (ISAC) performance analysis commonly employs the Cramér--Rao bound (CRB) as the sensing metric. The CRB lower-bounds estimation-error variance under a target-present model but does not characterize the reliability of the energy detection that receivers often use to validate returns against noise and clutter. Considering the range CRB in a single-user, single-target joint power--bandwidth allocation problem, we establish the conditions under which a rate-optimal allocation at a given CRB requirement fails to achieve a given detection probability. We then develop detection-constrained rate--CRB characterizations at two levels: 1) a detection-aware (DA) formulation that treats the CRB and detection probability as parallel requirements, and 2) a detect--then--estimate (DTE) formulation using a \textit{detection-gated CRB} defined on frames that cross an energy threshold. We analyze the resulting changes in the optimal rate and feasible power--bandwidth allocations, and for DTE further show how detection probability and conditional estimation accuracy jointly determine downstream tracking performance. Multi-user, multi-target resource allocation is then formulated under CRB-only, DA, and DTE characterizations. The results show that CRB-only allocation can conceal inadequate detection reliability, and that accounting for detection and receiver architecture materially changes the power--bandwidth allocation and the communication--sensing tradeoff.

0.27

Current-Future Rate Tradeoffs in ISAC Under Random Path Changes

eess.SP ·2026-11-03 ·Hang Ruan, Zhaofeng Liu, Taneli Riihonen
similarity 0.55
Abstract · 6 pages, 5 figures

In mobile wireless links, motion changes path directions and visibility, and blockage can shift communication to a different propagation path. Integrated sensing and communication (ISAC) allows a base station (BS) to use echoes of data transmissions to monitor these changes and guide subsequent beam selection. Illuminating objects that govern future path availability may reduce the beamforming gain on the current communication route. Existing sensing-communication tradeoffs and dynamic beam-control frameworks do not directly quantify the future communication gain from this current-rate sacrifice. We quantify sensing value by the future-rate gain enabled by echo-adaptive beam selection. We derive explicit expressions for the future communication gain and the net gain after accounting for the current-rate loss. The analysis uses a coupled communication-echo channel with binary-state Markov motion over a finite burst informed by one processed echo. We show that monitoring is worthwhile when its future-rate gain exceeds the current loss, while more informative observations yield zero additional future rate if they cannot change any future optimal beam. We derive interpretable gain bounds exposing the roles of improved scene discrimination, motion memory and future beam-rate differences. Reciprocal-channel tests demonstrate positive net accumulated-rate gains from monitoring a moving blocker during reflected-path service, including continuous position uncertainty.

0.39

Hybrid Offline-Online Multi-Agent Decision Transformers for Wireless Resource Management

eess.SY cs.AI ·2026-08-28 ·Yiming Zhang, Kun Yang, Cong Shen, Dongning Guo
similarity 0.55
Abstract · 11 pages, 9 figures, 3 tables. Submitted to IEEE Journal on Selected Areas in Communications in Aug 2026. The offline training part was pres…

This paper develops a hybrid offline-online multi-agent reinforcement learning framework based on decision transformers. The policy is first pretrained offline via supervised sequence modeling of trajectories generated by existing policies, providing a safe and sample-efficient initialization. It is then fine-tuned online using a hybrid objective that incorporates critic-guided gradients, enabling performance improvements beyond the offline policy. To facilitate stable offline-to-online transfer and effective multi-agent coordination, the framework incorporates return-weighted sampling, a critic conditioned on neighbors' actions, and neighborhood-correlated exploration. The approach is fully distributed: both training and execution rely only on local observations and limited information exchange among neighboring agents. Evaluations with dynamic traffic arrivals in two settings: (i) joint scheduling and power allocation and (ii) coordinated beamforming, show that the proposed method achieves quality-of-service (QoS) performance comparable to centralized methods. Moreover, when pretrained on lower-quality datasets, online fine-tuning is also observed to surpass the initial offline policy. These results demonstrate a promising learning-based alternative for wireless resource management.

0.25

Reference-Dependent Utility Optimization for Goal-Oriented Communication Systems

cs.IT cs.NIeess.SP ·2026-11-09 ·Symeon Vaidanis, Photios A. Stavrou, Marios Kountouris
similarity 0.55
Abstract · This paper has been submitted for publication

Traditional communication resource allocation optimizes operational metrics such as rate, latency, energy efficiency, and reliability. Motivated by goal-oriented semantic communication, we develop a generalized allocation framework that transforms operational rewards through reference-dependent user utilities and evaluates them via expected utility, cumulative prospect theory (CPT), or related decision criteria. The formulation separates operational rewards, user-side valuations, and system-level decision criteria under uncertainty. We characterize utilities incorporating QoS/service reference levels, deficit sensitivity, post-reference saturation, and loss aversion. Weighted sum-reward maximization, proportional fairness, $α$-fairness, and stochastic expected utility maximization emerge as exact special cases, while soft QoS-aware allocation follows from a deficit-penalty generalization. For deterministic orthogonal systems, we derive utility-weighted marginal-reward KKT conditions characterizing global optimality under concave composite objectives. For nonorthogonal and stochastic systems, we develop successive convex approximation (SCA) algorithms and establish stationary-point guarantees under explicit smooth and composite nonsmooth assumptions, including a CPT branch-stationarity result under eventual nondegenerate ordering identification. For globally solved penalized problems, we derive an $O(1/λ)$ bound on excess aggregate soft-QoS deficit, and on the deficit itself whenever a QoS-feasible allocation exists. Additionally, we establish an $O(1/ε^2)$ outer iteration bound for the smooth fixed-step SCA best-response residual. Numerical examples demonstrate how reference points, marginal utility slopes, channel quality, and resource budgets influence active users and allocation policies.

0.24