CS Paper Radar

TrustAgent-RFF: Agentic Diagnostic Planning for Reliable RF Fingerprinting under Domain Shift

Chuan Liu, Tianya Zhao, Yiting Wang, Junqing Zhang, Xuyu Wang

cs.LG cs.AI ·submitted 2026-10-18 00:56 UTC · v2

Abstract

Radio frequency fingerprinting (RFF) models can achieve accuracy under source domain conditions but become unreliable when the receiver, distance, collection day, or environment changes. Incorrect predictions in unseen domains may receive high softmax confidence, making confidence thresholding insufficient for trustworthy deployment. We propose TrustAgent-RFF, a prediction level reliability framework for RFF that operates with a frozen in-phase and quadrature (I/Q) classifier without target domain labels. For each device prediction, the framework acquires radio frequency evidence: counterfactual stability, prototype consistency, acquisition domain similarity, and signal quality. A source calibrated trust estimator combines these diagnostics with classifier confidence, prediction margin, and evidence availability indicators. Source derived lower tail penalties and cross module interactions reduce trust when diagnostic signals indicate weak support. A large language model (LLM) based planner adaptively selects the next diagnostic action based on evidence, trust state, action costs, and remaining budget. A deterministic source calibrated decision layer updates the prediction state as Accept, Reject, or Defer. Experiments across five RFF datasets and classifier backbones reveal an average source to target accuracy drop of 38.7% and show that many incorrect target domain predictions remain highly confident.

Comment
10 pages, 6 figures, 7 tables. Submitted to INFOCOM

Closest papers

Nearest neighbours by meaning across the whole index.

Regime-Conditional Verification: Correctness Estimation for Adapting and Monitoring Safety Classifiers

cs.AI cs.CLcs.CRcs.LG ·2026-08-14 ·Thiago Sandoval, Ufuk Topcu
benchmarkcode/data similarity 0.60
Abstract · 18 pages including technical appendix, 6 figures. Project page and code: https://rcv.tsandoval.com

Safety classifiers deployed with large language models often fail for two reasons: their decisions reflect the policy learned during training rather than the deployer's desired policy, and their performance degrades as deployment traffic evolves. We present Regime-Conditional Verification (RCV), a lightweight wrapper that adapts an off-the-shelf safety classifier without retraining it. RCV estimates, from the classifier's internal representations, the probability that each prediction disagrees with the deployer's policy, and selectively corrects predictions likely to be wrong. The same correctness estimates also provide a label-free signal for detecting distribution shift, enabling a maintenance loop that updates the correctness estimation layer and resorts to classifier fine-tuning only when repair fails within a label budget. Across three off-the-shelf safety classifiers and two benchmark datasets, RCV improves adherence to the deployer's policy in every classifier-dataset combination, catching up to 0.81 of previously missed unsafe content without modifying the underlying classifier. In a deployment study with ten attack campaigns, each a harm category held out of RCV's training, RCV detects every campaign in a dedicated injection panel; in the maintenance census most drift episodes are repaired without updating the classifier, and the fine-tune is reserved for the residual episodes.

0.26

RFCheck: Synthetic RF Sensing Data Can Fail Measurement Consistency

eess.SP ·2026-08-10 ·Di Zhang, Yuanhao Cui, Tony Xiao Han, Xiaojun Jing
similarity 0.59
Abstract

Synthetic radio-frequency (RF) sensing data are widely used to augment wireless sensing tasks, yet their measurement consistency with real data is rarely evaluated under matched acquisition conditions. This paper identifies a measurement-consistency failure mode: synthetic samples may pass task-facing checks while deviating from the measurement behavior of real samples collected and processed by the same sensing pipeline, potentially introducing synthetic shortcuts and biasing downstream model selection. We propose RFCheck, a calibrated measurement audit that uses held-out real data from the same acquisition and preprocessing pipeline as the reference. RFCheck calibrates representation-specific tests on real samples and flags synthetic samples whose responses exceed the calibrated real-data range. We use the audit for candidate screening and residual repair. We validate RFCheck primarily on Wi-Fi channel state information (CSI), where the audit examines delay-domain and local frequency-domain structures. Experiments show that aggregate statistics and label-based screening can miss measurement failures detected by RFCheck. Under the same label acceptance rule, low-risk and high-risk synthetic candidates exhibit different downstream behavior. A repair reference reduces the flagged ratio to 10.83% while preserving mean task performance. In a held-out proposal study, correction followed by calibrated selection produces a class-balanced set with no flagged samples under a fixed training budget. We further apply the same calibration principle to frequency-modulated continuous-wave (FMCW) millimeter-wave radar gesture sensing. The results show that synthetic RF sensing data can violate measurement consistency even when conventional task checks are satisfied, motivating measurement-aware diagnosis and mitigation before augmentation.

0.04

RF-Agent: Hierarchical Language-Agent Control for Instruction-Conditioned Active Spectrum Sensing

eess.SP eess.SY ·2026-10-04 ·Hao Zhang, Dongfang Xu, Hang Zou, Anis Bara, Brahim Mefgouda +5 more
similarity 0.58
Abstract

Active radio-frequency (RF) sensing must acquire evidence under receiver limits while following confirmation, recovery, and stopping instructions. \newhl{We propose RF-Agent, a closed-loop architecture combining language supervision, episode memory, deterministic RF execution, perception feedback, and evidence-based reporting.} An independent auditor checks trajectory compliance. We derive acquisition and supervisory-request bounds, characterize full-history token complexity, and bound joint success by output validity and evidence capacity. \newhl{ActiveRF-AD tests instruction changes at fixed states and evaluates joint success, requiring compliance and RF correctness in the same episode.} \newhl{Training on different instructions at shared sensing states raises counterfactual-pair accuracy from 24.03\% to 96.22\% and Core joint success from 65.13\% to 72.12\%. Of the 6.99-point joint-success gain, 6.73 points reflect a decrease in the fraction of all episodes that are RF-correct but noncompliant.} \newhl{At Core budget three, paired-training hierarchical control achieves 66.60\% joint success versus 9.17\% for direct-action control.} \newhl{In a separate comparison at the same budget, RF-Agent improves joint success by 2.31 points and reduces RF acquisitions by 12.3\% relative to an initial-state planner, at increased inference cost.} Cross-backbone diagnostics cover three model families. These results show how instruction-responsive control improves task completion beyond what RF accuracy alone reveals.

0.24

PLSP (Pre-hoc Liminal Space Profiling): OOD Prediction over Detection -- An Anticipatory Approach for Machine Learning Model Reliability

cs.LG cs.CV ·2026-09-10 ·Vipul Bansal, Himanshu Buckchash, Balasubramanian Raman, Deepak Dhungana
published similarity 0.57
Abstract · 10 pages, 3 figures, 5 tables. Accepted at EUSIPCO 2026. v2: Added funding acknowledgment, copyright notice, and corrected affiliation for f…

Out-of-Distribution (OOD) data poses a significant threat to machine learning models, often leading to model failure during deployment. All existing OOD detection methods are post-hoc, relying on evaluation metrics such as accuracy and AUC-ROC during inference to indirectly assess the model's response to OOD data by measuring deviations. In contrast to existing approaches, the proposed work shifts the paradigm from OOD detection to OOD prediction by proposing a pre-hoc anticipatory framework called PLSP for OOD prediction. We make several key contributions: (a) a dataset-independent metric called the CREDibility Score (CREDS) is proposed for OOD prediction; (b) credibility curves are introduced to study the maximum credibility a model can attain; and (c) credibility heat maps (and volume under surface) are introduced to characterize pre-hoc model behavior across different datasets. This work provides a novel perspective on signal processing under distributional shifts. Experiments across multiple datasets demonstrate that the proposed metric serves as a valuable measure for improving the robustness of machine learning models toward OOD prediction.

0.32

From Probe Scores to Alarm Policies: Operational Validity of Activation Monitors for Language-Model Agents

cs.CL cs.AI ·2026-10-03 ·Xueping Gao
top venue similarity 0.57
Abstract · 12 pages, 1 figure. Accepted at the Eighth International Conference on Distributed Artificial Intelligence (DAI 2026)

Activation probes can predict safety-relevant properties of language models with high area under the receiver-operating-characteristic curve (AUROC), but deployed agent monitors make thresholded alarm decisions under tight false-alarm budgets. These are different estimands. We introduce an Operational Validity Contract that fixes a monitor's target, observability, identity, timing, intervention unit, comparator, calibration, and cost. We formalize risk at the semantic request or trajectory level: when one task contains repeated alarm opportunities, row-level AUROC and false positive rate do not identify semantic-unit any-alarm risk. A confidence-certified threshold also requires enough independent negative units, a tie-safe rule, and transport to deployment. Across Models Under Pressure, LASR refusal prediction, immutable AgentDojo, and a prospectively protocol-frozen ST-WebAgentBench replication, joint activation-observable monitors reach AUROC 0.957 and 0.935 on the first two benchmarks, yet their locked 5%/10% detection rates are only .642/.742 and .719/.782, respectively. On AgentDojo, the secondary mean-activation rollout monitor reaches AUROC 0.922 but detects none of 38 positive semantic cases at the locked 5% operating point; thresholds intended for 10% false alarms realize 18.7-20.0% on test. Because the test misses its prospectively frozen 40-positive support gate, we label it support-insufficient. On ST-WebAgentBench, activation reaches AUROC .874, but 23 independent calibration negatives cannot identify even a 10% controller; the locked policy abstains rather than reporting its mechanical zero FPR as a success. An exploratory counterexample also lowers full AUROC while improving realized 10% utility. The fail-closed compiler caps MUP and LASR at restricted predictive value and AgentDojo and ST-Web at representation accessibility; no setting reaches alarm-policy validity.

0.66

CorteXforge: Scenario-Based RF Dataset Generation on Real Testbeds

cs.LG cs.IT ·2026-10-19 ·Andréa Joly, Leonardo S Cardoso, Jean-Marie Gorce
similarity 0.57
Abstract

Deep learning for radio frequency (RF) signal analysis relies on large annotated datasets, yet synthetic datasets trade physical realism for controllability, while uncontrolled over-theair measurements offer realism but limited reproducibility. We present CorteXforge, a scenario-based framework for generating realistic and reproducible RF datasets on programmable software defined radio (SDR) testbeds. High-level RF scenarios are automatically translated into synchronized experiments executed on the SLICES-RI/CorteXlab platform, producing fully annotated Signal Metadata Format (SIGMF) datasets that capture hardware impairments and propagation effects. We validate CorteXforge through automatic modulation classification using ModForge, an over-the-air (OTA) dataset generated with the framework. Cross-domain experiments reveal a synthetic-to-real performance gap and show that synthetic pretraining remains beneficial for adaptation to OTA data. CorteXforge provides a practical foundation for reproducible RF dataset generation and future research on domain generalization.

0.27

IriSig-Spoof: A Real-World Benchmark for Time-Robust Satellite RF Fingerprinting and Spoofing Detection

cs.CR ·2026-08-19 ·Shichang Guo, Yuanyu Zhang, Shuangrui Zhao, Ji He, Pinchang Zhang +1 more
benchmarkdataset similarity 0.57
Abstract

Low Earth orbit (LEO) satellite Internet is becoming critical communications infrastructure, yet its open wireless links remain vulnerable to satellite impersonation and signal spoofing. Radio frequency fingerprinting (RFF) offers a potential defense by exploiting transmitter-specific hardware imperfections manifested in received signals. However, the reliability of existing satellite RFF methods remains difficult to assess because no unified dataset and benchmark support temporal, open-set, and cross-scenario evaluation. To address this gap, we introduce IriSig-Spoof, a real-world Iridium dataset comprising 5.17 million messages collected from 66 satellites over 32 days, together with software-defined radio (SDR)-generated spoofing signals from indoor and outdoor settings. We further establish three benchmark tasks: temporal robustness evaluation, open-set RFF identification with unknown-signal rejection, and cross-scenario spoofing detection. Experiments using a multi-scale attention convolutional neural network (MACNN) show that temporal robustness varies across configurations, with the best configuration achieving 97.75% average cross-day accuracy. In open-set evaluation, MACNN achieves an area under the receiver operating characteristic curve (AUROC) of 0.9715, while showing that effective unknown-signal rejection does not necessarily ensure reliable identity assignment. Cross-scenario experiments reveal differences at low false-positive rates. IriSig-Spoof provides a reproducible basis for evaluating robust RFF methods under temporal variation and changing attack conditions.

0.40

CSI-Agent: LLM-Assisted Few-Shot Adaptation for Cross-Domain Wi-Fi CSI Sensing

cs.AI cs.NI ·2026-09-25 ·Tianya Zhao, Chuan Liu, Xuyu Wang
similarity 0.56
Abstract · 10 pages, 6 figures, 5 tables. Submitted to INFOCOM

Wi-Fi channel state information (CSI) has enabled device-free sensing applications such as human activity recognition. However, CSI sensing models remain brittle in cross-domain deployment, where changes in users or environments can produce incorrect predictions. Existing solutions usually treat this problem as an offline model-design problem, by pretraining a stronger representation or applying one fixed adaptation method to the entire target domain. In practice, labeled target data are scarce and different classes may fail in different ways under the same domain shift. To address this, we propose CSI-Agent, an evidence-seeking LLM agent that reformulates cross-domain CSI adaptation as a deployment-time decision-making problem. Rather than processing raw CSI or making sample-level predictions, CSI-Agent summarizes target-domain behavior into sensing-grounded class-level evidence. It establishes a strong target-adaptive default from complementary CSI views and uses an LLM planner to determine whether each class should retain the default or invoke a specialized action. Deterministic verification and bounded execution further reduce unreliable interventions. We evaluate CSI-Agent on four public datasets using five cross-domain splits covering device, user, environment, and compositional shifts. Under 1-shot adaptation, CSI-Agent achieves the best target-domain performance across all splits and improves the average Macro-F1 by about 16\% compared to the strongest baseline method.

0.28