CS Paper Radar

Wireless Evidence Acquisition for Multimodal Inference Constrained by Temporal Windows

Alessandro Compagnoni, Anup Mishra, Carla Fabiana Chiasserini, Elad Michael Schiller, Petar Popovski

eess.SP ·submitted 2026-09-25 15:47 UTC · v1
hot direction

Abstract

Multimodal inference in safety-critical applications, such as autonomous driving and robot navigation, requires heterogeneous sensor observations to reach an edge server within a task-prescribed temporal window. Referenced to the event or state being inferred, this window ends at the latest time an observation remains useful for the current decision. Since sensor readiness times, data volumes, wireless channel conditions, and task relevance vary across sensors, maximising network throughput does not necessarily minimise the fused prediction error when the window closes. We cast multimodal uplink scheduling as sequential wireless evidence acquisition and, for a linear minimum mean-square error (LMMSE) fusion model, derive a conditional evidence gain metric from the reduction in residual-error volume. Defined through second-order statistics, this metric applies beyond Gaussian models and coincides with conditional mutual information when the target and prediction errors are jointly Gaussian. We then develop MIRA, a greedy task-driven maximum information-rate allocation policy that combines conditional evidence gain with each sensor's channel state information and remaining data volume, while updating sensor relevance as evidence is acquired. Experiments on synthetic classification, human activity recognition, and vehicle-trajectory regression show that MIRA outperforms both relevance-only and channel-only scheduling. Relative to the former, MIRA improves classification accuracy by up to 70% and reduces regression mean-square error (MSE) by up to 5.5%. Relative to the latter, it requires 58% less acquisition time to attain an 80% target accuracy, while achieving up to 95% higher accuracy and 9% lower regression MSE. These gains are achieved without maximising received-data volume.

Comment
5 pages, 4 figures, submitted to IEEE Communications letters

Closest papers

Nearest neighbours by meaning across the whole index.

Event-Inference Reliability for Physical AI over Wireless Networks

eess.SP ·2026-08-31 ·Anup Mishra, Petar Popovski
benchmarktheory similarity 0.65
Abstract

Wireless-enabled physical artificial intelligence (physical AI) systems call for a shift from reliable data delivery to reliable inference of physical events. The relevant question is not only whether packets arrive, but whether the set of cues available at the decision node, i.e., the evidence, is sufficiently timely and informative to support reliable inference about the event. Accordingly, this paper develops a framework in which event-inference reliability (EIR) is determined jointly by cue informativeness, cue availability, and temporal admissibility. The latter is determined by the downstream task requirement and represented through the usefulness horizon. We define event-inference error ratio (EIER) as the normalised residual event uncertainty after incorporating admitted cues, and EIR as the corresponding normalised uncertainty reduction, both conditioned on decision-node context. We further distinguish the evidence-limited Bayes benchmark from operational performance of a particular inference engine and derive an entropy-based lower bound on the minimum achievable event error from the same decision-node information. The framework then enables an event-aware wireless design interface for cue prioritisation, cue-reliability allocation, and event-inference coverage characterisation. A multiclass indoor activity-inference study combining empirical cue likelihoods with wireless delivery instantiates the framework and demonstrates how it characterises EIR under finite usefulness horizons.

0.50

Agentic Semantic Sensing for Resource-Adaptive AI-RAN

cs.AI eess.SP ·2026-10-06 ·Zhongqin Wang, Xiaoqi Zhang, Nan Yang, Kai Wu, J. Andrew Zhang +1 more
similarity 0.65
Abstract

Semantic sensing (SemS) acquires task-relevant information rather than reconstructing complete physical information. Existing SemS formulations typically operate open loop: sensing configurations and observation schedules are fixed before inference and cannot respond to evolving task-level evidence. We propose Agentic SemS, a closed-loop framework for AI-enabled radio access networks (AI-RANs) that controls sensing within a communication-feasible profile set. A profile-conditioned causal Transformer updates the semantic belief from streaming observations, while key-value caching enables efficient state updates across profile changes without repeatedly processing the complete history. A semantic utility network estimates the task-level benefit of acquiring the next observation block under each feasible profile after accounting for sensing cost. The resulting continuation utilities jointly support next-profile selection and semantic early exit, adapting sensing configuration and duration to evolving evidence. The expected semantic gain is further related to conditional mutual information, providing a value-of-information interpretation of continued online sensing. Experiments on Widar3.0 with six emulated sensing profiles show that, in comparison with full-sequence High, the resource-efficient Agentic setting reduces normalized cumulative sensing cost by 25.33% while achieving 85.79% Macro-F1. At the same utility checkpoint, semantic early exit provides a further 12.35% cost reduction over adaptive sensing without early exit, with a 0.97-percentage-point Macro-F1 decrease.

0.14

Joint Age-of-Latent and Resource Minimization for Wireless Multi-Camera Perception With Temporal Window Selection

cs.IT eess.SP ·2026-08-10 ·Chih-Yu Lin, Wanjiun Liao, Sumudu Samarakoon, Mehdi Bennis
similarity 0.64
Abstract · 13 pages, 10 figures, 4 tables

Multi-camera wireless perception requires a base station (BS) to maintain timely and reliable latent beliefs from distributed cameras under limited uplink resources. Conventional Age-of-Information (AoI) measures the age of the latest received update but not task-relevant latent content. We introduce Age-of-Latent (AoL) to quantify the freshness of each camera's latest decoded latent representation. A finite temporal window of integration (TWI) determines the task-commitment time and available uplink slots, creating a tradeoff among update opportunities, prediction duration, commit-time AoL, prediction reliability, and accumulated resource cost. Within this horizon, redundant or overlapping views enable correlated prediction, reducing reliance on the highest-cost communication and encoding configuration to maintain BS-side latent beliefs. We formulate a joint AoL-resource minimization problem coupling task-level TWI selection with slot-level encoder selection, scheduling, and NOMA power allocation under prediction-reliability constraints. We propose correlation-aware latent prediction for AoL minimization (CoLA), which uses Lyapunov optimization for task-level TWI selection based on AoL-resource cost and prediction uncertainty, and proximal policy optimization for slot-level resource control. Results on a warehouse multi-camera RF dataset show that CoLA adapts the TWI to camera-update availability and achieves the most favorable AoL-resource tradeoff among the benchmarks while maintaining prediction reliability, particularly under prolonged and severe camera outages.

0.38

Uncertainty-Guided Counterfactual Sensor Selection and Safety-Gated Recognition for Autonomous Sensing Agents in IoT Systems

cs.NI ·2026-10-26 ·Shirong Guo, Hongming Zhou, Muhammad Attique Khan, Jinfeng Xu, Yonis Gulzar +2 more
similarity 0.63
Abstract · 15 pages, 13 figures

Autonomous IoT systems rely on distributed sensing, but sensor faults and communication loss can leave multichannel evidence incomplete or unreliable. Their agents must therefore classify measurements, assess evidence sufficiency, select a sensor to reacquire, and hand off unsafe decisions. We formulate counterfactual sensing: a degraded window defines the factual state, each candidate restoration defines a controlled alternative, and a pre-request utility model estimates loss reduction. Physics-Guided Invariant-Kinematic Fusion (PGIK-Fusion) constructs class evidence, while calibrated risk and cost-sensitive utility select acceptance, sensor request, or handoff from factual information. On the Logistic Activity Recognition Challenge dataset, PGIK-Fusion achieves 0.768 accuracy and a macro-averaged F1 score (Macro-F1) of 0.696, exceeding extreme gradient boosting (XGBoost)--one-dimensional convolutional neural network (1D-CNN) fusion by 2.49 and 2.00 percentage points, respectively. Across seven predefined degradation conditions on held-out subjects, the policy reduces unsafe acceptance from 33.0% to 13.8%; relative to an action-rate-matched random policy, it raises automation accuracy by 18.5 percentage points and lowers expected cost by 24.7%. In the auxiliary within-event wind-turbine study, PGIK-Fusion reaches 0.975 Macro-F1, improves on XGBoost--1D-CNN by 1.17 percentage points, and reduces unsafe acceptance from 20.1% to 8.0%. The evaluation characterizes the controlled responses of a frozen recognition model to specified sensor restorations under predefined fault families and severities. Within this scope, the results demonstrate that calibrated recognition, targeted evidence acquisition, and conservative deferral can form a unified perception--action loop that reduces unsafe automation under sensor degradation.

0.28

Model-Free Runtime Measurement of Task-Relevant Information

cs.RO cs.AI ·2026-11-10 ·Dimitris Panagopoulos, Adolfo Perrusquía, Yang Xing, Weisi Guo
similarity 0.62
Abstract · 17 pages, 5 figures, 2 extended data tables, appendix included. Code available

Autonomous systems increasingly monitor physical kinematics, environmental states and task completion outcomes. While existing work provides methods to plan information seeking actions and interpret acquired observations, current approaches do not monitor whether the live process of information gathering is functioning properly. Consequently, such systems can remain operationally active without resolving outstanding mission requirements. To address this limitation, we introduce Acquisition-State Telemetry (AST), a model free architecture that evaluates ongoing information acquisition from observable evidence relative to declared task requirements. Specifically, a domain interface maps raw observations into task resolution coordinates and normalized comparative representations, which are processed by a fixed causal monitor. This monitor emits two continuous real time signals that quantify (i) prospective progress across unresolved requirements and (ii) informational friction generated when recurrent evidence yields negligible informational gain. We evaluated a single, unadjusted monitor configuration across eight diverse domains including search and rescue dialogue, spatial grid exploration, hierarchical capability acquisition, continuous robotic manipulation, and probabilistic intent estimation. We show that across these domains the friction channel distinguished unproductive stagnation from purposeful exploration prior to task completion, while remaining muted during post completion activity. Furthermore, in closed loop reinforcement learning experiments under early termination constraints, we demonstrate that penalizing informational friction allowed agents to sustain high mission success, whereas unpenalized policies and baselines with matched operational costs failed to complete required tasks.

0.19

Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies

cs.RO cs.CVcs.LG ·2026-09-02 ·Yue Yang, Diego Romeres, Chiori Hori, Gedas Bertasius, Daniel Szafir +1 more
benchmark similarity 0.60
Abstract

Vision-Language-Action (VLA) policies fuse multimodal sensory inputs, but training on limited and homogeneous robot demonstrations encourages spurious inter-sensor correlations rather than task-relevant signal, a failure we term modality entanglement. Under real-world occlusions and distractors, this manifests as nuisance sensitivity to corruption of uninformative sensors and single-modality insufficiency when only one informative sensor remains intact. We propose Evidence-Gated Regularization (EGR), a modality-agnostic training objective that introduces zero inference-time overhead. EGR derives a per-frame and per-sensor task-relevance signal to gate two state-conditional consistency objectives: invariance on low-evidence sensors, and single-sensor sufficiency on high-evidence ones. We introduce a benchmark based on BEHAVIOR-1K, comprising a fast inference-only diagnostic suite and 47 rollout-based skills targeting modality entanglement. We validate EGR on this benchmark and on two real-robot setups with fundamentally different embodiments: a bi-manual setup with two Kinova arms and three RGB cameras, and a single-arm MELFA ASSISTA setup combining vision and GelSight tactile sensors. EGR improves simulation success rates (SR) from 12.5% to 16.4% under full modalities (+31%), from 9.4% to 16.5% under uninformative-sensor corruption (+75%), and from 2.8% to 6.1% under single-sensor fallback (+120%). Under physical-object distractors, EGR boosts SR from 30% to 85% on the bi-manual setup (+183%) and from 55% to 70% on the tactile setup (+27%).

0.21

QoS-Aware Federated Learning for Multimodal In-Cabin Interaction in Smart Vehicles

cs.LG ·2026-09-17 ·Baran Can Gül, Mert Nakıp, Nasser Jazdi, Michael Weyrich
similarity 0.60
Abstract

Modern smart vehicles leverage multimodal sensors, ranging from high-bandwidth vision systems to low-rate physiological monitors, to provide personalized in-cabin services. However, integrating high-fidelity multimodal fusion with collaborative training is often hindered by the heterogeneous and time-varying Quality of Service (QoS) constraints of vehicular networks. Standard Federated Learning (FL) approaches enforce rigid synchronous rounds that fail to account for these resource asymmetries, leading to safety-critical timing violations and energy exhaustion. In this paper, we propose FedQoS, a novel asynchronous, event-triggered FL framework that decouples local computation from global communication via a two-phase gating mechanism. First, we introduce a resource-aware training gate that initializes local learning only when sensing buffers and energy reserves meet safety thresholds, preventing ML tasks from compromising core vehicle mobility. Second, a QoS-aware transmission policy gates uplink updates based on an efficiency score that balances model novelty against instantaneous latency and energy costs. Locally, clients optimize an objective featuring a staleness-aware proximal term that dynamically adjusts the global anchor strength based on update age. Extensive experiments on multimodal vehicular datasets demonstrate that FedQoS achieves competitive personalized accuracy with only marginal performance loss compared to FedAvg, while substantially reducing QoS violations, cutting communication overhead by 76.7\%, and lowering latency cost by 26.0\%, demonstrating a highly favorable accuracy and efficiency balance for real-world vehicular deployments.

0.07

Resource-Constrained Semantic-Aware Remote Estimation with Overlapping Sensor Coverage

cs.IT ·2026-09-07 ·Bowen Sun, Nikolaos Pappas
published similarity 0.60
Abstract

We study semantic-aware remote estimation of multiple finite-state Markov sources observed by K sensors with overlapping coverage. The sensors share a time-division multiple-access uplink and differ in transmission reliability, delivery delay, and transmission budget. In each slot, the scheduler jointly selects a source and one of its monitoring sensors, or remains idle, to minimize the long-run average cost of actuation error subject to global and per-sensor transmission-frequency constraints. We formulate this problem as a finite average-cost constrained Markov decision process. We show that the transmission resource functions have rank at most K, although the global constraint may still restrict the feasible region. Consequently, the Lagrangian depends only on K effective transmission costs, and an optimal constrained solution can be represented using at most K+1 deterministic policy-recurrent-class components. We further characterize the piecewise-affine concave Lagrangian value function and derive projected dual subgradient ascent over an explicitly bounded multiplier set. Numerical results illustrate the value-function structure, the need for policy randomization in a representative instance, and the interaction between global and per-sensor transmission budgets.

0.25