CS Paper Radar

Enabling Versatile Human Sensing through Wi-Fi Beamforming Feedback

Jingzhe Zhang, Peiliang Wang, Yitong Shen, Ning Wang, Mingzhe Chen, Yili Ren

eess.SP ·submitted 2026-11-12 02:20 UTC · v1

Abstract

Wi-Fi sensing enables contactless human sensing, while most existing systems rely on Channel State Information, which is accessible only on a limited range of Wi-Fi chipsets. In contrast, Beamforming Feedback Information (BFI) is standardized in modern Wi-Fi and readily accessible on a wide range of commodity devices, offering new opportunities for human sensing. In this paper, we present BeamLens, a Wi-Fi sensing system that extracts fine-grained spatial information from BFI to enable versatile human sensing. Specifically, we jointly estimate the angle of departure and relative time of flight from BFI to extract fine-grained spatial information and leverage two AP-STA links to capture complementary azimuth and elevation views. We further design a sparse physical antenna array and construct a uniform virtual antenna array to enhance spatial resolution. Moreover, we fuse complementary views through self-supervised learning, combining temporally aware cross-view contrastive learning and temporal masked reconstruction to learn a versatile backbone for diverse human sensing tasks. Extensive evaluations demonstrate that BeamLens achieves 90.16\% accuracy in human activity recognition, a mean per-joint position error of 8.64\,cm in 3D human pose estimation, and 70.64\% intersection over union in human silhouette estimation, while exhibiting strong generalization to unseen environments and subjects.

Closest papers

Nearest neighbours by meaning across the whole index.

Physics-Informed WiFi Sensing for Robust 3D Human Pose Estimation in Mobile and Cross-Environment Settings

eess.SP ·2026-08-25 ·Kaixuan Huang, Yuanbo Chen, Guangjin Pan, Shiyi Mu, Tao Yu +2 more
similarity 0.68
Abstract · 12pages 6figures

Device-free human pose estimation using commodity WiFi signals has emerged as a promising paradigm for pervasive sensing in mobile computing systems. However, existing approaches often suffer from severe performance degradation when deployed across heterogeneous environments due to complex multipath propagation and domain shifts in wireless signals. In this paper, we present a physics-informed WiFi sensing framework for robust 3D human pose estimation under mobile and cross-environment settings. Our approach explicitly models wireless signal propagation characteristics and incorporates multipath-aware attention to capture environment-dependent signal variations. To further improve generalization, we introduce a disentangled representation learning scheme that separates pose-related features from environment-specific factors, enabling effective cross-domain adaptation without requiring extensive retraining. We implement our system using commodity WiFi devices and evaluate it on multiple public benchmarks, including Person-in-WiFi-3D and MM-Fi, as well as real-world deployments across diverse indoor environments. Experimental results demonstrate that our framework significantly improves robustness and generalization performance compared to state-of-the-art methods, particularly under cross-environment scenarios. These results highlight the potential of physics-informed wireless sensing for enabling reliable, scalable, and infrastructure-free human-centric applications in mobile computing systems.

0.12

WiNeRF: Measurement Constrained Radiance Fields for Actionable Wireless Channel Modeling

cs.NI cs.LG ·2026-08-24 ·Saif Ur Rahman, Rafid Umayer Murshed, Anton Dmitriev, Cagri Tanriover, Rahul C. Shah +1 more
published similarity 0.68
Abstract · Accepted to EWSN 2026

Wireless embedded systems increasingly rely on wireless channel information for decision making, yet practical platforms operate under severe constraints, including few antennas, narrow bandwidth, and sparse, noisy measurements. While neural field based approaches inspired by Neural Radiance Fields (NeRFs) have recently been explored for continuous wireless channel modeling, existing approaches depend on dense measurements or external priors such as known geometry, visual context, or angle-of-arrival (AoA) information, limiting their practicality in real-world deployments. We present WiNeRF, a neural field framework that learns a spatially continuous, complex-valued wireless channel representation directly from sparse channel state information (CSI) collected by commodity WiFi devices. WiNeRF embeds intrinsic system constraints, such as antenna geometry, limited spatial resolution, and phase uncertainty, as inductive biases through a 3D conical wave sampling model, a multi-resolution implicit scene representation, and a differentiable optimization framework for complex-valued channel learning. Across diverse indoor environments with non-line-of-sight (NLoS) regions, WiNeRF achieves a median prediction SNR of 5.3 dB, outperforming prior neural baselines by 4.9 dB on average (approximately 3x higher prediction SNR), and produces a task-agnostic channel representation that can be directly reused in standard signal-processing pipelines, including beamforming, AoA estimation, and RSSI coverage mapping, without modifying existing hardware or wireless protocols.

0.37

Look Before You Move: Multimodal Sensing-Aided Trajectory and Beamforming Design for 6DMA

eess.SP ·2026-11-04 ·Zeyu Hao, Wentao Yu, Lutz Lampe, Vincent W. S. Wong
similarity 0.65
Abstract · 13 pages, 9 figures

Six-dimensional movable antenna (6DMA) technology allows a base station (BS) to adjust the three-dimensional (3D) positions and 3D rotations, i.e., the 6D poses, of its surfaces. Many existing 6DMA designs select the poses based on prior channel knowledge. However, the channels at a new pose can be estimated only after the surfaces have moved to this pose, and the limited movement speeds of the surfaces restrict the poses reachable at the next time step. To address these challenges, we propose a learning-based multimodal sensing-aided trajectory and beamforming design for multiuser 6DMA systems with mobile users and surrounding objects. The BS observes the users and surrounding objects with RGB images, LiDAR point clouds, and GPS positions, independently of the poses of the surfaces. Since a surface may need several time steps to reach a favorable pose, the BS designs a 6DMA trajectory over several future time steps and executes only its first step, following receding-horizon control. We propose a neural network, in which user-centric cross-modal attention and temporal self-attention modules relate each user to the scene and its sensing history, and surface-to-user attention relates each surface to the users. A projection layer keeps the poses feasible under the geometric and kinematic constraints, and a graph attention module allocates the transmit power along the pilot-based beamforming directions. Performance evaluations using the CARLA driving simulator and Sionna ray tracing (RT) demonstrate significant minimum-rate gains of the proposed design over fixed-position antennas. Ablation studies validate the contributions of multimodal sensing and the proposed attention modules to these gains. The results further highlight the importance of designing the trajectory several time steps ahead, which is more beneficial under tighter speed limits of the surfaces.

0.29

Untangling the Geometry and Speed for RF Sensing Spectrograms

eess.SP cs.LG ·2026-09-22 ·Mert Torun, Darius Cuenca, Yasamin Mostofi
similarity 0.64
Abstract

A fundamental challenge in RF sensing is that Doppler signatures observed by a link entangle the target's motion with the sensing geometry, resulting in limited applicability to unconstrained real-world settings. In this paper, we establish a new foundation for physically interpretable RF sensing that disentangles reflector speed from geometry, jointly recovering the speed, geometry factor, relative amplitude, and width of each dominant Doppler ridge. More specifically, we first develop a compact parametric representation of WiFi spectrograms and establish its low-dimensional structure through a systematic computer-vision analysis of a large and diverse human-activity dataset, thereby providing a tractable foundation for learning. Building on this representation, we then design a physics-informed autoencoder whose structured bottleneck and differentiable RF forward model enforce physically meaningful estimates of reflector speed and geometry. We further introduce a synthetic-to-real training framework, eliminating the need for real WiFi training data. We extensively validate the proposed framework under both known and time-varying geometries, using both independently generated synthetic test sets and 31 real WiFi experiments. The results demonstrate the superior performance in speed and geometry extraction, robustly recovering the underlying geometry, speeds, Doppler-ridge amplitudes, and ridge widths across all settings, while substantially outperforming the strongest baselines.

0.10

Trajectory-Guided Tokenization of Complex CSI for Wi-Fi Sensing

cs.LG ·2026-10-05 ·Ziyi Wang, Kenuo Xu, Jichu Jiang, Yumeng Yang, Zheng Chen +6 more
similarity 0.64
Abstract

Wi-Fi channel state information (CSI) enables contactless presence detection and gesture recognition. Its high-dimensional complex-valued time series require input representations that preserve informative temporal variations during compression. We propose Trajectory-Guided Tokenization (TGT), which combines complex trajectory decomposition with asymmetric attention to construct compact continuous tokens. For each antenna link and subcarrier, an orthonormal Helmert transform decomposes short, ordered temporal patches into local-center and centered-trajectory coordinates. Keys are learned from the centered-trajectory coordinates, while values retain both components. Learnable queries aggregate subcarriers into frequency slots, which are fused into temporal tokens. Trained jointly from scratch, TGT with TokenMLP achieves the highest mean accuracy of 92.83% among all evaluated frontend-backend combinations on the self-collected dataset. Experiments on EHUNAM and Widar further support the applicability of TGT to cross-domain presence detection and gesture recognition.

0.32

Temporal vs Spectral Resolution in CSI Reporting for Wi-Fi ISAC

eess.SP ·2026-10-16 ·Abolfazl Zakeri, Sumit Roy, Nhan Thanh Nguyen, Markku Juntti
similarity 0.64
Abstract · Under review for publication

CSI feedback is fundamental to proposed uses of Wi-Fi sensing such as human activity recognition (HAR); but it also constitutes significant overhead as resources must be allocated away from data communications. Wi-Fi CSI extraction can be explored along two dimensions in IEEE 802.11bf: reporting intensity, i.e., temporal resolution, and number of reported subcarriers, i.e., spectral resolution. We explore periodic and IEEE 802.11bf threshold-based reporting at matched rates, and uniform decimation and block-mean grouping at matched report sizes. We further propose reporting the mean CSI accumulated since the last report. Using the 802.11bf report size as the metric, we evaluate the accuracy-cost tradeoffs on three public datasets with our proposed model, a convolutional neural network combined with a gated recurrent unit and temporal pyramid pooling. The proposed periodic reporting with mean payload and block-mean grouping improves accuracy by up to 53 percentage points at equal CSI overhead cost. Temporal resolution is generally more cost-effective than spectral resolution. With only at most 7.7% of full-CSI feedback cost, the proposed scheme achieves 96-98% of full-CSI accuracy.

0.23

Visual-Wi-Fi Navigation to Signal-Emitting Devices

cs.RO ·2026-10-08 ·Lihao Wang, Tianjian Xu, Tianmin Shu, Renjie Zhao
similarity 0.63
Abstract · Under review

Indoor navigation to task-relevant targets remains difficult when the target is small, occluded, or visually indistinct. Meanwhile, smart appliances, mobile devices, and IoT tags emit Wi-Fi signals during everyday communication, providing a pervasive but underused spatial cue. We study visual-Wi-Fi navigation, where a robot reaches a signal-emitting device in an unmapped environment using onboard visual observations and Wi-Fi packets overheard from the device, without connecting to the device or modifying infrastructure. Realizing this requires pose-dependent Wi-Fi observations during closed-loop policy learning and reliable spatial cues from bearing measurements corrupted by indoor multipath propagation on a moving robot. We present WiFiSpaces, which extends the Habitat embodied simulator with online ray-traced Wi-Fi sensing, rendering Wi-Fi observations for a robot-mounted antenna array at continuous poses during policy rollouts. On top of it, we build ViFiNav, a localization-aware navigation framework: an online source-localization algorithm exploits robot motion to disambiguate and robustly aggregate bearings from multiple viewpoints into a confidence-aware source estimate, and a learned policy fuses this evolving estimate with depth observations and learns to act on it as it is refined. Experiments show that exploiting robot motion is key to accurate source estimates, and that fine-tuning on ray-traced Wi-Fi observations in WiFiSpaces improves the success rate of ViFiNav. The policy transfers zero-shot to unseen scene datasets, and we deploy it on a real robot with a Wi-Fi sensor built from a commodity router, without any real-world training.

0.22

From Activity Recognition to Shift Detection: Variational Wi-Fi Sensing with Evidential Uncertainty

cs.LG ·2026-11-18 ·Luca Cotti, Marco Cominelli, Francesco Gringoli, Lance M. Kaplan, Mani B. Srivastava +5 more
benchmark similarity 0.62
Abstract · 17 pages,8 figures, 8 tables

Human motion perturbs wireless channels, making commodity Wi-Fi devices a practical platform for device-free activity recognition. Yet Channel State Information (CSI) also depends strongly on the person, receiver position, recording session, and surrounding environment, so a classifier can continue producing activity labels after its deployment conditions have moved away from those seen during training. We propose Wi-HAR, a multi-antenna architecture in which four Variational Auto-Encoders learn compact distributions from raw Wi-Fi 6 CSI magnitudes and a delayed-fusion classifier combines their means and log-variances. On twelve activities from a public benchmark, Wi-HAR reaches 96.6% median recognition accuracy, compared with 70.8-81.5% for independently optimized single-antenna models, showing that the antennas provide complementary views of the same activity. We then use the same latent backbone to detect deployment shifts without using shifted samples for model selection or calibration. A class-conditional uncertainty score derived from Evidential Deep Learning achieves a macro-average ROC-AUC of 0.897 across eleven datasets that change receiver position, participant, recording session, or room, and detects 82.5% of shifted samples at a realized 5.2% in-distribution rejection rate. Detection performance nevertheless varies substantially across receiver positions, showing that the same physical change does not induce a uniform uncertainty response. The compact representation also supports shallow decision-tree analysis using variables from several antennas.

0.24