CS Paper Radar

Tactile Search: Enhancing Targeting in 3D Space

Amber Maimon, Iddo Yehoshua Wald, Jonas Keppel, Eunhee Chang, Yoshifumi Kitamura, Stefan Schneegass, Rainer Malaka, Donald Degraen

cs.HC ·submitted 2026-09-05 04:07 UTC · v1
top venue

Abstract

Visual search is crucial in daily life, from scanning for relevant information to spotting signs of danger. When sensory channels are overloaded or degraded, cognitive tasks can be supported by crossmodal information representations through vibrotactile cues. We introduce Tactile Search, an approach that uses modulation of frequency and amplitude of vibrations to the hands, for guiding attention to the location of objects in 3D space. We evaluated this approach in a competitive VR game where participants searched for targets using both vision and touch. Across two studies -- an in-the-wild demonstration (n=55) and a controlled laboratory experiment (n=28) -- we found that vibrotactile feedback significantly improved performance and increased user confidence. In the combined haptic condition, performance did not differ across target heights. We further analyzed participants' subjective experiences and search strategies highlighting the benefits of the tactile cues. Our findings suggest that Tactile Search can enhance interaction and provide design considerations for integrating haptic search into interactive systems.

Comment
Accepted to the 2026 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2026)

Closest papers

Nearest neighbours by meaning across the whole index.

Comparing Haptic Feedback Across Hand Tracking and Controllers in VR Object Interaction Tasks

cs.HC ·2026-09-18 ·Natalia Ocampo, J. Felipe Gonzalez, Robert J. Teather, Kiyoshi Kiyokawa
published similarity 0.73
Abstract

Hand tracking offers natural VR interaction but lacks controllers' inherent tactile feedback, while haptic feedback across input methods remains understudied. We conducted a participant study comparing vibration, impulse, and no feedback in hand- and controller-based VR interaction across grasp-, pinch-, and tap-like gestures assessing performance, workload, and preference. A custom glove and controller-mounted device provided both feedback types, aiming for consistency across input modalities. Controllers were faster for grasp and pinch, whereas hand tracking was more accurate for pinch and preferred overall. Haptics had limited performance effects, although impulse reduced grasp accuracy with controllers. Participants preferred vibration and impulse over no haptic feedback, favouring vibration overall. Our findings reveal a more nuanced relationship between haptic feedback, input device, and interaction context than suggested by previous work.

0.36

Sharing Roughness with Hand-Outline Visualization to Reduce Sensory Asymmetry in VR Collaboration

cs.HC ·2026-08-29 ·Minju Baeck, Yoonseok Shin, Hyunjin Lee, Boram Yoon, Sang Ho Yoon +1 more
published similarity 0.70
Abstract · 10 pages, 8 figures, 9 tables. Accepted for publication in TVCG Special Issue on the 2026 IEEE Symposium on Mixed and Augmented Reality (IEE…

In collaborative VR, asymmetric access to haptic hardware creates a critical information gap: tactile evidence remains private to the haptic user, hindering the shared understanding needed for joint decision-making. While prior work has explored crossmodal sensory cues in virtual environments, it remains unclear how such cues should be designed for asymmetric collaboration, where collaborators receive information through different modalities. In our setting, the haptic user feels roughness through fingertip vibration, whereas the non-haptic user relies on vision alone. To reduce this asymmetry, we propose externalizing an object's tactile state through a glanceable hand-outline visual proxy. Specifically, we examine whether abstract visual roughness cues based on line shape and motion can encode three discrete roughness levels for both haptic and non-haptic users. Two preliminary studies establish a shared visual semantics by identifying visually distinguishable cues for non-haptic users and validating their visuo-haptic correspondence for haptic users. In a main study of a collaborative sorting task, showing this visualization on both users' hands significantly reduced completion time relative to a no-visualization baseline. Moreover, NU-side cue visibility was associated with higher confidence and perceived contribution for the non-haptic user. These findings show that hand-anchored abstract visual cues provide a lightweight means of externalizing object tactile state, reducing information asymmetry without compromising social presence.

0.17

An Affordable Vibrotactile Surface for Tactile Figure Recognition: Exploration Strategies of Blind and Sighted Users

cs.HC ·2026-11-17 ·Uday Nath Gunda, Arun Raman, Parthasarathy PD
hot direction similarity 0.69
Abstract

Refreshable tactile displays can make graphics accessible to blind and low-vision people, but high-resolution actuator arrays remain expensive. We study whether a low-cost vibrotactile surface can convey simple figures, and how they are read. Nine participants (four blind; five sighted, tested blindfolded then open-eyed) identified seven figures by touch, with video and timing analysis of their exploration. Blind and blindfolded-sighted readers achieved comparable accuracy, but blind participants were about three times faster, using a continuous, rhythmic "gliding" strategy-reading through motion, whereas sighted participants searched in halting, pause-heavy passes; among the sighted, more pausing accompanied errors. Recognition failures were concentrated in specific figures (a diagonal was misread even with vision), locating the bottleneck in representation rather than resolution. We contribute an empirical characterization of tactile reading strategies and design implications for low-cost refreshable tactile displays and affordable tactile representation.

0.25

Selfrionette: A Fingertip Force-Input Controller for Continuous Full-Body Avatar Manipulation and Diverse Haptic Interactions

cs.HC ·2026-11-02 ·Takeru Hashimoto, Yutaro Hirao
top venuehighly cited similarity 0.68
Abstract · 14 pages, 12 figures. Author-prepared version of the UIST 2024 paper. Both authors contributed equally

We propose Selfrionette, a controller that uses fingertip force input to drive avatar movements in virtual reality (VR). This system enables users to interact with virtual objects and walk in VR using only fingertip force, overcoming physical and spatial constraints. Additionally, by fixing users' fingers, it provides users with counterforces equivalent to the applied force, allowing for diverse and wide dynamic range haptic feedback by adjusting the relationship between force input and virtual movement. To evaluate the effectiveness of the proposed method, this paper focuses on hand interaction as a first step. In User Study 1, we measured usability and embodiment during reaching tasks under Selfrionette, body tracking, and finger tracking conditions. In User Study 2, we investigated whether users could perceive haptic properties such as weight, friction, and compliance under the same conditions as User Study 1. Selfrionette was found to be comparable to body tracking in realism of haptic interaction, enabling embodied avatar experiences even in limited spatial conditions.

0.61

Vibes on Demand: Adding Vibrotactile Encoding to Line Charts Shows Experiential Benefits Without Performance Costs

cs.HC ·2026-08-15 ·Anchit Mishra, Oliver Schneider, Matthew Brehmer
similarity 0.68
Abstract

Details on demand is a common design pattern in visualization design, especially useful when interacting with visually-saturated or small displays. Beyond visualization, another common approach for saturated displays is to incorporate other modalities, such as haptic feedback. While haptic rendering in visualization has primarily targeted accessibility needs, with haptics as a substitute for visual feedback, studies using haptics outside of a visualization context have shown value in experiential factors, such as increased confidence in ambiguous contexts and higher engagement. We explore vibrotactile feedback as a reinforcing information channel for communicating trends in details-on-demand tooltips on touchscreens. We identify preferred parameter configurations for our haptic encoding, informed by a study where participants identified parameter configurations that they perceived to most accurately reflect the dynamics of line charts appearing in tooltips. In a second study, we evaluated participant performance in a pairwise comparison task, finding that incorporating vibrotactile encoding improves involvement without affecting accuracy. We discuss the implications of these findings for future visualization design, and propose directions for applications and future studies.

0.04

Evaluating Tactile Encoding Strategies for Communicating 3-D Shape

cs.HC ·2026-11-10 ·MacKenzie C. Harnett, Rebecca F. Friesen
similarity 0.67
Abstract

Two-dimensional haptic displays, such as programmable pin arrays and vibrotactile or friction-modulating touchscreens, enable tactile communication of complex shapes in a low-profile form factor. However, many shapes of interest, including CAD models, three-dimensional graphs, and map topographies, are inherently three-dimensional. This work investigates two methods for encoding 3-D information using a 2-D tactile display: (1) a single tactile height map providing coarse but quantifiable depth cues, and (2) a series of binary layers communicating sequential slices of a 3-D model, supporting more complex geometries such as overhangs and cavities. We further compare performance across two display types--a friction-modulating display and a pin array--to examine how the level of haptic abstraction affects users' ability to decode discrete 3-D information. A user study demonstrates that participants were able to effectively complete a 3-D assembly task using both strategies, achieving high accuracy across all display types. While the pin array supported faster task completion and higher-rated--though not statistically significant--user experience than the friction-modulating display for the binary-layer task, these differences did not translate to significant differences in overall usability (i.e., reassembly accuracy success). Together, these results identify design trade-offs and inform development of future surface haptic displays that support the communication and interpretation of discrete 3-D information in tactile graphics.

0.12

ViHaTeleop: A Low-Cost, Lightweight Visual-Haptic Teleoperation System for Dexterous Manipulation Learning

cs.RO ·2026-08-17 ·Fucai Zhu, Yanhou Lai, Paul Maestre, Koichi Hashimoto
published similarity 0.65
Abstract · Accepted to the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 8 pages

Learning from demonstration is a promising approach for dexterous manipulation, but collecting high-quality contact-critical demonstrations remains difficult with low-cost teleoperation hardware. We present ViHaTeleop, a lightweight (0.7 kg), low-cost (\$550) visual-haptic teleoperation system with SLAM-based wrist tracking, camera-based hand tracking, and finger-wise vibrotactile feedback through Linear Resonant Actuators (LRA). The system includes several design choices (LED illumination, fisheye hand camera, and tactile-aware retargeting constraints) and is deployed on Franka + LEAP Hand + 9DTact in both real and simulated environments. Under matched with/without-haptic conditions with nine participants across six contact-critical tasks, haptics improved success rates across all tasks (+2.2 to +15.6 percentage points), while completion-time effects were task-dependent. Subjective ratings showed significant gains in contact clarity and grasp confidence in both simulation and real-world settings (Wilcoxon signed-rank, $p<0.05$). We also integrate a lightweight depth-camera-based tactile proxy in Isaac Sim, enabling a full pipeline from multi-modal demonstration collection to visual-tactile policy training. Preliminary downstream validation by training visual-tactile policies from collected demonstrations shows tactile cues benefit contact-critical subtasks (peg-in-hole: +17 percentage points over vision-only).

0.63

C-LISTEN: Cognitive Load Impacts of Sensory-Triggered Environmental Navigation in Virtual Reality

cs.HC ·2026-09-29 ·Md. Monowar Hossain, M. Rasel Mahmud
top venue similarity 0.64
Abstract · 6 pages. Published in AIVR 2026, The Third International Conference on Artificial Intelligence and Immersive Virtual Reality, Lisbon, Portug…

Nowadays, Virtual Reality (VR) systems are more helpful for making decisions, training, and rehabilitation. Multimodal settings in these systems impose a significant balance and cognitive difficulties. Additionally, decreased performance, higher cognitive load, user overwhelm, and limited accessibility of VR technology can be caused by excessive auditory, visual, and sensory stimulation. In our pilot study, we examine the strategic design of directional auditory cues to improve cognitive load and enhance user experience in virtual environments. This research also enhances fundamental knowledge that auditory feedback reduces cognitive load in VR, with statistical analysis confirming this improvement (p = .0011). This study investigates how postural balance and pupil diameter correlate with cognitive load while the users navigate. Moreover, this study provides realistic overview design guidelines for accessibility, which will make VR experiences safer and more useful for everyone, including people with cognitive impairments.

0.49