CS Paper Radar

Dichoptic Foveation

Henry Kam, Colin Groth, Jenna Kang, Pratham Saraf, Qi Sun, Kenneth Chen

cs.GR cs.PF ·submitted 2026-09-14 21:50 UTC · v1
published

Abstract

Interocular differences in visual perception can induce a variety of effects when fused by the brain. For example, prior works have found that carefully crafted binocular differences in local detail can improve contrast. It has also been found that when the frequency content of two stimuli are slightly different, blur suppression leads to a fused percept that is typically dominated by the sharper image. In this paper, we develop a psychophysical framework to measure the perception of natural image stimuli with interocular frequency differences across the visual field. To this end, we study the effect of dichoptic foveation, which we define as the application of blur to one eye and a simultaneous sharpening filter to the other. Stimuli were viewed in a virtual reality (VR) head-mounted display (HMD) and placed at different retinal eccentricities. Study data were scaled to a perceptual just objectionable difference (JOD) scale, and a 4D model was fit to it; our results suggest that interocular frequency differences can be well described by a simple computational model. We applied the model in a realistic VR scenario with free exploration of 360° videos to improve a base foveated rendering system by enhancing high frequency information dichoptically.

Journal ref
SIGGRAPH Conference Papers 2026
DOI
10.1145/3799902.3811108

Closest papers

Nearest neighbours by meaning across the whole index.

Blind Stereoscopic Omnidirectional Image Quality Assessment Using Predictive Coding Hierarchy

cs.CV ·2026-08-28 ·Wei Zhou, André Kaup
top venue similarity 0.58
Abstract · IEEE TMM

Stereoscopic omnidirectional images (SOIs) have provided users with newly immersive quality of experience in virtual reality environments. However, developing efficient and accurate perceptual quality assessment metrics for SOIs remains challenging due to many factors such as freely changeable field of views and binocular vision. In this paper, based on the characteristics of the human visual system (HVS), we propose a Predictive Coding Hierarchy-inspired metric (PCH) for blind/no-reference stereoscopic omnidirectional image quality assessment. Motivated by the viewing process of SOIs, the proposed PCH includes a local cyclopean perception module, a global predictive perception module, and a visual quality regressor. First, observers browse different spherical sceneries from viewports, and aggregate the local visual information to infer the perceptual quality of SOIs. Therefore, we extract various viewports, followed by cyclopean conversion and saliency detection to approach the perception and attention of the human brain. After the local aggregation, viewers then infer the global scene in their minds. Based on the binocular mechanism, we fuse left and right views to perform predictive coding hierarchy modelling. Finally, the visual quality regressor is exploited to obtain the ultimate quality score related to both local and global perceptual cues. Extensive experiments demonstrate that the proposed PCH achieves competitive and consistently improved performance compared with state-of-the-art quality assessment methods.

0.39

Unpacking the process of watching a 360-degree video: How physiological responses and head rotation relate to affective and cognitive outcomes

cs.HC ·2026-10-30 ·Portia Wang, Yujie Tao, Monique Santoso, Jeremy Bailenson
similarity 0.56
Abstract

A defining feature of 360-degree video is that the perceptual experience is actively constructed. As viewers turn their heads, shift their gaze, and encounter changing visuals, their perceptual experience is not predetermined, but rather emerges through ongoing exploration. Yet, it is unclear how the process of watching immersive videos unfolds, and how it is related to psychological and physiological outcomes. We present a large-scale study (N=200) in which participants experienced one of 10 pieces of 360-degree videos in virtual reality. Results showed that greater head rotation was associated with greater valence, higher attention focus, longer length of subjective review, and lower simulator sickness; greater pupil dilation was associated with lower valence, lower review ratings, and greater use of negative tone in written reviews. A mediation analysis revealed that participants who rotated their heads more experienced greater frame-to-frame pixel-level perceptual changes in their field of view, which in turn resulted in greater valence and lower simulator sickness. Moreover, participants tended to rotate their heads toward field of view regions with greater perceptual movement, while directing their eye gaze toward less perceptually dynamic areas within that view. We outline theoretical and practical contributions for designing 360-degree content and predicting experiential outcomes.

0.14

Masking Judder in Foveated Rendering with Phase-Shifted Noise

cs.GR ·2026-10-07 ·Ville Cantory, Danhua Zhang, Victoria Interrante, Piotr Didyk
similarity 0.55
Abstract · 11 pages, 13 figures

Low framerates during rendering arise when frame time exceeds the rendering budget, or can be introduced deliberately to save computation, for example in foveated rendering, where the periphery can be rendered at a reduced spatial and temporal resolution. However, low frame rates also cause non-smooth motion, or judder, degrading perceived image quality. Judder manifests as aliasing in the spatiotemporal frequency domain; temporal filtering, such as blurring, can suppress it, but at an additional computational cost and incur a larger loss of detail. Prior work has shown that inexpensive synthesized noise can compensate for the loss of spatial detail and velocity perception caused by foveation, but its potential for restoring motion cues lost to reduced temporal resolution has not yet been explored. We show that such noise can itself restore these cues: translating a Gabor kernel reduces to a phase shift, and modulating a kernel phase creates a perception of smooth motion without having to fully rerender the noise. We derive a method that, given the on-screen angular velocity and the temporal rendering rate, selects a spatial frequency noise band such that phase shifts perceptually mask judder without introducing motion aliasing of their own. User experiments show that our technique substantially expands the range of angular velocities over which motion at reduced temporal resolution remains smooth, without objectionable degradation of image quality.

0.30

MetaSapiens v2: Advancing Real-Time Foveated Neural Rendering via Foveation-Aware Pruning and Stereo Warping

cs.GR ·2026-08-18 ·Weikai Lin, Yu Feng
similarity 0.54
Abstract · 14 pages, 20 figures, and 2 tables

Point-Based Neural Rendering (PBNR) is emerging as a promising class of rendering techniques, which are permeating all aspects of society, driven by a growing demand for real-time, photorealistic rendering in AR/VR and digital twins. However, achieving real-time PBNR on VR/AR devices is challenging. This paper proposes MetaSapiens v2, a PBNR system that delivers real-time neural rendering on VR/AR devices while maintaining human visual quality. MetaSapiens v2 combines four techniques. First, we present an efficiency-aware pruning technique to optimize rendering speed. Second, we introduce a Foveated Rendering (FR) method with an efficient primitive for PBNR, leveraging humans' low visual acuity in peripheral regions to relax rendering quality and improve rendering speed. Third, we leverage the redundancy between the two eyes and propose a selective warping method to further reduce the computation overhead in AR/VR binocular rendering. Finally, we propose an accelerator design for binocular FR, addressing the load imbalance issue in (FR-based) PBNR and supporting warping for efficient binocular rendering. Our evaluation shows that MetaSapiens v2 achieves an order of magnitude speedup over existing PBNR models while maintaining the visual quality.

0.38

Streaming across viewing conditions - The effect of viewing distance and display luminance on video quality

eess.IV cs.CVcs.MM ·2026-11-15 ·Dounia Hammou, Lukáš Krasula, Christos G. Bampis, Zhi Li, Rafał K. Mantiuk
unusual similarity 0.54
Abstract

The visibility of streamed video distortions is affected by the user's display and viewing conditions, such as their display's luminance or the viewing distance. Distortions become less visible at lower luminance levels or farther viewing distances. However, most image and video quality metrics assume fixed optimal display and viewing conditions, making them insensitive to the viewing conditions. In this work, we demonstrate how existing metrics can be adapted to account for both factors and compare such an adaptation with the metrics that natively model viewing conditions. First, we collected a new video quality dataset, HDR-VDC, which contains streaming distortions in 4K HDR videos. The dataset consists of 12 4K and 4 FHD HDR source video content, each distorted with AV1 encoding and Lanczos upscaling from a lower resolution. The quality loss due to the distortions was measured at two viewing distances, corresponding to 60 and 120 pixels per visual degree, and two display mean luminance levels, varying by a factor of 8 in terms of luminance. Next, we developed a pre-processing framework that lets us adapt many quality metrics so that they can evaluate content across the viewing distances and luminance levels. The framework employs a display model and perceptually uniform encoding, PU21, to account for the effect of display luminance, and perspective projection scaling (PPS) to account for the effect of viewing distance. We used the framework to compare the performance of 35 state-of-the-art metrics. This allowed us to identify a selection of existing quality metrics that can be effectively adapted to account for the viewing conditions.

0.31

Beyond Monoscopic Viewing: A Study on 3D Gaussian Splatting Quality in VR

cs.HC ·2026-09-29 ·Shreyas Shivakumara, Gabriel Eilertsen, Karljohan Lundin Palmerius
similarity 0.53
Abstract · 12 pages

Stereoscopy is fundamental to virtual reality (VR), providing depth perception through binocular viewing. Recent advances in 3D Gaussian Splatting (3DGS) enable high-quality novel view synthesis, making it well suited to immersive VR. We render 3DGS reconstructions stereoscopically and evaluate them in a head-mounted display, replicating how they would actually be viewed in VR. Real-world capture provides only a limited number of views, and under this constraint 3DGS reconstruction often produces localized floaters and misplaced structures. Standard metrics miss these localized artifacts, which become salient under stereoscopic viewing, where geometry is placed at the wrong depth. We investigate whether standard image-quality evaluation reflects the perceptual quality of 3DGS reconstructions under reduced capture. We compare SfM-only baseline with a union initialization that combines SfM with a dense VGGT network. All other training components are held fixed, isolating the effect of initialization coverage. We conduct a user study comparing preferences under monoscopic and stereoscopic HMD viewing, and test whether image-quality metrics predict the observed preferences. Monoscopically, preference for the more consistent reconstruction is weak, reaching 58.4\% overall. Stereoscopically, the same preference rises to 78.2\% and is consistent across all participants, while image-quality metrics (PSNR, SSIM and LPIPS) and stereo-aware metrics (iSQoe and StereoQA) show only modest differences and fail to penalize them. Our results indicate that monoscopic evaluation and standard image-quality metrics substantially underestimate perceptual artifacts observed in 3DGS reconstructions for VR, making stereoscopic assessment essential for 3DGS quality evaluation in VR.

0.19

From Mono to Stereo: Accelerating Binocular Gaussian Splatting via Reprojection and Selective Patching

cs.CV ·2026-09-25 ·Hongfei Zhu, Ling Zhou
similarity 0.53
Abstract

Binocular rendering requires two nearby views of the same scene and therefore repeats substantial visibility and shading work. We present a 2D Gaussian Splatting (2DGS) pipeline that fully renders a dominant-eye RGB image and an alpha-weighted depth proxy, reprojects that image to the affiliated eye, and repairs uncovered pixels. Small interior gaps are interpolated, whereas larger disoccluded regions are identified as regions of interest (ROIs) and selectively re-rendered. The depth proxy reuses the alpha-blending weights computed during dominant-eye rasterization, avoiding a separate depth-rendering pass. An adaptive ROI generator localizes the required updates using reprojected image boundaries and optional connected center-hole detection. On DTU, Tanks and Temples, and MipNeRF-360, the method reduces the measured time of a sequential two-pass binocular reference by 15.5\% to 28.8\% and peak GPU memory by 6\% to 11\%. The corresponding affiliated-eye quality degradation is at most 1.3 dB PSNR, 0.02 SSIM, and 0.02 LPIPS, representing a measurable trade-off that requires application-specific perceptual validation. These results establish a practical efficiency-quality trade-off for controlled static-scene stereo rendering and motivate future evaluation under continuous motion and on physical VR hardware.

0.20

Measurement-Guided Conversion of Laboratory Eye-Tracking Data for VR Authentication

cs.HC ·2026-10-21 ·Md Arif Shahriar, Mehedi Hasan Raju, Oleg V. Komogortsev
similarity 0.53
Abstract · 19 pages, 5 figures, 6 tables

Eye-movement authentication in virtual reality (VR) needs longitudinal training data, yet most such datasets come from lab trackers. We convert lab recordings to a VR headset's signal quality while keeping their eye movement, using only unpaired VR recordings of other people. Measurements show that the headset's added noise dominates above 7.8 Hz and that its quality is consistent within a person. A parametric device model re-creates the headset's sampling, a person-consistent calibration error and spectrally shaped noise, and a frequency-locked diffusion renderer re-textures that high-frequency noise. Converted GazeBase recordings match GazeBaseVR in noise level and accuracy, keep their source's saccade dynamics, and are harder to tell from real VR data than two prior conversions. An authenticator trained only on converted data verifies unseen VR users at a 5.9% equal error rate with 45 s of gaze, close to real VR training (5.8%); with 5 s, a gap remains.

0.31