CS Paper Radar

Masking Judder in Foveated Rendering with Phase-Shifted Noise

Ville Cantory, Danhua Zhang, Victoria Interrante, Piotr Didyk

cs.GR ·submitted 2026-10-07 19:16 UTC · v1

Abstract

Low framerates during rendering arise when frame time exceeds the rendering budget, or can be introduced deliberately to save computation, for example in foveated rendering, where the periphery can be rendered at a reduced spatial and temporal resolution. However, low frame rates also cause non-smooth motion, or judder, degrading perceived image quality. Judder manifests as aliasing in the spatiotemporal frequency domain; temporal filtering, such as blurring, can suppress it, but at an additional computational cost and incur a larger loss of detail. Prior work has shown that inexpensive synthesized noise can compensate for the loss of spatial detail and velocity perception caused by foveation, but its potential for restoring motion cues lost to reduced temporal resolution has not yet been explored. We show that such noise can itself restore these cues: translating a Gabor kernel reduces to a phase shift, and modulating a kernel phase creates a perception of smooth motion without having to fully rerender the noise. We derive a method that, given the on-screen angular velocity and the temporal rendering rate, selects a spatial frequency noise band such that phase shifts perceptually mask judder without introducing motion aliasing of their own. User experiments show that our technique substantially expands the range of angular velocities over which motion at reduced temporal resolution remains smooth, without objectionable degradation of image quality.

Comment
11 pages, 13 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Ultra-fast Neural Inference for Stochastic Gaussian Splatting Denoising

cs.CV cs.GR ·2026-09-22 ·Chenxiao Hu, Hao Zhang, Yanchen Zhang, Meng Gai, Guoping Wang +1 more
similarity 0.62
Abstract · Video supplements: https://youtu.be/avWpgs4P1s8; https://www.bilibili.com/video/BV1Jkhk6YEcE

Stochastic rendering eliminates the sorting and alpha blending process in Gaussian splatting, at the cost of introducing spatial noise. Formulating temporal denoising over the pixel stream shared by view-consistent stochastic splatting renderers, we propose a temporal neural denoiser validated on stochastic 2D Gaussian Splatting rendering, combining dual-path exponential moving average accumulation, per-pixel learned trust prediction for history validation, a fixed anisotropic spatial filter and a variance-gated composition with stabilization. The denoiser suppresses the noise, achieving temporally stable, visually compelling outputs during free camera navigation, all while retaining the sort-free, blend-free rasterization performance. The combined pipeline retains a PSNR gap to sorted alpha-blending renderers, but the denoiser's overhead stays below the time saved by removing sorting and blending.

0.33

Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering

cs.CV ·2026-08-22 ·Ankit Dhiman, Kunal A Kathare, Pranav Vignesh, Lokesh R Boregowda, Venkatesh Babu Radhakrishnan
top venuecode/data similarity 0.61
Abstract · Accepted to ECCV 2026. Project Page: https://maaf-4dgs.github.io/

Novel-view synthesis of dynamic scenes, crucial for AR/VR applications, remains a challenging problem. Recent methods adapt representations like 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) for dynamic scenes by incorporating time as the fourth dimension (4D representations). These 4D representations still suffer from aliasing artifacts, especially when generating novel views from divergent viewpoints (zoom-in/zoom-out operations). While using 3D smoothing filters like those proposed in Mip-Splatting might seem like a possible solution, they fail to account for local motion and also exhibit aliasing. To address this, we propose a motion-aware 3D smoothing filter specifically designed for 4D representations. Our approach adapts the filter strength based on local motion information, effectively mitigating aliasing without compromising rendering quality. This is achieved by estimating the joint density function of time and focal-to-depth ratio using a non-parametric estimation method. During inference, we sample from this joint distribution to determine the appropriate smoothing filter. This flexible strategy can be integrated with various 4D representations. Our evaluations on standard datasets demonstrate superior performance compared to state-of-the-art methods.

0.50

SteadySplats: Resampling of Low-Variance Gaussians for High-Fidelity Stochastic Rendering

cs.CV cs.GR ·2026-10-04 ·Felix Windisch, Thomas Köhler, Lukas Radl, Chris Wyman, Georgios Kopanas +2 more
similarity 0.61
Abstract

Stochastic order-independent transparency enables efficient and elegant rendering of primitive-based radiance fields like 3D Gaussian Splatting models, but remains impractical due to the inherent visible noise in the output. We propose a principled approach to minimize high-frequency noise, addressing its sources at the representation and image synthesis level. During stochastic rendering, our history-based spatial resampling scheme drastically accelerates image convergence, while temporal importance resampling ensures coherence under camera movement. During training, a color regularizer implicitly reduces the variance along view rays in the 3DGS models. With these properties, our optimized, Vulkan-based renderer effectively mitigates output noise at low and high sample counts, achieving a substantial 13~dB PSNR increase in quality over previous stochastic methods at 1 sample per pixel and quickly converging to sorted 3DGS with an average L1 error of less than $10^{-4}$.

0.36

CAVC: Convergence-Adaptive Audio-Visual Cache for Modality-Asymmetric Diffusion Generation

cs.CV cs.SD ·2026-10-22 ·Lifan Jiang, Yibo Zhao, Senlin cheng, Bolei Xu, Xiaobo Li +4 more
similarity 0.60
Abstract

Diffusion-based audio-visual generation methods typically perform joint denoising of audio and video latents throughout the entire sampling trajectory, repeatedly executing modality-specific denoising branches and cross-modal attention at every timestep. However, we observe that such uniform joint computation is not always necessary. The key is a modality-asymmetric recoverability: audio-side drift introduced by mid-stage caching can be substantially reduced by only a few terminal joint denoising steps, whereas video-side degradation caused by caching leads to persistent loss of motion and temporal details. This asymmetry suggests that inference acceleration should selectively cache recoverable audio-side computation while preserving full video refinement. Motivated by this observation, we propose \textbf{Convergence-Adaptive Audio-Visual Cache (CAVC)}, a training-free modality-asymmetric caching framework. CAVC adopts a sandwich-structured computation allocation: after detecting that audio denoiser outputs enter a cache-tolerant regime, it caches and reuses the audio denoiser output to bypass audio denoising and cross-modal attention in the middle stage, while the video branch continues independent spatio-temporal refinement; a few joint steps are then restored at the end to reduce accumulated cross-modal drift and improve synchronization. Experiments across multiple public benchmarks demonstrate that CAVC achieves 1.10--1.35x wall-clock acceleration, improves several visual dynamics and temporal statistics, and maintains competitive audio fidelity and audio-visual alignment.

0.06

TSRN-RTVD: Real-Time Video Deblurring System

cs.CV ·2026-10-06 ·Nikita Alutis, Danila Evsyukov, Egor Chistov, Mikhail Voronin, Evgeney Bogatyrev +1 more
similarity 0.58
Abstract

As video capture moves to handheld and edge devices, motion blur from camera shake has become a pervasive degradation that lowers perceptual quality and harms downstream vision tasks. The strongest deblurring networks recover impressive detail, yet they remain computationally heavy and overwhelmingly complex, so their quality comes at a cost that consumer hardware cannot pay in real time. This gap between restoration quality and on-device speed is exactly what makes real-time deblurring difficult. We developed and implemented TSRN-RTVD, an efficient video deblurring system that explicitly reconstructs the underlying camera trajectory during exposure and uses the recovered motion to guide restoration. This approach turns the physical cause of blur into a signal that drives sharpening. Our system runs on a single consumer GPU and restores the video at 30 FPS while reaching 30.08 dB PSNR on the GoPro dataset. We demonstrate TSRN-RTVD on consumer devices with interactive side-by-side visualization of the blurry input and the deblurred output, live throughput, and an on-screen view of the recovered camera trajectory. Demo video is available at https://youtu.be/3alMwVrVALU.

0.38

DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming

cs.CV ·2026-09-15 ·Idil Sulo, Alexey Supikov, Ilke Demir, Sainan Liu
similarity 0.58
Abstract

Streaming 3D reconstruction demands both speed and temporal fidelity, goals that existing methods undermine by updating every Gaussian every frame, even in static regions. We present DecoGS, a method for efficient online training of 3D Gaussians from streaming videos. Unlike prior methods that update the entire scene indiscriminately, DecoGS introduces an adaptive mechanism that selectively focuses optimization on spatiotemporal regions exhibiting motion or photometric changes. This targeted training strategy eliminates redundant updates that cause flickering and drift in nominally static regions, while enabling fast, high-fidelity scene updates. The pipeline further integrates region-aware Gaussian management through gradient gating and efficient visibility filtering to maintain temporal coherence and a compact memory footprint. On N3DV and MeetRoom, DecoGS achieves 34.55 and 31.60 dB PSNR respectively, outperforming all streaming and offline baselines, while rendering at 261 FPS with $70\times$ lower temporal flicker than the best prior method, requiring no large-scale pretraining.

0.20

Reconstruct What You Can: Distractor-free 4D Gaussian Splatting

cs.CV ·2026-11-12 ·Joel Julin, Liuyue Xie, Ananya Bal, Mose Sakashita, Koichiro Niinuma +1 more
published similarity 0.58
Abstract · Accepted at WACV 2027

Dynamic reconstruction from casual video must preserve valid subject motion while suppressing transient occluders, shadows, and volumetric effects. Existing methods either suppress valid motion through static-scene assumptions or model all observations jointly, producing ghosting and unstable geometry. We introduce ReCan-GS, a 4D Gaussian Splatting framework that separates coherent scene content from inconsistent observations. It derives a Jacobian-based deformation-sensitivity score from the learned deformation field, using it as an empirical proxy for reconstruction ambiguity. The score guides separation into dynamic Core Gaussians and per-view Distractor Gaussians, or post-hoc pruning of sensitive Core Gaussians. The same criterion supports removal of spatial occluders, photometric artifacts, and evolving smoke or fog without masks, pretrained segmenters, or medium-specific supervision. Experiments on synthetic and real dynamic scenes and synthetic smoke/fog scenes demonstrate its usefulness across the evaluated distractor regimes.

0.23

Frozen History: When Temporal Losses Stop Accumulation in Learned Real-Time Supersampling

cs.CV ·2026-10-11 ·Hao Yu, Guoying Zhao
code/data similarity 0.58
Abstract · 12 pages for main text

Learned real-time supersampling accumulates jittered low-resolution samples along motion vectors. Many methods use a temporal consistency loss to reduce flicker. We show that with accurate registration, this loss can suppress accumulation: on static content, the network copies its warped history at almost no temporal cost. Camera jitter in motion vectors raises this cost and can hide the effect. We identify four registration errors that training can conceal: jitter-carrying motion vectors, one motion field for both resolution lattices, jittered depth, and an unregistered skip path. A model-free oracle shows that correct registration makes freezing two orders of magnitude cheaper on static pixels. Controlled training shows that registration reverses the temporal weight's effect on PSNR. Under exact registration, increasing the weight reduces pixel variance at the expense of accuracy and perceived quality, with a 0.7 to 0.9 dB loss on static frames at weight 0.25. This reversal recurs across three network families and two scales; the loss also reduces accuracy on unjittered STSS data. With a small temporal weight and a normalised sample accumulator, a plain registered network improves the best published QRISP PSNR by 0.34 to 0.62 dB at $\times$2, $\times$3 and $\times$4 upscaling to 1080p. At $\times$2, its static pixel standard deviation is one quarter that of DLSS 2. Without retraining, it outperforms classical temporal upsampling by at least 4.4 dB on Arm's jittered Bistro capture. Our most accurate $\times$4 model runs in 2.03 ms per 1080p frame on an H200. Code: https://github.com/CV-AC/Frozen_history

0.47