CS Paper Radar

Ultra-fast Neural Inference for Stochastic Gaussian Splatting Denoising

Chenxiao Hu, Hao Zhang, Yanchen Zhang, Meng Gai, Guoping Wang, Sheng Li

cs.CV cs.GR ·submitted 2026-09-22 02:51 UTC · v1

Abstract

Stochastic rendering eliminates the sorting and alpha blending process in Gaussian splatting, at the cost of introducing spatial noise. Formulating temporal denoising over the pixel stream shared by view-consistent stochastic splatting renderers, we propose a temporal neural denoiser validated on stochastic 2D Gaussian Splatting rendering, combining dual-path exponential moving average accumulation, per-pixel learned trust prediction for history validation, a fixed anisotropic spatial filter and a variance-gated composition with stabilization. The denoiser suppresses the noise, achieving temporally stable, visually compelling outputs during free camera navigation, all while retaining the sort-free, blend-free rasterization performance. The combined pipeline retains a PSNR gap to sorted alpha-blending renderers, but the denoiser's overhead stays below the time saved by removing sorting and blending.

Comment
Video supplements: https://youtu.be/avWpgs4P1s8; https://www.bilibili.com/video/BV1Jkhk6YEcE

Closest papers

Nearest neighbours by meaning across the whole index.

Gaussian Stippling: Efficient Sorting-Free 3D Gaussian Rendering through Hybrid Sampling and Spatiotemporal Reconstruction

cs.GR cs.CV ·2026-09-29 ·Zijian Huang, Suiliang Mai, Chuankun Zheng, Yuan Meng, Yuchi Huo
similarity 0.69
Abstract · Preprint

Conventional 3D Gaussian Splatting (3DGS) requires depth sorting and ordered alpha blending to correctly render overlapping Gaussian primitives. Stochastic transparency enables sorting-free rendering by replacing fractional alpha contributions with discrete stochastic visibility samples, but produces substantial spatial and temporal noise at low sample counts. We refer to this conversion from continuous Gaussian splats to discrete visibility samples as \textit{Gaussian Stippling}. Based on this, we present an efficient order-independent rendering and reconstruction framework that operates directly on unmodified 3DGS assets. Our method adaptively integrates primitive-based and fragment-based stippling, leveraging their complementary strengths across different rendering regimes to significantly improve rendering throughput. To recover high-quality images from sparse stochastic samples, we further introduce a lightweight Gaussian-aware spatiotemporal reconstruction network. By exploiting the Gaussian attributes retained by each stipple, the network aggregates structured stochastic clues across both space and time, effectively suppressing stippling noise. Experiments show that our hybrid Gaussian stippling method, coupled with a spatiotemporal reconstruction network trained on diverse scenes, generalizes to unseen scenes and enables interactive, temporally stable, and visually plausible rendering on mobile devices without retraining or preprocessing. With scene-specific training and appropriately scaled sampling and network capacity, our method further outperforms the baselines in visual quality, offering a high-fidelity configuration for quality-prioritized applications.

0.42

SteadySplats: Resampling of Low-Variance Gaussians for High-Fidelity Stochastic Rendering

cs.CV cs.GR ·2026-10-04 ·Felix Windisch, Thomas Köhler, Lukas Radl, Chris Wyman, Georgios Kopanas +2 more
similarity 0.68
Abstract

Stochastic order-independent transparency enables efficient and elegant rendering of primitive-based radiance fields like 3D Gaussian Splatting models, but remains impractical due to the inherent visible noise in the output. We propose a principled approach to minimize high-frequency noise, addressing its sources at the representation and image synthesis level. During stochastic rendering, our history-based spatial resampling scheme drastically accelerates image convergence, while temporal importance resampling ensures coherence under camera movement. During training, a color regularizer implicitly reduces the variance along view rays in the 3DGS models. With these properties, our optimized, Vulkan-based renderer effectively mitigates output noise at low and high sample counts, achieving a substantial 13~dB PSNR increase in quality over previous stochastic methods at 1 sample per pixel and quickly converging to sorted 3DGS with an average L1 error of less than $10^{-4}$.

0.35

Towards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering

cs.CV ·2026-08-22 ·Ankit Dhiman, Kunal A Kathare, Pranav Vignesh, Lokesh R Boregowda, Venkatesh Babu Radhakrishnan
top venuecode/data similarity 0.67
Abstract · Accepted to ECCV 2026. Project Page: https://maaf-4dgs.github.io/

Novel-view synthesis of dynamic scenes, crucial for AR/VR applications, remains a challenging problem. Recent methods adapt representations like 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) for dynamic scenes by incorporating time as the fourth dimension (4D representations). These 4D representations still suffer from aliasing artifacts, especially when generating novel views from divergent viewpoints (zoom-in/zoom-out operations). While using 3D smoothing filters like those proposed in Mip-Splatting might seem like a possible solution, they fail to account for local motion and also exhibit aliasing. To address this, we propose a motion-aware 3D smoothing filter specifically designed for 4D representations. Our approach adapts the filter strength based on local motion information, effectively mitigating aliasing without compromising rendering quality. This is achieved by estimating the joint density function of time and focal-to-depth ratio using a non-parametric estimation method. During inference, we sample from this joint distribution to determine the appropriate smoothing filter. This flexible strategy can be integrated with various 4D representations. Our evaluations on standard datasets demonstrate superior performance compared to state-of-the-art methods.

0.50

Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting

cs.CV ·2026-08-28 ·Yongqi Mao, Zijia Dai, Zhishuo Liu, Wei Xu, Kaiwei Wang +1 more
positioncode/data similarity 0.62
Abstract · Project page: https://yongxuqixiang.github.io/Manifold4D-Project-Page/

Video re-shooting is the task of re-rendering a monocular video of a dynamic scene along a user-specified camera trajectory. A dominant paradigm explicitly provides the target geometry by lifting the source video into a 4D point cloud using per-frame depth, and rasterizing this representation along the target trajectory to obtain point-cloud renders as geometric conditions for trajectory-controlled generation. The point cloud render and source video may provide conflicting visual cues throughout denoising, as both are directly used as conditions. We refer to this conflict as a trust dilemma, which can compromise trajectory control, 3D consistency of dynamic content, and visual quality, particularly under distribution shifts. We argue that because a point-cloud render is pixel-aligned with the target view, it does not need to be continuously provided as a conditioning signal throughout denoising. We propose Manifold4D, which injects the render directly into the initial noise of flow matching, so that generation no longer departs from standard Gaussian noise but from a geometry-bearing noise distribution that we term the point cloud rendered manifold, leaving the source video as the only visual condition. The render is thus used exactly once, and the network is never asked to learn how to read it; in subsequent denoising steps the model can focus on the source video. In our experiments, Manifold4D attains the best camera-control accuracy on every metric, lowering rotation error by 25--27% and translation error by up to 32% over the strongest baseline, while matching it in video fidelity and attaining the best overall photometric quality and 3D consistency of dynamic content.

0.20

UGOD: Uncertainty-Guided Opacity and Dropout for Sparse-View 3D Gaussian Splatting

cs.CV ·2026-09-30 ·Zhihao Guo, Peng Wang, Zidong Chen, Xiangyu Kong, Yan Lyu +5 more
similarity 0.62
Abstract · 31 pages, 5 figures, 10 tables. Supplementary material included at the end of the manuscript

Sparse-view 3D Gaussian Splatting is prone to overfitting because limited observations leave many Gaussian primitives weakly constrained, yet their contributions are still accumulated through alpha blending. Without uncertainty estimation, the renderer cannot distinguish unreliable primitives from well-constrained ones, allowing their erroneous contributions to corrupt novel-view synthesis. We introduce UGOD, an uncertainty-guided framework that estimates a view-dependent uncertainty score for each Gaussian and uses it to regulate its rendering contribution. A lightweight uncertainty head conditioned on Gaussian attributes and viewing direction predicts this score, which then drives a differentiable opacity-modulation mechanism that attenuates high-uncertainty primitives before compositing. During training, a detached soft-dropout branch applies an uncertainty-controlled continuous keep mask to discourage the model from relying on poorly constrained Gaussians and thereby reduce overfitting. Crucially, detaching the uncertainty score prevents gradients from this stochastic regulariser from biasing or collapsing the uncertainty prediction. Experiments on Mip-NeRF~360 and LLFF show that UGOD improves sparse-view novel-view synthesis while producing more compact Gaussian representations than the compared methods. These results demonstrate that Gaussian uncertainty provides an effective rendering-time control for sparse-view reconstruction.

0.16

Masking Judder in Foveated Rendering with Phase-Shifted Noise

cs.GR ·2026-10-07 ·Ville Cantory, Danhua Zhang, Victoria Interrante, Piotr Didyk
similarity 0.62
Abstract · 11 pages, 13 figures

Low framerates during rendering arise when frame time exceeds the rendering budget, or can be introduced deliberately to save computation, for example in foveated rendering, where the periphery can be rendered at a reduced spatial and temporal resolution. However, low frame rates also cause non-smooth motion, or judder, degrading perceived image quality. Judder manifests as aliasing in the spatiotemporal frequency domain; temporal filtering, such as blurring, can suppress it, but at an additional computational cost and incur a larger loss of detail. Prior work has shown that inexpensive synthesized noise can compensate for the loss of spatial detail and velocity perception caused by foveation, but its potential for restoring motion cues lost to reduced temporal resolution has not yet been explored. We show that such noise can itself restore these cues: translating a Gabor kernel reduces to a phase shift, and modulating a kernel phase creates a perception of smooth motion without having to fully rerender the noise. We derive a method that, given the on-screen angular velocity and the temporal rendering rate, selects a spatial frequency noise band such that phase shifts perceptually mask judder without introducing motion aliasing of their own. User experiments show that our technique substantially expands the range of angular velocities over which motion at reduced temporal resolution remains smooth, without objectionable degradation of image quality.

0.30

Parametric Gaussian Noise Mixer (PGNM): Unified Synthesis of Camera Noise and Film Grain

cs.CV ·2026-10-29 ·Mingyang Song, Martín Rodríguez Muñoz
code/data similarity 0.61
Abstract · Technical report, not submitted to any conference. 49 pages (9-page main paper, 40-page supplementary material), 29 figures, 33 tables. Code…

Noise synthesis is commonly approached through physical models of image formation or neural networks trained to generate noisy images. We explore a middle ground: an explicit statistical model fitted directly from paired clean and noisy images. A normalized convolution correlates a Gaussian field across pixels and color channels, and a lookup maps each Gaussian value to a residual given the clean intensity. Because the field stays standard Gaussian, the two components are fitted separately, without reproducing the physical process or training a neural generator. With one formulation for camera noise from SIDD and simulated film grain from Newson, the model has the lowest average distribution and correlation errors on SIDD among the evaluated methods and remains competitive on film grain. A denoiser trained on its noise comes closest to one trained on real noise, and a 1080p frame renders in 10 ms on GPU.

0.44

DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming

cs.CV ·2026-09-15 ·Idil Sulo, Alexey Supikov, Ilke Demir, Sainan Liu
similarity 0.61
Abstract

Streaming 3D reconstruction demands both speed and temporal fidelity, goals that existing methods undermine by updating every Gaussian every frame, even in static regions. We present DecoGS, a method for efficient online training of 3D Gaussians from streaming videos. Unlike prior methods that update the entire scene indiscriminately, DecoGS introduces an adaptive mechanism that selectively focuses optimization on spatiotemporal regions exhibiting motion or photometric changes. This targeted training strategy eliminates redundant updates that cause flickering and drift in nominally static regions, while enabling fast, high-fidelity scene updates. The pipeline further integrates region-aware Gaussian management through gradient gating and efficient visibility filtering to maintain temporal coherence and a compact memory footprint. On N3DV and MeetRoom, DecoGS achieves 34.55 and 31.60 dB PSNR respectively, outperforming all streaming and offline baselines, while rendering at 261 FPS with $70\times$ lower temporal flicker than the best prior method, requiring no large-scale pretraining.

0.20