CS Paper Radar

GradRig: Differentiable Weights for Skinned Gaussian Splat Deformation

Nina Vesseron, Élie Michel

cs.GR ·submitted 2026-09-04 13:27 UTC · v1
hot direction

Abstract

Skinned deformation is a common framework to turn a 3D shape from its rest pose into a dynamic pose through the deformation of a coarser kinematic structure, called rig. When applied to a 3D mesh, this rig only needs to displace vertices to deform the polygons that connect them. However, when deforming 3D Gaussian Splats, which do not provide connectivity information, rigidly transforming points is not enough to prevent the creation of holes when stretching shapes. In this paper, we use the spatial gradient of skinning weights to provide a full mesh-free deformation pipeline for Gaussian Splats, that more accurately stretches splats while remaining fully compatible with real-time rendering capabilities, which we demonstrate in a WebGL viewer. We present how we evaluate these gradients when the user creates the rig structure and propose an optional adaptive resampling scheme to split up splats that still produce artifacts.

Closest papers

Nearest neighbours by meaning across the whole index.

EvoGS: Modeling Deformation Evolution for Dynamic Gaussian Splatting

cs.CV ·2026-09-01 ·Wei Dong, Shahram Shirani, Jun Chen, Han Zhou
published similarity 0.63
Abstract · Accepted by Pacific Graphics 2026 (journal track)

Recent extensions of 3D Gaussian Splatting (3DGS) enable real-time novel view synthesis in dynamic scenes by learning time-conditioned Gaussian deformations. However, existing MLP-based methods typically estimate deformations independently at each timestamp, making them less robust to large or abrupt motions. To address this issue, we propose \textbf{EvoGS}, a 3DGS-based dynamic reconstruction framework that models Gaussian deformation as a temporal evolution process. EvoGS maintains persistent deformation states for each Gaussian, extrapolates future states from historical deformation states, and corrects the predictions with MLP-derived observations. The correction is adaptively weighted using a temporal residual memory and evolution statistics such as deformation velocity and trajectory deviation. To further improve reconstruction quality, EvoGS introduces deformation-aware densification. Clone and split operations are performed along corrected deformation directions, while an uncertainty-aware strategy suppresses densification for Gaussians with unstable deformation histories. Experiments show that EvoGS improves dynamic novel view synthesis quality and achieves competitive performance across benchmarks.

0.27

OCLDA-GS: Object-Centric Local Deformation-Aware Gaussian Streaming

cs.CV ·2026-11-17 ·Ashim Dahal, Nikesh Subedi, Rabab Abdelfattah, Nick Rahimi
similarity 0.63
Abstract

Streaming 3D Gaussian Splatting (3DGS) allows for online reconstruction of dynamic scenes from multi-view videos for Free Viewpoint Video (FVV). Current time and storage efficient methods rely on selecting a subset of anchor Gaussians and neighborhood interpolation for fast streamable 3DGS. However, these methods can overlook object-specific motion and introduce inconsistencies near object boundaries. We propose OCLDA-GS, an object-centric streaming framework that dynamically reallocates object and motion-aware Gaussian anchors to allocate anchor Gaussian support for objects undergoing large motion while at the same time, restricting the gaussian neighborhood within object groups for more precise object boundaries. Furthermore, it estimates object-wise rigid transformations (e.g. a hand moving) and leverages these estimates to learn per-anchor local deformation correction for small deformations (e.g. wrinkles on a shirt). Then, we conduct experiments on three dynamic multi-view video datasets and demonstrate improvements over the previous baselines alongside improved quality between refinement timesteps. Under matched refinement budgets, our method improves PSNR over Instant Gaussian Stream (IGS) by 0.169 dB on N3DV, 0.202 dB on Meeting Room and +0.199 on Google Immersive, while reducing the mean PSNR drop between refinement timesteps by 9.2% and 13.8% in N3DV and Meeting Room, respectively.

0.23

Perception Over Geometry: Rethinking Gaussian Allocation in Mesh-based Splatting

cs.GR ·2026-11-05 ·Yuting Wang, Yang Zhao, Shanding Diao, Penglin Wang, Yuan Chen +2 more
similarity 0.63
Abstract · 10 pages, 7 figures

3D Gaussian Splatting (3DGS) enables photorealistic novel-view synthesis but lacks explicit topology for geometric editing. Existing mesh-based methods enable geometric manipulation by associating Gaussians with triangular mesh faces, typically assigning a fixed number of Gaussians to each face. However, the representation capacity required for appearance reconstruction depends on local appearance complexity rather than merely on mesh tessellation density. To address these limitations, we propose P-MGS, a framework that separates appearance modeling from geometric control to achieve high quality rendering, compact representation, and flexible mesh editing. P-MGS introduces a perceptual complexity guided allocation strategy that distributes Gaussians according to surface appearance demand estimated from multiview observations. To preserve reconstruction flexibility, Gaussians are optimized without mesh constraints and subsequently associated with the original mesh through post hoc binding, retaining adaptive refinement while preserving mesh topology. During mesh editing, local affine deformation transfer updates Gaussian centers and covariances under mesh deformation, reducing misalignment and floating artifacts. Experiments demonstrate superior average novel view synthesis quality with fewer Gaussians and coherent mesh editing.

0.20

Elastic Triangle Splatting

cs.CV cs.CG ·2026-08-29 ·Tian Shi, Shenhan Qian, Daniel Cremers
similarity 0.63
Abstract

While neural rendering methods such as 3D Gaussian Splatting achieve remarkable visual fidelity, traditional polygonal meshes remain the backbone of established graphics pipelines. Triangle splatting bridges this gap by optimizing triangle primitives as differentiable splats, producing representations that are closer to mesh-based workflows. Central to these methods is the kernel function that softens triangle boundaries to propagate gradients to vertex positions. Existing triangle splatting methods make inconsistent choices of kernel functions, and analysis of these kernels' optimization behavior has been limited to unstructured triangle soups for novel-view synthesis. In this work, we consider triangle splatting as a generic tool for photometric optimization, comparing kernel properties through two complementary tasks: mesh optimization for shape reconstruction and triangle soup optimization for novel-view synthesis. Along with the analysis, we introduce an elastic kernel function that features bilateral gradient support across the boundary and an adaptive boundary value, which are shown to be essential for robust optimization. Under isolated comparison, our elastic kernel outperforms existing kernels on shape reconstruction and in the majority of novel-view synthesis benchmarks, demonstrating the importance of kernel design in the effectiveness and versatility of triangle splatting.

0.26

Dynamic Skinning: Kinematics-Driven Cartoon Effects for Articulated Characters

cs.GR ·2026-10-29 ·Damien Rohmer, Karim Salem, Niranjan Kalyanasundaram, Victor Zordan
publishedcode/data similarity 0.62
Abstract · 10 pages, 9 figures. Author's accepted version of the article published in IEEE Transactions on Visualization and Computer Graphics (TVCG), …

We present an extension to traditional rig skinning, like Linear Blend Skinning (LBS), to produce secondary motions that exhibit the appearance of physical phenomena without need for simulation. At the core of the technique, we call dynamic skinning, is a set of deformers which offset position of individual vertices as a function of position derivatives and time. Examples of such deformers create effects such as oscillation in response to movement and the appearance of wave propagation, among others. Because the technique computes offsets directly and does not solve physics equations, it is extremely fast to compute. It also boasts a high degree of customizability which supports a desirable artist workflow and fine level of control. Finally, we showcase the technique in a number of scenarios and make comparisons with the state of the art.

0.46

Spaghetti Splatting: Differentiating Curvilinear Dirac Masses via Convolution

cs.CV cs.GR ·2026-11-09 ·George Shramko, Shrisudhan Govindarajan, Rudy Lam, Yizheng Xie, Daniel Rebain +2 more
similarity 0.61
Abstract · 10 pages, 8 figures, 1 table

In production systems, 3D geometry is represented by primitives such as points, lines, and triangles, as rendering hardware is optimized to generate images from them very efficiently. Learning such primitives from images by volume rendering is challenging, as they are Dirac masses defined at infinitesimal locations in space. EWA splatting, Poisson reconstruction, and 3D Gaussian Splatting overcome this by convolving Dirac masses with a low-frequency kernel, a recipe that generalizes along two axes: the kernel and the primitive. As points and triangles have already received significant attention, we investigate this recipe for curvilinear primitives, and introduce Spaghetti Splatting. We approximate curves by polylines whose convolution converges to that of the continuous curve, and volume render each segment so that connected segments composite without overcounting at their joints. For fast training and inference, we linearize the camera projection per segment, which also accommodates kernels beyond Gaussians, such as Beta kernels. As a point is a curve of zero length, our representation is a strict superset of 3D Gaussian Splatting. It remains competitive with the state-of-the-art on general scenes, outperforms methods specialized to line-like geometry, natively supports anti-aliasing, and produces long connected strands that are directly amenable to physics simulation.

0.12

MGAvatar: Mesh-Bound Gaussians for Head Avatar Geometry and Appearance Modeling

cs.CV ·2026-09-11 ·Lei Shi, Sen Peng, Zhiyang Deng, Zhonggui Chen, Xiaohu Guo +2 more
publishedcode/data similarity 0.61
Abstract · 10 pages, 7 figures. Accepted to the Journal Track of Pacific Graphics 2026. Our project page is available at is available at https://bnbucv…

Accurate head modeling requires a stable yet expressive geometric representation. Existing Gaussian-based head avatars commonly rely on parametric templates (e.g., FLAME) for Gaussian initialization and deformation, but these templates lack personalized priors and struggle to represent structures such as hair and clothing. To address this issue, we propose MGAvatar, a Gaussian-mesh hybrid representation that jointly models geometry and appearance through two Gaussian-mesh binding modes. Specifically, we introduce vertex-bound Gaussians and constrain their learnable parameters, enabling progressive mesh deformation to represent complex head geometry, while a pose-dependent offset module accounts for non-rigid deformations. Once geometry is stabilized, MGAvatar switches to face-bound Gaussians for appearance modeling. To improve appearance consistency across novel poses and viewpoints, we introduce a view-conditioned neural color field that alleviates artifacts caused by independently optimized Gaussian colors. In addition, we design a Gaussian offset network to predict Gaussian offset maps in the observation space, providing greater flexibility for face-bound Gaussians to capture dynamic facial textures. Extensive experiments on multi-view and monocular videos show that MGAvatar outperforms existing methods in rendering quality, producing high-fidelity head avatars with rich texture details.

0.28

Love Handles: Decimation for Deformation Handles with Compact Support and Low Memory Footprints

cs.GR ·2026-08-18 ·David IW Levin, Paul Kry, Kartic Subr, Ryan Schmidt, Etienne Vouga +1 more
similarity 0.61
Abstract

Estimating the deformation of solids via physical simulation is an important problem spanning fields such as computer animation, engineering and robotics. Such simulations are computationally expensive and scale poorly when the representation of an object is refined by increasing the level of discretization. Reduced Order Methods (ROM) offer computational savings by decreasing the number of degrees of freedom, for example by using \emph{handles} that control groups of vertices. We present the first decimation-based algorithm for computing a sparse, compactly supported set of deformation handles. The crux of our method utilizes iterative algebraic simplification to optimize handle deformation to match any input deformation, such as linear vibration modes. This applies to any volumetric input mesh, including those with high genus or porous features, since we do not alter the geometry. We also devise an efficient algorithm to compute and update compact supports and their associated weights. We leverage compact support to develop an efficient, reduced-cubature computation scheme. Once optimized, our handles offer a memory-efficient solution while enabling real-time elastodynamics simulation of complex geometry. We show real-time performance on a variety of tetrahedral meshes with up to 796,623 tetrahedra.

0.23