CS Paper Radar

A Regularity Condition Under Which a CPAB Transformation is a Diffeomorphism

Amit Aflalo, Oren Freifeld

cs.CV ·submitted 2026-10-23 08:59 UTC · v1
unusual

Abstract

Continuous Piecewise-Affine Based (CPAB) transformations, introduced by Freifeld et al. (2015, 2017), are flows obtained by integrating continuous piecewise-affine (CPA) velocity fields. These expressive transformations have proven useful in applications including nonlinear temporal warping and trainable activation functions in 1D, as well as nonrigid spatial deformations in 2D and 3D. While computational costs were not an issue in 1D, they originally limited the practical expressiveness of CPAB transformations in higher dimensions, especially in 3D. Our recent work (Aflalo et al., 2026) removed this bottleneck, enabling efficient optimization with much finer tessellations and substantially greater expressiveness. There is, however, a mathematical subtlety that was overlooked in the original CPAB papers (Freifeld et al., 2015, 2017). CPAB transformations are always bi-Lipschitz homeomorphisms, implying that both the transformations and their inverses are differentiable almost everywhere. They are not, however, necessarily diffeomorphisms. This note remedies the omission by identifying sufficient regularity conditions under which a CPAB transformation is guaranteed to be a diffeomorphism. We explain how differentiability can fail and how the proposed conditions prevent this failure. In 1D and 2D, we show that these conditions can be easily enforced and, for commonly used tessellations, hold with probability one under standard sampling assumptions. We expect analogous behavior in 3D.

Closest papers

Nearest neighbours by meaning across the whole index.

Factorized Gradients for Scalable Highly-expressive Parametric Diffeomorphisms

cs.CV ·2026-10-26 ·Amit Aflalo, Eran Treister, Chaim Baskin, Oren Freifeld
top venue similarity 0.79
Abstract · Accepted by NeurIPS 2026

Diffeomorphisms provide a flexible, topology-preserving mathematical tool for modeling complex spatial or temporal deformations and are used in various scientific fields. However, making these deformations simultaneously highly expressive and computationally efficient remains challenging. Continuous Piecewise-Affine Based (CPAB) transformations (Freifeld et al., ICCV 2015; IEEE TPAMI 2017) offer an attractive solution by parameterizing a family of diffeomorphisms via continuous velocity fields that are piecewise affine with respect to a chosen tessellation of the domain. Importantly, $d=\dim(θ)$, the dimension of the parameter vector $θ$, depends on the fineness of the tessellation rather than on the data resolution. Despite this compact parameterization, CPAB optimization has long been hindered by the tight coupling between trajectory integration and gradient computation with respect to $θ$. We introduce FG-CPAB, a factorized-gradient formulation for scalable CPAB transformations. By separating integration from parameter-space projection, our method reduces gradient computation complexity from $\mathcal{O}(dTN)$ to $\mathcal{O}(TN+dC)$, where $T$ is the number of integration steps, $N$ is the number of transformed points, and $C$ is the number of tessellation cells. This reformulation yields speedups of up to four orders of magnitude (e.g., $\approx 10^4\times$ in 2D), substantial memory savings (e.g., $\approx 500\times$ reduction in peak GPU memory usage in 2D), and dramatically higher expressiveness. This makes fine-tessellation CPAB practical in 2D and 3D for the first time, enabling highly expressive parametric diffeomorphisms.

0.49

Two-Parameter Flow Map Learning for Continuous-Time Diffeomorphic Image Registration

cs.CV ·2026-09-09 ·Mohammadjavad Matinkia, Nilanjan Ray
top venue similarity 0.57
Abstract · Published at European Conference on Computer Vision (ECCV), 2026

Diffeomorphic image registration is central to medical image analysis, enabling anatomically consistent alignment across subjects. Most learning-based diffeomorphic methods model autonomous ODEs(ordinary differential equations) by parameterizing a stationary velocity field and recovering deformations via scaling-and-squaring. While non-autonomous ODEs with time-dependent velocities increase expressiveness, existing approaches rely on numerical integration to implicitly enforce flow structure that entangles model expressiveness with discretization accuracy. We propose a framework to directly learn the continuous-time solution of a non-autonomous ODE formulated as a two-parameterflow map. By enforcing cocycle consistency, a fundamental structural property of time-varying flows, we learn the flow maps without time discretization and velocity integration during training. The framework recovers diffeomorphic mappings at inference using a small number of compositions. Our proposed framework seamlessly incorporates standard registration backbones and improves alignment accuracy consistently across nine datasets while preserving diffeomorphic structure. Notably, the proposed method achieves an average Dice improvement of 2.1% on brain MRI benchmarks, a 12% TRE reduction on lung CT, and a 2.6% Dice gain on cardiac MRI and ultrasound datasets.

0.46

Certified folding-free deformable image registration: A whole-cell Jacobian certificate and a sequential variational solver

cs.GR math.AP ·2026-11-03 ·Baihan Zhao, Zicong Zhou, Guojun Liao
similarity 0.55
Abstract · 51pages

Registration maps propagate labels, measure local volume change, and map results back through their inverses; requiring invertibility. Voxelwise checks can miss folds between grid points. We study the canonical continuous extension of a nodal displacement field by trilinear interpolation and give a test that proves its Jacobian determinant positive in every grid cell or rejects the map. The test is rigorous under IEEE 754 binary64 arithmetic (correct rounding, no contraction). With a fixed boundary, certification implies a bi-Lipschitz homeomorphism of the image domain. We introduce SeqVP, built around this certificate. A proximal Jacobian-determinant-curl formulation yields inner problems whose penalties on changes in the map, Jacobian determinant, and curl vanish to first order at the current iterate. The method decreases a fixed outer energy up to a floating-point resolution guard and certifies every committed iterate. After certified initialization, stopping at any time returns a folding-free map. A Poisson-preconditioned gradient method with Jacobian-aware step prediction and affine-scaling damping, initialized by certified handoff from an uncertified binary32 pre-optimizer, handles a 1 mm brain MRI with about 2e7 unknowns in 90 s on one GPU. On 49 held-out OASIS pairs, SeqVP achieves mean Dice 0.821 over 35 structures and 0.889 over 4 tissue classes, with certified zero folding. Gains are 0.022 and 0.025 over ANTs SyN, and 0.022 and 0.023 over uniGradICON with instance optimization at equal time (paired, Holm-adjusted p < 0.001), but maps are rougher. SeqVP is level with ANTs on LPBA40, behind it on IBSR18, and ahead of all label-free baselines on 20 large-deformation pairs. On fields from nine methods, the certificate finds non-positive-Jacobian cells in every ANTs SyN map (median 10, missed by voxelwise checks) and in maps from NiftyReg, ConvexAdam, uniGradICON, and TransMorph.

0.28

Coupled Optimal Transport with Landmark Constraints

cs.CV ·2026-08-20 ·Xiang Gu, Jian Sun, Zongben Xu
similarity 0.52
Abstract

Existing optimal transport (OT) models primarily seek an OT map or plan between distributions by minimizing a prescribed transport cost or distortion. However, minimizing transport cost or distortion alone may fail to identify a geometrically meaningful transformation between the two distributions. To address this limitation, this paper proposes a novel coupled OT framework that leverages a small number of annotated landmarks to guide the recovery of an underlying deformation governing the distribution transformation. The coupled OT framework integrates the optimization of the transport plan and the deformation field into a unified model, where the landmark-guided deformation field and the cost-driven transport plan are coupled through a mutual-consistency constraint. As a result, the deformation is jointly determined by the annotated landmarks and cost-driven distribution matching. The proposed framework provides a principled connection between landmark-based registration and transport-based distribution matching, enabling the recovery of transport maps from sparse geometric supervision. We establish the well-definedness of the proposed model in a general variational setting and develop a finite-element-based numerical algorithm for computation whose convergence properties are systematically analyzed. The practical effectiveness of the proposed approach is verified in shape matching.

0.24

Point interpolation and distributional universality in flow-based generative models

cs.LG stat.MLmath.OC ·2026-11-03 ·Antonio Álvarez-López, Jingpu Cheng, Liyan Zhang, Qianxiao Li
similarity 0.52
Abstract · 45 pages, 3 figures

Motivated by the expressive power of neural ordinary differential equations in flow-based generative modeling, we study the approximation of probability measures by pushforwards generated by parameterized families of Lipschitz vector fields. For Wasserstein distances, we establish a quantitative relationship between finite-sample point interpolation and distributional approximation, and derive universality criteria based on $L^p$-approximation of transport maps. In particular, affine-invariant families containing a non-affine vector field are universal from compactly supported absolutely continuous base measures. For total variation, we show that coordinate-wise dynamics are insufficient in dimensions $d\geq 2$ and establish sufficient conditions based on one-dimensional Sobolev approximation and shear-type mixing. We further examine the role of point interpolation, establishing when different regimes relate to one another and when approximate interpolation can be made exact.

0.16

Surface matching for image-derived geometries with a projection-based separation of rigid body modes

cs.CE ·2026-10-19 ·Ludwig Wagmüller, Christian Bilas, Markus Gitterle, Michael Wibmer, Michael W. Gee
similarity 0.51
Abstract · 28 pages, 11 figures, 6 tables, 1 appendix, submitted for publication in a scientific journal, currently under review

The large diffeomorphic deformation metric mapping (LDDMM) framework offers numerous techniques for analyzing shapes and images. Surface matching computes a non-rigid, smooth, and invertible mapping that registers one surface to another. The computed deformation may contain rigid body motion, which frequently does not represent meaningful shape differences but is due to external factors like imaging modalities, such as the object's positioning during image acquisition. We present a simple extension to the LDDMM framework's surface matching that uniquely decomposes the computed deformation into rigid body modes (RBM) and RBM-free motion by introducing a suitable projection. This enables a focused analysis of each component individually and additionally helps to preserve the surface discretization quality. Three sets of examples illustrate our approach. A small-scale example demonstrates the proposed method's effects, followed by an example using a single pair of heart geometries, and finally an example involving a cohort of 98 heart shapes.

0.29

CANTO: CAD-Native Transformer Operators for AI-Aided Engineering

cs.AI ·2026-09-29 ·Daniel Leibovici, Nikola Borislavov Kovachki, Dawon Ahn, Ruben Ohana, Ira J. S. Shokar +6 more
similarity 0.51
Abstract · 25 pages, 11 figures, 15 tables

Modern engineering systems, from automobiles to aircraft, are designed by using precise, continuous parametric computer-aided design (CAD) models. Evaluating design changes through numerical simulation requires meshing the continuous geometry, a computationally expensive and often brittle process that can require manual intervention and replaces the continuous representation with a discrete approximation. Most neural surrogates accelerate the simulation, but inherit this representation gap by relying on meshes, point clouds, voxels, or other sampled approximations of geometry. We introduce CANTO, a transformer neural operator that maps directly from continuous CAD geometry to physical fields, without meshing the input geometry. We develop a theoretical framework for learning operators from geometric manifolds to function spaces of physical fields, representing geometry through sequences of parametric patches. CANTO instantiates this framework by directly tokenizing non-uniform rational B-spline (NURBS) patches from their control points, knot vectors, and weights, and predicts continuous surface and volume fields at arbitrary query locations. We evaluate CANTO on four automotive and aircraft aerodynamics industry benchmarks: AhmedML, WindsorML, DrivAerML, and HiLiftAeroML. CANTO achieves state-of-the-art accuracy on most evaluated surface and volume prediction tasks, including a 19.8% reduction in surface-pressure relative $L_2$ error compared with AB-UPT on HiLiftAeroML. Differentiability with respect to CAD parameters further enables gradient-based inverse design of designs. On AhmedML, CANTO identifies designs with 4.4 to 20.4% lower drag than the best dataset designs satisfying the same volume and lift constraints, with the improvements verified using the same CFD setup used to generate the original dataset.

0.46

Coordinate-Free Automatic Differentiation

cs.LG cs.MSmath.DG ·2026-10-08 ·Alex Guerra, Joshua Aduol, Yaqian Tang, Daniel Williams, Ryan P. Adams +1 more
similarity 0.51
Abstract · 34 pages, 18 figures

Automatic differentiation (AD) is a cornerstone of modern machine learning. Since all AD frameworks implicitly fix a basis of Euclidean space to define gradients and Jacobians, they natively process mathematical objects that are arrays of a fixed set of coordinates. This makes it awkward to express objects such as rotations, volume forms, and curvatures that arise, for example, in applications of AI to science. Bespoke workarounds lack reusability. We show that (i) a single, basis-independent derivative operator can represent many geometric differential operations, and (ii) this operator can be expressed entirely in terms of existing AD primitives. This reusable transformation can be composed with JAX batching, compilation, and hardware acceleration. Geometry enters as algebraic data. We experimentally demonstrate its reuse across different manifold operators, its composition through a spacetime inverse-problem pipeline, and its use in optimization over different rotor subgroups.

0.27