CS Paper Radar

The proton structure one mode at a time: a Neural Tangent Kernel analysis of a DIS fit

Amedeo Chiefa, Luigi Del Debbio, Richard Kenway

cs.LG hep-ph ·submitted 2026-10-26 18:00 UTC · v1

Abstract

We study the training dynamics of a feed-forward neural network (NN) through the analysis of the neural tangent kernel (NTK) in a phenomenologically relevant fit of parton distribution functions (PDFs) from deep inelastic scattering (DIS) data. The exact integration of the gradient flow derived in a previous single-flavour analysis is generalised to the multi-flavour case, yielding an analytical perspective on the relationship between data and methodology during training. The Shapley value recently used in the context of PDFs is derived within our statistical framework for observables that depend linearly on the PDFs, and we outline a geometric interpretation of training. We expose the role of gradient-based optimisation algorithms and of the parametrisation in the regularisation of the ill-posed inverse problem that affects the determination of PDFs from experimental data, demonstrating that the regularisation amounts to the incremental inclusion of NTK modes, each learned at the timescale set by the corresponding eigenvalue. We find that only a few leading modes of the NTK are necessary to reconstruct the target PDFs, while the noise of the data is carried by the sub-leading ones learned at later stages of training. Finally, we consider the impact of the initialisation on the training dynamics, and recover a transient behaviour observed in the previous analysis and in the machine learning (ML) literature. Beyond sharpening our understanding of the training dynamics, our framework can be applied to other parametrisations (such as fixed functional forms) and ML applications in physics, as well as to stress tests in the presence of inconsistent data.

Comment
70 pages, 37 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Intrinsic Gradient Barriers in Pushforward Deep Generative Models

cs.LG stat.MLmath.ST ·2026-10-25 ·Edric Tam, Qingyang Liu, Barbara Engelhardt, Ray Bai
similarity 0.60
Abstract · 45 pages, 9 figures

Broad classes of deep generative models (DGMs) operate by learning to map a simple source distribution, such as a standard Gaussian, to a complex high-dimensional target distribution. Despite their success, DGMs often empirically struggle to accurately represent distributions with heavy tails or well-separated modes. In this work, we show that these difficulties reflect intrinsic properties of the underlying transport problem rather than particular neural network architectures or training procedures. We establish quantitative lower bounds on the gradients and Jacobians of pushforward mappings that transport log-concave source distributions to such targets. For heavy-tailed target distributions, the required gradient magnitude grows as the target develops increasingly large moments. For multimodal target distributions, the low-probability regions between well-separated modes similarly force large gradients in the transport map. We discuss how such large derivatives relate to trade-offs between expressivity and numerical stability. Our results hold under substantially weaker regularity conditions than previous analyses and remain stable under perturbations of the target distribution. Finally, we show that these obstructions can be mitigated when the goal is approximation of a given density rather than generative modeling. Specifically, we propose simple classes of bijective reparametrizations that can alleviate the difficult geometric structure and reduce the gradient burden placed on the learned generative map. Numerical experiments support our theoretical analysis.

0.15

Probabilistic Physics-Informed Neural Solvers for Woods-Saxon Parameter Identification: A Coupled Forward-Inverse Approach

cs.CE ·2026-08-10 ·Iraklis Spyrou, Christos Tsepas, Vaia Prassa, Christoforos Rekatsinas
similarity 0.60
Abstract · 29 pages, 4 figures, 12 tables

The Woods-Saxon mean-field approach offers a compact description of bound single-particle motion in finite nuclei, while physics-informed neural networks (PINNs) provide a differentiable route to the inverse problem of recovering potential parameters from sparse spectral data. We develop a probabilistic physics-informed framework in which a WaveNet represents the separated single-particle wavefunction and a ParamNet maps selected spectra, nuclear descriptors, and quantum numbers to a learned distribution over six global Woods-Saxon parameters. The Hamiltonian includes the central Woods-Saxon, proton Coulomb, and spin-orbit terms; training enforces spectral energy consistency, Schr"odinger-equation residuals, boundary conditions, normalization, orthogonality, spin-orbit splitting constraints, and latent regularization. The distribution mean serves as a selection-free parameter estimate, validated against an independent finite-difference radial solver. Synthetic closure tests with the Seminole and Wahlborn parameterizations recover all six parameters with sub-percent relative errors and reproduce reference spectra with mean absolute deviations of (0.0109) and (0.0131~\mathrm{MeV}). For experimental spectra with the Wahlborn form, the estimator reduces the all-state mean absolute error from (1.0783) to (0.8303~\mathrm{MeV}); with the Seminole form it attains (0.8068~\mathrm{MeV}), close to the (0.7969~\mathrm{MeV}) from Seminole reference parameters, using only (42) experimental levels -- about (51%) fewer than the Seminole calibration. These results show that sparse, structured single-particle spectra can constrain global Woods-Saxon interactions within a differentiable framework addressing both the forward eigenvalue problem and inverse parameter identification, while the learned output spread offers a model-derived, qualitative measure of parameter stiffness.

0.10

Neural Sampling with Reweighted Normalizing Flows via the Wasserstein--Fisher--Rao JKO Scheme

cs.LG math.NAmath.PRstat.ML ·2026-10-07 ·Chenguang Duan, Johannes Hertrich, Gabriele Steidl
theory similarity 0.59
Abstract

We propose a neural algorithm for sampling from distributions specified by unnormalized Boltzmann densities. Our approach is based on the Jordan--Kinderlehrer--Otto scheme for the Kullback--Leibler divergence in the Wasserstein--Fisher--Rao geometry (WFR JKO scheme). Our contributions are twofold. First, we prove that, for any fixed step size, the exact WFR JKO iterates converge exponentially fast to the target as the number of iterations tends to infinity. Notably, this result requires no structural assumptions on the target, such as log-concavity or a logarithmic Sobolev inequality. Second, we develop a neural implementation of the WFR JKO scheme that parametrizes its transport and reaction components using reweighted normalizing flows. Numerical experiments on challenging multimodal targets demonstrate the promising performance of the proposed method.

0.06

The Symmetry of Differential Neural Tangent Kernel under the Orthogonal Group

cs.LG math.GR ·2026-10-25 ·Bangti Jin, Longjun Wu
theory similarity 0.59
Abstract · 25 pages, 2 figures

The differential neural tangent kernel (DNTK) is a tool for analyzing the training dynamics of overparameterized physics informed neural networks. In this work, we investigate the symmetry of the infinite DNTK under an orthogonal group, for two layer and deep neural networks separately, based on the explicit expression of the DNTK and recursive formula, respectively. The results are for all activations with or without a bias term, and shed insight into the structure of the infinite width DNTK. Then we prove that the integral operators over the unit sphere induced by operators from the same group orbit share the spectrum, and their reproducing kernel Hilbert spaces differ only by an orthogonal transformation, and that the operator fixed DNTK exhibits zonal symmetry on the unit sphere for symmetric operators. Thus the eigenvalue decay rate of the associated integral operator can be derived for shallow networks with RePU activation and zero bias initialization.

0.27

Generative Neural Networks for Sinkhorn Distributionally Robust Hypothesis Testing

cs.LG stat.MLmath.OC ·2026-08-24 ·Fenglin Zhang, Teyan Liu, Jie Wang
theory similarity 0.59
Abstract · 41 Pages, 7 figures

This paper studies the Sinkhorn distributionally robust hypothesis testing (SDRHT) problem, seeking a robust detector against least-favorable distributions in Sinkhorn discrepancy-based ambiguity sets centered at the empirical distributions. Existing approaches solve this problem by solving large-scale conic programs, which are not scalable. To overcome this, we propose a generative framework that learns least-favorable distributions and supports efficient training and end-to-end sampling. For the Sinkhorn discrepancy-based ambiguity sets, we first derive an equivalent conditional-KL-divergence representation with respect to kernel-smoothed reference distributions. This property allows us to prove strong duality for both constrained and unconstrained minimax SDRHT formulations. Based on the closed-form optimal detector and Brenier's theorem, we reformulate the max-min dual formulation as a maximization problem over convex potentials whose gradients characterize invertible transport maps between kernel-smoothed distributions and their least-favorable counterparts. We efficiently approximate these potentials using Hyper Input Convex Neural Networks (HyCNNs) equipped with stochastic gradient estimators and prove the representation power of HyCNNs and the distributional universality of their induced transport maps. Numerical results show that the proposed method achieves superior accuracy and robustness across different sample sizes and dimensions, while avoiding the scalability limitations of classical SDRHT methods.

0.16

S-matrix informed neural networks for amplitude analysis

cs.LG hep-phnucl-th ·2026-08-24 ·Wyatt A. Smith, Arkaitz Rodas, Marius D. Thomas, César Fernández-Ramírez, Giorgio Foti +3 more
similarity 0.58
Abstract · 29 pages, 23 figures

Reconstructing scattering amplitudes from finite, noisy, and mutually inconsistent measurements is an ill-posed inverse problem common to many reactions relevant to particle physics. We introduce S-matrix informed neural networks (SINNs), and demonstrate their ability to learn scattering amplitudes directly from data while respecting first principles. We further develop a novel data selection procedure, which uses the response of constrained neural network ensembles to identify a set of experiments compatible with first principles, and with each other. We apply this framework to $ππ$ scattering, producing reusable amplitudes and correlated uncertainties without relying on a fixed functional form. We validate our results against residual model dependencies and training biases through closure tests and ablations. We find negligible impact of model architecture on our results. Our workflow unifies physics-constrained representation learning, data selection, and uncertainty quantification. Our strategy is transferable to other scattering processes, and other constrained physics problems limited by inconsistent data.

0.28

WaSP: Wasserstein Data Synthesis Pipeline for Solver-Free Operator Learning

cs.LG cs.AI ·2026-11-05 ·Ryan Liu, Chuwei Wang, Ricardo Baptista, Andrew Stuart, Anima Anandkumar
theory similarity 0.58
Abstract

Neural operators offer fast surrogates for solving PDEs, but training them typically requires expensive input-solution pairs. Two solver-free alternatives include physics-informed learning and training on manufactured data. Physics-informed learning approximates solutions by minimizing PDE residuals. While the residual norm must be strong enough to control solution error, stronger norms increase mini-batch variance and hinder optimization. Manufactured data constructs input-solution pairs for learning by applying the PDE operator to artificial solutions. However, the resulting training distribution can be mutually singular with the target distribution, yielding poor accuracy on the target distribution. We introduce the Wasserstein Data Synthesis Pipeline (WaSP), which trains on manufactured input-solution pairs while gradually mitigating the distribution shift. WaSP synthesizes new pairs by applying the learned operator to a path of intermediate distributions converging to the target input distribution. Training proceeds in stages along this path. At each stage, the previous surrogate generates solutions, and the exact PDE operator derives corresponding inputs, yielding training pairs for the next surrogate. Theoretically, we prove a stepwise error-propagation bound for the distribution shift introduced during synthesis. Empirically, WaSP reduces solution error by $3.9\times$ to $9.5\times$ compared to existing solver-free methods on PDEs such as Allen-Cahn, Kuramoto-Sivashinsky, and Ginzburg-Landau, and better reproduces the two chaotic systems' statistical observables.

0.21

Learning Transverse Momentum Distributions from Raw Scattering Events via Conditional Diffusion

cs.AI hep-ph ·2026-08-27 ·Jitao Xu, Christopher Cocuzza, Kevin Braga, Daniel Lersch, Nobuo Sato +1 more
published similarity 0.58
Abstract · Accepted at Physics and AI at Stanford University (PAI 2026)

Extracting transverse momentum dependent parton distribution functions (TMD PDFs) from semi-inclusive deep inelastic scattering (SIDIS) data is a central goal of the nucleon structure program at Jefferson Lab and the future Electron-Ion Collider. Traditional extraction methods rely on parameterized functional forms and iterative fitting, which can limit the flexibility of the resulting distributions and make uncertainty quantification cumbersome. We present a conditional diffusion model that learns to map raw SIDIS event kinematics directly to TMD PDFs, bypassing explicit functional assumptions. Evaluated on simulated SIDIS data at CLAS12 kinematics, the model recovers the underlying TMD with informative uncertainties that narrow steadily with increasing event statistics, and produces reliable estimates even with as few as 1,000 conditioning events, a statistics-limited regime directly relevant to ongoing and planned experiments.

0.37