CS Paper Radar

Functional anatomy of Pythia-Herwig differences with Kolmogorov-Arnold networks

Arghya Chattopadhyay

cs.LG hep-ph ·submitted 2026-08-16 22:53 UTC · v1

Abstract

Differences between high-energy event generators can arise at several stages of the collision simulation, from the hard scattering through parton showering and hadronization to the final event. These differences are usually summarized using observable distributions or global classifier scores. While these quantify the disagreement, they do not reveal which observable-level structures carry it or whether those structures persist through different stages of event generation. In this work, we formulate this problem as a staged functional analysis of generator-model differences. Following the same hard dijet events through Pythia and Herwig at shower-only, hadronized, and full-generator levels, we use an additive Kolmogorov-Arnold network (KAN) representation of the classifier-derived log density ratio to decompose the learned discrepancy into explicit one-dimensional observable responses that can be isolated, recomposed, and transported between generator stages. Within the same eight-observable jet representation, the Pythia-Herwig difference is driven mainly by multiplicity at shower level, shifts toward jet mass and shape after hadronization, and develops a mixed shape-multiplicity driven structure in the full-generator configuration. Transporting the individual shower-level functional components downstream shows that shower-level multiplicity information can retain its reweighting power, whereas the corresponding shape responses need not do so even though shape becomes important again at later stages. The jet-mass factors, meanwhile, are limited by poor statistical support. This KAN-based framework therefore provides a functional anatomy of generator-model dependence, exposing both persistent structures and support failures that are hidden inside a single global classifier-derived reweighting function.

Comment
32 pages, 4 appendix

Closest papers

Nearest neighbours by meaning across the whole index.

Machine Learning Meets High-Energy Nuclear Physics: From Pattern Recognition to Physics-Integrated Discovery

cs.AI hep-phhep-lathep-th+1 ·2026-10-08 ·Xun Chen, Weiyao Ke, Yu-Gang Ma, Long-Gang Pang, Kai Zhou
publishedsurvey similarity 0.55
Abstract · 37 pages, 22 figures, NST accepted

Machine learning (ML) in high-energy nuclear physics (HENP) is entering a new stage in which physical knowledge is incorporated more directly into data analysis, simulation, and physics inference. This mini-review focuses on developments that have matured in the past several years. Whereas earlier applications emphasized event classification, pattern recognition, and surrogate models for selected observables, recent work has moved toward physics-integrated workflows: calibrated Bayesian extraction of QCD matter properties, dense-matter equation-of-state inference from heavy-ion and neutron-star data, generative event modeling, neural unfolding of weak physical signals, differentiable inverse solvers, gauge-equivariant and diffusion-based lattice-field samplers, and neural reconstruction of model functions in holographic QCD. We survey recent applications of ML in heavy-ion collisions, neutron-star physics, lattice QFT, and holographic or continuum QCD. The emphasis is not on ML architectures alone, but on how they enter concrete physics workflows, how physical constraints such as symmetries, conservation laws, causality, thermodynamic stability, and topology are imposed, and how uncertainty quantification and validation determine whether an AI-assisted result can support a reliable physics conclusion.

0.57

RINO: Renormalization Group Distillation with No Labels

cs.AI hep-ex ·2026-10-11 ·Zichun Hao, Raghav Kansal, Abhijith Gandrakota, Chang Sun, Haoyang Li +4 more
code/datahot direction similarity 0.55
Abstract

Supervised machine learning in high-energy physics (HEP) requires training on labeled simulations of particle collisions, which are known to be unfaithful to the underlying physics. This leads to significant inaccuracies and biases in the transfer of trained models to real data, limiting the power of deep learning methods. Self-supervised learning (SSL) is a promising alternative for pretraining directly on real, unlabeled data. However, existing techniques largely operate with inductive biases inspired by domains such as images and natural language. We propose RINO (Renormalization Group DIstillation with NO Labels), which, for the first time, exploits the fundamentally multi-scale renormalization group structure of high-energy jet formation as a physically grounded source of SSL views. We define teacher-student representations across energy scales using different levels of hierarchical clustering, aligned via DINO-style self-distillation. To mirror the background-dominated nature of real collider data, RINO pretrains exclusively on jets from quantum chromodynamics (QCD) processes and is evaluated on out-of-distribution (OOD) transfer to rare signal classes. In our controlled data-efficiency study, RINO matches fully supervised training on JetNet after finetuning on only 1% of the labeled data. With the full labeled dataset, RINO improves OOD classification accuracy on top-quark jets by 5.9% and, without retraining, improves AUC on the unseen Higgs boson decay channel $H \to 4q$ by 4.1% over the strongest SSL baseline. Scale-structure diagnostics reveal that DINO-style self-distillation permits our backbone to retain scale-dependent structure. Ablation studies show that this accounts for an 8.6% OOD accuracy gap with respect to alternative SSL paradigms such as SimCLR. Code is available at https://github.com/zichunhao/RINO.

0.37

Combinatorial Residual Network: a decay-chain-aware classifier without explicit jet assignment

cs.LG hep-exhep-phphysics.data-an ·2026-10-29 ·John Alison, Patrick Bryant, Alejandro Gomez Espinosa, Christian Guinto-Brody, Aniket Khanal +3 more
code/data similarity 0.54
Abstract · 24 pages, 7 figures, 6 tables. Code available at https://github.com/cms-cmu/CoReNet

Final states with several jets from the decays of heavy particles pose a combinatorial problem, since the jets must be assigned, at least implicitly, to their parent particles. We describe the Combinatorial Residual Network (CoReNet), a classifier that encodes the assumed decay chain of the final state in its architecture. CoReNet builds its event representation level by level along the decay hierarchy, evaluates every jet assignment hypothesis with weights shared across objects, and combines the hypotheses with learned weights using residual networks. The exchange symmetries of the decay are built into the construction, the size of the network does not depend on the number of hypotheses, and the network is trained with the classification loss alone, without generator-level jet assignments. The architecture was developed for the $b\bar{b}b\bar{b}$ final state and has been used in several CMS searches. On fast-simulation samples of Higgs boson pair production in the $b\bar{b}b\bar{b}$ final state against QCD multijet production, CoReNet with 1508 trainable parameters performs well above kinematic baselines and trains in minutes on a single GPU. Its hypothesis weights select the truth-matched jet pairing in most of the signal events in which it is defined, although no assignment target is used in training. Since only the encoded decay chain is specific to the final state, the construction carries over to other topologies, which we test with $HH \to b\bar{b}W^+W^-$ against semileptonic $t\bar{t}$. There, encoding the decay chain of the background as well as that of the signal further improves the classification, at a cost of about $10^3$ parameters. In both final states its performance is comparable to that of a state-of-the-art transformer-based network more than two orders of magnitude larger. The implementation is publicly available at https://github.com/cms-cmu/CoReNet.

0.37

Likelihood-Based Unsupervised Anomaly Detection in CMS Dijet Events

cs.LG hep-ex ·2026-09-06 ·Bhavishya Chebrolu, Hitesh Rasineni, Prajwal Aaryan Immadi
similarity 0.54
Abstract

We present an unsupervised search for anomalous dijet events in proton--proton collision data using neural spline flow density estimation. A normalizing flow model is trained on a high-dimensional feature space comprising jet, dijet, and event-level observables to learn the dominant Standard Model background directly from data, without assuming a specific signal hypothesis. Events assigned low likelihood under the learned density are identified as potential anomalous events. Using this approach on a CMS Open Data dijet sample, we investigate extreme events in the tail of the anomaly-score distribution and perform an extensive validation and robustness study. This study includes feature-level statistical comparisons, mass decorrelation tests, permutation-based null tests, and evaluations of training stability. The selected anomalous events exhibit notable departures from the background-only expectation, primarily in jet-substructure observables, while remaining stable under several known sources of bias in unsupervised learning. The identified anomalies are distributed across the kinematic phase space and do not exhibit a narrow structure in the dijet invariant-mass spectrum. Instead, they show correlated deviations across multiple observables, consistent with a multivariate difference in jet substructure and event topology rather than a localized resonance. While no claim of new physics is made, this study demonstrates that neural spline flow-based density estimation can be sensitive to rare, structured deviations in collider data and may provide a model-independent exploratory tool for searches for physics beyond the Standard Model at the LHC.

0.32

The proton structure one mode at a time: a Neural Tangent Kernel analysis of a DIS fit

cs.LG hep-ph ·2026-10-26 ·Amedeo Chiefa, Luigi Del Debbio, Richard Kenway
similarity 0.54
Abstract · 70 pages, 37 figures

We study the training dynamics of a feed-forward neural network (NN) through the analysis of the neural tangent kernel (NTK) in a phenomenologically relevant fit of parton distribution functions (PDFs) from deep inelastic scattering (DIS) data. The exact integration of the gradient flow derived in a previous single-flavour analysis is generalised to the multi-flavour case, yielding an analytical perspective on the relationship between data and methodology during training. The Shapley value recently used in the context of PDFs is derived within our statistical framework for observables that depend linearly on the PDFs, and we outline a geometric interpretation of training. We expose the role of gradient-based optimisation algorithms and of the parametrisation in the regularisation of the ill-posed inverse problem that affects the determination of PDFs from experimental data, demonstrating that the regularisation amounts to the incremental inclusion of NTK modes, each learned at the timescale set by the corresponding eigenvalue. We find that only a few leading modes of the NTK are necessary to reconstruct the target PDFs, while the noise of the data is carried by the sub-leading ones learned at later stages of training. Finally, we consider the impact of the initialisation on the training dynamics, and recover a transient behaviour observed in the previous analysis and in the machine learning (ML) literature. Beyond sharpening our understanding of the training dynamics, our framework can be applied to other parametrisations (such as fixed functional forms) and ML applications in physics, as well as to stress tests in the presence of inconsistent data.

0.26

Comprehensive reconstruction of collider events with hypergraph representation learning and graph-conditioned diffusion

cs.LG hep-phhep-ex ·2026-09-16 ·Lining Mao, Yvonne Peters, Ethan Simpson, Zihan Zhang
similarity 0.54
Abstract · 23 pages, 9 figures, to be submitted to PRX Intelligence

In particle collider experiments, event reconstruction is the task of inferring the kinematics of short-lived particles produced in the hard scatter from the stable final states recorded by detectors. We decompose event reconstruction into two primary tasks: assigning measured jets and charged leptons to parent particles, and predicting unmeasured neutrino kinematics. We present VyPER, a novel geometric learning framework that represents collider events as hypergraphs with a physics-inspired topology. VyPER combines the supervised classification of hyperedges for particle assignment with a diffusion model for predicting neutrino kinematics, leveraging a joint loss function to optimize both reconstruction tasks within a unified framework. We showcase VyPER across several proton-proton collision processes, comparing its performance to existing analytical and machine-learning-based reconstruction techniques. In doing so, we demonstrate that accurate event reconstruction is achievable across a diverse range of Standard Model physics processes, opening new avenues for precision measurements in the Higgs boson, electroweak, and top-quark sectors.

0.17

Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Tasks

cs.LG hep-phhep-exphysics.data-an ·2026-09-25 ·Nilotpal Kakati, Daniel Murnane, Baran Hashemi, Samuel Klein, Jeffrey Krupa +3 more
code/datahighly cited similarity 0.53
Abstract · 47 pages. Code: https://github.com/FM-for-HEP/hep-any2any ; data and models: https://doi.org/10.5281/zenodo.22917591

Reconstruction and simulation at a collider experiment are long chains of specialised algorithms, each tuned to a single step. We explore how one model can serve many of those steps at once, while still producing the intermediate objects (tracks, calorimeter cells, clusters, particles and jets) that make the chain interpretable. To do so, we represent every object in a jet in a single shared token vocabulary and train one model to map any subset of these modalities to any other. A task is then only a choice of which modalities to provide and which to request: particle flow, detector simulation and charged energy subtraction are all directions through the same set of weights. We train over all modality combinations, with a decoder emitting tokens either autoregressively or in parallel. With tokenisation, both architectures train stably with little tuning. In evaluations, both models produce realistic reconstruction and simulation objects, with the autoregressive model particularly faithful to output from Geant4. The autoregressive model also outperforms a state-of-the-art particle flow algorithm on many typical jet reconstruction metrics.

0.62

Higher Order Component Attribution via Learned Surrogates in High Energy Physics

cs.LG hep-exhep-ph ·2026-11-05 ·Lauri Laatu, Aritra Bal, Benedikt Maier, Markus Klute, Michael Spannowsky
unusual similarity 0.53
Abstract

Experimental High Energy Physics (HEP) has adopted the transformer architecture for identification of jets, particularly the state-of-the-art Particle Transformer (ParT) which injects explicit information about particle correlations into the attention mechanism. While able to achieve state-of-the-art results in accuracy, interpretability to its effectiveness has been limited. In this paper we propose component attribution methods using Kolmogorov-Arnold Networks (KANs) that directly tie back to the physical descriptors of jets, to probe whether mechanisms such as Multi-Head Attention (MHA), or the ParT architecture, are able to learn these as discriminating features.

0.26