CS Paper Radar

Classical heat exchanger fouling-resistance laws as first-moment identities of additive stochastic deposition

Simone Casolo

eess.SY ·submitted 2026-11-17 14:01 UTC · v1
unusual

Abstract

Heat-exchanger fouling is monitored through the fouling resistance, whose record is routinely fitted with the classical linear (Ebert--Panchal) or asymptotic (Kern--Seaton) law, and the shape of the fit is often taken as evidence of the underlying deposition or removal mechanism. We show that it cannot be. If the deposit grows by non-negative, statistically stationary increments, the mean fouling resistance is exactly linear without removal and exactly the Kern--Seaton asymptote under first-order removal, whatever the microscopic deposition law. Shear-driven erosion, per-element detachment, intermittent sloughing and saturation of the surface all give the same mean curve, so a fit identifies a net deposition rate and a relaxation time, and nothing else. Modelling the deposit as a Levy subordinator, we show where the missing information lies and what it costs to retrieve it from monitoring data. Removal mechanisms separate in the variance: sloughing leaves a plateau scatter that persists even for smooth deposition and can be read from a record that saturates. Deposition laws separate only in higher cumulants, which the measurement noise of a thermally reconstructed resistance attenuates; the record needed to distinguish them grows as the fourth power of the conductance error, which places it beyond reach at realistic measurement accuracy. For the time to reach a cleaning limit, the deposition law matters only near the threshold; farther away, the mean rate and its uncertainty dominate the prediction.

Comment
Submitted

Closest papers

Nearest neighbours by meaning across the whole index.

Early Signatures of Memorization in Diffusion Models via Basin Geometry and Cyclic Denoising

cs.LG ·2026-10-08 ·Nikhil Verma, Siddharthan Dileep, Anoop Singh, Srikanth Sastry, Ramya Hebbalaguppe +2 more
theory similarity 0.44
Abstract · 42 pages, 24 figures, 7 tables

Diffusion models generalize early in training and later reproduce individual training samples. Standard tests detect memorization only once one-shot generation produces near-copies, leaving a released model unaudited until its outputs fail. We show that memorization is encoded in the geometry of the learned energy landscape before it appears in generated samples, a state we call latent memorization. Using score divergence and basin volume, we find that localized basins form around training samples and separate them from held-out samples before the first memorized sample appears, with an onset that follows the same $O(n)$ scaling as the memorization time. We probe these basins with cyclic denoising, which repeatedly applies partial noising and denoising. Under the exact empirical score, we prove that cycling started near an isolated training sample recovers it and returns to it over any finite number of cycles with high probability. In trained models, cycling recovers training images from CelebA and CIFAR-10 checkpoints whose one-shot samples contain no copies, and at a CelebA checkpoint with 0.1% one-shot copies, 500 cycles raise the memorized fraction above 30%. Cycling also reveals degenerate attractors that match no single training image and fade as training proceeds, so residence in a basin does not by itself imply memorization. These findings hold on a Gaussian mixture, CelebA, and CIFAR-10 across optimizers, architectures, noise schedules, and training-set sizes, and extend to off-the-shelf Stable Diffusion v1.4, where the cycled conditional-unconditional divergence gap separates memorized from non-memorized prompts with an AUC of 0.944 and a TPR of 0.866 at 1% FPR. More broadly, what a diffusion model has memorized is a property of the geometry and stability of its learned distribution, and assessing it requires examining this structure rather than generated outputs alone.

0.14

Generative Modeling of Stochastic Dynamics for Long-Time Evolution

cs.LG cond-mat.stat-mechhep-lat ·2026-09-30 ·Yang-yang Tan, Jinyang Li, Lingxiao Wang
similarity 0.44
Abstract · 21 pages, 15 figures, comments are welcome!

Exact stochastic equations for non-equilibrium dynamics are rarely accessible. We show that the long-time evolution of stochastic dynamics can be predicted from configuration pairs at a fixed short time lag, without knowledge of the equation of motion. Generative diffusion models learn the finite-time transition kernel from these pairs, and iterating it propagates the dynamics far beyond the training lag. For two-dimensional Model B, the diffusive dynamics of a conserved order parameter, the learned kernels reproduce dynamic critical scaling and self-similar $t^{1/3}$ coarsening. Agreement with direct simulations persists on lattices twice the largest training size and for initial ensembles absent from training. For driven colloids in a periodic optical potential, ten minutes of measured trajectories suffice to predict the particle current and mean passage time over the next twenty minutes within experimental uncertainty. Short-time observations thus contain the information needed to predict emergent non-equilibrium dynamics at much longer times.

0.28

Generative diffusion in long-range correlated landscapes: Speciation cascade and the foam structure of the score

cs.LG cond-mat.dis-nncond-mat.stat-mech ·2026-11-02 ·Jerome Garnier-Brun, Giulio Biroli, Marc Mézard, Jean-Philippe Bouchaud
similarity 0.43
Abstract · 25 pages, 7 figures

While state of the art for image and video generation, the fundamental reasons for the effectiveness of generative diffusion remain unclear. In particular, the observed advantage of following an entire reverse process with respect to single-shot or autoregressive methods, and for what type of data it may hold, is not well understood. In this work, we aim to better understand the role of the reverse process by considering a complex yet analytically tractable data model, the Gibbs measure of a high-dimensional Gaussian random potential with long-range correlations. Focusing on the exact score, we show that the speciation threshold, in which a trajectory commits to one class of the data, becomes a speciation window, in which the reverse process progressively resolves the Parisi tree of pure states of the full replica-symmetry breaking measure, committing to ever finer branches down to a single pure state. Importantly, these commitments take place at noise levels where the noisy sample distinguishes the pure states only through an energy of order one, beyond the reach of standard replica saddle points. Constructing a Larkin argument suited to such $O(1)$ energy gaps, we describe the score as a foam, with slab-like cells separated by shock-like boundaries. In the variance-exploding process we consider, this window is followed by a shrinkage of the samples towards the data support, and finally by reconstruction within the selected pure state. The denoising error of the exact score follows these stages, dropping during the speciation window with a profile set by the Parisi function alone, and then within the selected state. We believe that the generative foam we describe, and in particular the boundaries between cells, could play an important role in determining where the errors of trained diffusion models redistribute the mass of the generated samples when the data are long-range correlated.

0.29

The Depth Flow of Token Representations Is Nonlinear and Does Not Descend Its Own Density

cs.CL ·2026-08-30 ·Alexandre Quemy
publishedcode/data similarity 0.40
Abstract · Accepted at the NeurIPS 2026 Workshop on Symmetry and Geometry in Neural Representations (NeurReps), Proceedings Track, to appear in PMLR. 9…

A token's representation is carried through the network layer by layer. The whole vocabulary carried together forms a flow. We fit this flow's equation of motion as a discrete Langevin model over corpus-mean trajectories of Pythia-160M and Pythia-410M, and score the predicted steps on held-out tokens. Linear maps are often used as cheap surrogates for a layer. The flow they summarize is not linear: a quadratic drift beats the linear map at every transition of both models, and the Kramers-Moyal estimator agrees wherever its neighborhoods stay local. At full width, the step of a mean trajectory is nearly affine, 3% non-affine, while the step of an individual state is not, 17%. We then characterize the flow further. First, we show that it does not descend its own log-density, whatever the diffusion matrix. The drift instead descends a potential that is not the density. Second, the rotational component is not negligible, 4 to 45% of the explainable drift, and it is the antisymmetric part of the linear map. Finally, a token keeps its angular rank and its local-density rank across all thirteen layers, on two corpora and both models.

0.56

From Modes to Memories: Characterizing the Scale-Space Dynamics of Diffusion Models

cs.LG cs.AIcs.CV ·2026-09-30 ·Cristina López Amado, Marco Fumero, Francesco Locatello
similarity 0.40
Abstract

Diffusion models are typically viewed as stochastic processes that transform noise into data. We take a complementary perspective: a diffusion model defines a family of deterministic dynamical systems indexed by noise scale. At each fixed scale $σ$, we treat the denoiser as a self-map and study its dynamics. For an exact denoiser, fixed points correspond to critical points of the smoothed data density, while attractors correspond to its modes; as $σ$ increases, sample-level modes merge into progressively coarser ones. This suggests a geometric view of memorization: examples that receive excess probability mass due to duplication or overfitting, as well as outliers, should remain distinguishable under stronger smoothing than ordinary examples. We quantify this persistence by the critical scale $σ_c$, the largest noise scale at which an example is retained by the fixed-scale dynamics. In conditional models, the same construction extends naturally to image--caption pairs. Experiments in controlled settings and on large-scale models show that $σ_c$ tracks memorization arising from duplication, overfitting, and outliers, and identifies both memorized and partially memorized examples in Stable Diffusion. Moreover, $σ_c$ yields interpretable measures of the image spatial distribution and caption dependence of memorization.

0.33

Masked diffusion as random sequential adsorption: an exactly solvable model for parallel decoding

cs.AI cond-mat.stat-mechcs.CLcs.LG ·2026-11-05 ·Adrian Baule
similarity 0.40
Abstract · 14 pages (incl. appendices), 3 figures

Masked diffusion models generate text by reversing a stochastic masking process. Unlike autoregressive LLMs, which generate text one token at a time, they can reveal many tokens in parallel, at the price of an error, since tokens revealed together are drawn independently. We show that this trade-off maps onto the statistical physics of driven many-particle systems. (i) For any data, the error of parallel generation is the entropy production of the generation process relative to the reversed masking process. (ii) For Markov data, generation is a random sequential adsorption process with labelled gaps, which we solve exactly for any number of steps. (iii) For many steps, the error becomes the dissipation of a slowly driven system: the unmasking schedule plays the role of the driving protocol, the number of steps that of its duration, and the error is set by a thermodynamic metric that we obtain in closed form from the mutual information between tokens. Optimal schedules are geodesics of this metric. The exact solution shows how correlations in the text shape both the error and the quality of the output. The longer the correlations, the more the error concentrates at the start of generation. Schedules that start with small steps then gain more, both in path error and in perplexity, and need fewer steps to reach their asymptotic behaviour.

0.28

TBR: Transport-Based Rendering with Deposition Strokes for Inverse Graphics

cs.GR cs.CV ·2026-09-08 ·Tianqi Liu, Yushan Han, Hang Liu
similarity 0.40
Abstract

We present a stroke design in which strokes are transport-coupled: each stroke deposits material of its own area and moves every earlier mark without changing its area, so later strokes deform earlier ones. We then solve the inverse problem under this design: given a target image, we optimise an ordered program of such strokes whose replay approximates it, with digital marbling as the motivating medium. The stroke is a capsule that continuously joins circular drops to drawn deposits; its transport is exactly area-preserving, with a closed-form inverse outside the deposit, and a variant with the same inverse differs from line-source potential flow by 8% of the mean displacement. A replay adjoint regenerates intermediate states instead of storing them and uses 8.7x less memory than checkpointed automatic differentiation; a fused implementation fits a 2000-stroke program at 1024x1024 in about four minutes on one GPU. On five marbled sheets the recovered programs are level with a published stroke-based fitter as rasters, replay across a fourfold resolution range, and support edits in program order and palette space that stay valid under transport.

0.29

Some remarks on the connection between generative diffusion and optimal transport

cs.LG stat.MLcond-mat.dis-nn ·2026-10-09 ·Giulio Biroli, Marc Mézard
similarity 0.39
Abstract

We discuss three simple connections between generative diffusion and optimal transport. First, the joint law of the data and of their Ornstein-Uhlenbeck noising is, at every time, the solution of an entropic optimal-transport problem, at a temperature set by the noise level. Backward diffusion can consequently be read as an annealing which gradually decreases the entropic regularization. Second, we study the speciation transition--how the modes of the data distribution emerge during generation--and compare how it happens in diffusion and flow matching with respect to optimal transport. Using Gaussian mixtures as high-dimensional example, we show that the dynamical instability through which diffusion and flow matching separate the modes becomes, for optimal transport, an exponentially thin boundary layer at the beginning of generation, which is rounded by entropic regularization. Third, considering a generic forward dynamics with a general confining potential, we show that the backward process driven by the score also satisfies a drift-based variational principle whose minimal cost is the entropy difference between initial and final distributions.

0.29