CS Paper Radar

Sorted Mutability as an Entropic Functional: Theory and Two Applications

Michel Aguilera, Eugenio E. Vogel, Francisco J. Peña, Gonzalo Saravia, Patricio Vargas

cs.IT physics.data-an ·submitted 2026-10-06 14:36 UTC · v1
unusual

Abstract

We investigate sorted mutability, $ζ_S$, as an information-based quantity with an explicit entropic character. We show that $ζ_S$ is directly proportional to the diversity of a data sequence and can therefore be expressed in terms of Shannon entropies, establishing a connection between compression-based measures and conventional information theory. In contrast to regular mutability, which preserves the sequential ordering of the data, sorted mutability removes this ordering and provides a static characterization of the distribution of observed values. We illustrate these properties in two complementary settings: the two-dimensional ferromagnetic Q-clock model and wind-power production data. For the Q-clock model, sorted mutability and diversity display the same temperature dependence, consistent with their analytical relation, while conventional thermodynamic observables provide an independent reference. In the case of wind power, we report monthly results for sorted mutability and diversity, showing proportional time evolutions. These results support sorted mutability as a useful, easy-to-calculate entropic functional for analyzing both equilibrium and non-equilibrium data sets.

Comment
12 pages, 11 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Revisiting entropy and entropy-related magnitudes of a symbolic sequence and their estimation

cs.IT nlin.CDphysics.data-an ·2026-10-26 ·Efren Aragon-Perez, Ania Mesa-Rodriguez, Karel Garcia-Medina, Daniel Estevez-Moya, Amanda Mollineda-Rodriguez +1 more
publishedtheorycode/data similarity 0.56
Abstract

This article revisits entropy and related magnitudes (entropy density, effective measure complexity, and informational distance) for the analysis of sequential data. We present their mathematical foundations within information theory and ergodic theory, establishing connections between probabilistic Shannon entropy and algorithmic Kolmogorov complexity. A central result, Zivs theorem, demonstrates the asymptotic equivalence between the normalised number of distinct words and entropy density, providing the theoretical basis for estimation via Lempel-Ziv factorisation. We examine the convergence properties of these magnitudes and introduce estimation procedures for finite sequences, including a method for the effective measure complexity and the transfer entropy rate. An open-source software library implementing parallel algorithms for efficient Lempel-Ziv factorisation is presented. The practical utility of the framework is illustrated through three case studies: functional brain connectivity analysis from fMRI data, characterisation of spatiotemporal dynamics in coupled nonlinear oscillators, and electrocardiogram-based classification of atrial fibrillation, demonstrating how entropic measures capture meaningful structural and dynamical properties across diverse domains.

0.47

A Structural Characterization of Entropy Functionals

cs.IT math.ST ·2026-08-14 ·Daniel Lazarev
similarity 0.49
Abstract · 31 pages, 1 figure

Entropy functionals and their associated divergences underlie many statistical methods, including maximum entropy inference, minimum divergence estimation, and goodness-of-fit testing, yet choosing among Shannon, Rényi, Tsallis, and more general entropies is often a matter of convention rather than structural principle. We introduce a measure theoretic framework in which admissibility requires the entropy of an input measure to be bounded above by that of its reference measure whenever the former is absolutely continuous with respect to the latter. Under generalized mean-value composition, we characterize all such entropy functionals and obtain a four-level hierarchy determined successively by the mean generator, entropy scale, and additivity assumptions. A continuous strictly monotone generator $g$ is admissible exactly when $t\mapsto g(1/t)$ is strictly convex for increasing $g$, or strictly concave for decreasing $g$. This resolves a question posed by Rényi (Proc. 4th Berkeley Sympos. Math. Statist. Prob., 1961) concerning which generalized means may replace the arithmetic mean in his entropy axiomatization. The same criterion is equivalent to strict convexity of an associated Csiszár $f$-divergence generator and therefore yields data processing under Markov kernels with an exact equality condition. Within this hierarchy, product additivity singles out the Rényi family, while internal additivity, or product additivity together with arithmetic mean-value composition, singles out Shannon entropy. The characterization is constructive and yields new admissible entropy and divergence families, including integral-transform examples.

0.10

Distributional statistics of nonequilibrium

cs.IT cond-mat.stat-mechmath.PRphysics.data-an ·2026-10-24 ·Harrison Hartle, Aanjaneya Kumar, David H. Wolpert
similarity 0.49
Abstract · 23 pages, 5 figures

We establish a reference modeling framework for random probability distributions subject to constraints. Generalizing the hyperensemble approach of Crooks, we formulate Jaynesian priors of maximal uncertainty over the unit simplex of categorical distributions. This framework is entirely general, but we primarily investigate models with constraints on physically relevant quantities, namely, average energy and Shannon entropy. A constraint on the exact value of average energy uniquely determines a Boltzmann-Gibbs equilibrium, but also defines a hyperplanar subset of the probability simplex consisting of all distributions with that value of average energy. The associated hyperensemble has a uniform probability density across all such distributions, regardless of distance to equilibrium. Such reference models make predictions of generic nonequilibrium properties such as the mean and modal microstate distributions and the expected free energy of a random distribution, which we examine analytically and via exact sampling algorithms. Moreover, introducing constraints on Shannon entropy permits parametric access to tunably nonequilibrium regimes. The approach follows conventional Jaynesian modeling logic and is compatible with standard Bayesian inference, and reduces to Boltzmann-Gibbs statistics when Shannon entropy is maximized. We examine the physical predictions of this scheme, and demonstrate its wide compatibility with other approaches to nonequilibrium modeling. We illustrate the framework in three scenarios: (i) comparison to superstatistics quasi-equilibrium modeling, (ii) generation of random nonequilibrium steady states, and (iii) Bayesian inference under a prior hyperensemble. We highlight numerous prospects for theoretical extensions and empirical application.

0.25

ALPHABET: A Laplace-Pole History Aggregator with Banked Exponential Transport

cs.LG ·2026-08-25 ·Daehwa Ko, JaeHyeon Kim, Oh Seong Kwon, Jay Hoon Jung
similarity 0.49
Abstract · 21 pages, 5 figures, 9 tables; includes technical appendix

Can a sequence model remain competitive with only a few thousand parameters and an explicitly auditable prediction interface? We introduce ALPHABET, a compact linear-time model that compresses temporal history into stable complex pole modes: a direct bank synthesizes its modal states back into the feature trajectory, an independent cascaded bank analyzes the transformed trajectory without resynthesis, and an affine head reads only modal energies and lag moments from both banks. We characterize the temporal information this descriptor retains: for a stationary, fully observed feature process, each mode energy is a frequency-localized measurement of the second-order spectrum, the continuum of such measurements identifies the spectrum, and almost every mode separates any fixed finite set of spectrally distinct classes. On a Gaussian control with matched low-lag statistics, the learned descriptor approaches the Bayes oracle where raw autocovariances remain at chance. Across the fixed 82-task registry, ALPHABET attains mean rank 3.97 in the complete ten-family comparison. At the common-width D=64 runtime anchor, its 6,437 parameters deliver 5.02 times faster inference and 3.93 times faster complete training steps than the nine baselines on average.

0.29

Synchronization Reveals Market Structure That Classical Randomness Tests Cannot Detect

cs.CE ·2026-10-08 ·Nam H. Le
similarity 0.47
Abstract

Synchronization among coupled oscillators -- from neurons to power grids -- is a universal signature of collective behavior, classically measured by the Kuramoto order parameter. Applied identically across five asset classes and 61 financial instruments, a Kuramoto-style cross-timeframe coherence measure detects structure that a calibrated, heteroskedasticity-robust variance-ratio test of the random-walk hypothesis does not: the two diagnostics are statistically independent even on the same price windows. Here we explain why, and extract the physics behind it. The four-state regime alphabet underlying the measure is a Z4 clock model whose exact factorization into two Ising sectors is precisely the order parameter's decomposition into a direction channel and a volatility channel, and the sign-flip symmetry of returns acts on the regime circle as a reflection, yielding a parity selection rule: the direction channel is provably independent of the variance ratio and of every statistic built from squared returns -- confirmed by controlled simulation on processes with and without genuine persistence. Boltzmann inversion of the regime statistics then yields effective couplings between adjacent timescales, benchmarked against matched random-walk, GARCH, and fractional-Gaussian-noise nulls: the direction sector's coupling never exceeds its random-walk null in a single instrument, and its deficit independently re-measures the panel's Hurst exponent, while the volatility sector's coupling exceeds every null in every instrument and survives across scale separations where GARCH cannot -- a volatility cascade. A closed-form mean-field analysis places markets deep below the synchronization transition, with all genuine cross-scale structure confined to the even, volatility sector.

0.28

infomeasure-rs: A High-Performance Rust Library for Information-Theoretic Measures and Estimators

cs.IT cs.MSphysics.data-an ·2026-10-20 ·Carlson Moses Büth
code/data similarity 0.46
Abstract · 21 pages, 7 figures, 4 tables. Documentation: https://infomeasure.org/

Information theory has become a standard tool across the natural and social sciences, yet practical use is limited by estimator choice, fragmented software, reproducibility, and computational cost. We present infomeasure-rs, an open-source Rust library that brings a broad set of information-theoretic measures and estimators into one self-contained, type-safe package. It covers entropy, mutual information, conditional mutual information, transfer entropy, conditional transfer entropy, cross-entropy, and the Kullback-Leibler and Jensen-Shannon divergences, with discrete (plug-in and bias-corrected), kernel, ordinal, and nearest-neighbour estimators, including the Rényi and Tsallis families, and exposes local and global values and significance testing through a consistent trait interface. It ships as a single portable binary with no runtime dependency and is continuously validated against a reference implementation. On a single central processing unit (CPU) core, and even without its GPU or parallel paths, it is the fastest of the packages we compared across languages, matching the closest packages only for plug-in discrete entropy and substantially faster for mutual information, the conditional and transfer measures, and the kernel, ordinal, and generalised-entropy estimators. The optional GPU and multi-threaded paths accelerate selected continuous estimators further. The library is open source and, to our knowledge, the most complete information-theory package for Rust.

0.41

Ladder of information limits on prediction for reduced-order models

cs.IT nlin.CDphysics.comp-ph ·2026-09-16 ·Adrian Lozano-Duran
code/data similarity 0.46
Abstract

What can and cannot be predicted by a model when only limited information is available? We answer this question by constructing a ladder of information limits that organizes prediction tasks according to their information requirements: from memoryless and memory-augmented trajectory forecasts to event prediction, stationary statistics, and generative laws. The analysis, which is independent of the model structure or architecture, identifies the minimum attainable error along with the information limitations that give rise to it. The approach distinguishes information hidden in unresolved variables from information recovered through time-delayed observations and connects these contributions to Mori--Zwanzig memory. The ladder also reveals why Lyapunov growth alone cannot characterize reduced-order prediction error, why stationary statistics may remain predictable even when individual trajectories become unpredictable, and why stochasticity can represent (but cannot recover) missing information. Numerical studies of the Kuramoto--Sivashinsky equation and the Lorenz system illustrate these results across the ladder. This unified perspective provides a principled language for understanding the fundamental limitations of ROMs for a given prediction task and for clarifying whether improved predictions require richer observations, greater precision in the input, or additional memory.

0.51

Information Potential: A Variational Approach to Quantum Information Complexity

cs.CC quant-ph ·2026-09-30 ·Penghui Yao, Yifan Zhou
theory similarity 0.46
Abstract

Quantum information complexity (QIC), introduced by Touchette [Touchette, STOC 2015], has been shown to be one of the most powerful methods for proving quantum communication complexity and has also been shown to be equal to amortized quantum communication complexity. Unfortunately, QIC is generally hard to analyze because it is a sum of quantum conditional mutual information terms, which are difficult to estimate. In this work, we introduce a new variational approach, the information potential, for analyzing QIC and proving quantum communication lower bounds inspired by the resolvent representation for quantum relative entropy. This approach connects the QIC of individual messages to a quadratic form, making it more amenable and thus enables us to bound the cumulative positive increments of the potential throughout an interactive quantum protocol by its QIC. Lower bounds on the growth of the potential therefore translate into lower bounds on both QIC and quantum communication complexity. As an application, we give an optimal $Ω(1/r)$ lower bound on the QIC of the two-bit $\mathsf{AND}$ function as well as an optimal $Ω(n/r)$ lower bound on the quantum communication complexity of $r$-round Set-Disjointness, answering an open problem in~[Braverman, Garg, Ko, Mao, Touchette FOCS 2015]. Moreover, we further prove a direct-sum theorem for bounded-round quantum communication complexity of Set Disjointness. With the tight bound on the QIC of $\mathsf{AND}$ function, we further establish a nearly tight tradeoff for the asymmetric quantum communication complexity of $\mathsf{Set} \mathsf{Disjointness}$: $(q_A+1)(q_B+1)=Ω(n)$, where $q_A$ and $q_B$ denote the total numbers of qubits sent by Alice and Bob, respectively.

0.26