CS Paper Radar

HodgePhaseNet: Discrete Hodge Decomposition of Semantic Flows in Transformer Attention

Kiyotaka Kasubuchi, Kazuo Fukiya

cs.LG cs.CL ·submitted 2026-10-10 14:45 UTC · v1

Abstract

WavePhaseNet introduced frequency-resolved semantic representations, QuantumPhaseNet introduced gauge-covariant phase connections, and ModularPhaseNet made a finite cyclic phase channel and its cycle holonomy computable in an ordinary Transformer. These constructions are complementary, yet they do not by themselves separate an observed collection of pairwise relations into a globally consistent direction, circulation around local compositions, and circulation that persists around a larger unfilled cycle. HodgePhaseNet addresses this separation by representing semantic transitions as an antisymmetric real-valued 1-cochain on a finite oriented simplicial complex. With vertex-edge incidence matrix $B_1$ and edge-face incidence matrix $B_2$, every such field has a unique orthogonal decomposition $Ω= B_1^TΦ+ B_2Ψ+ H$, where $B_1H=0$ and $B_2^TH=0$. The three component fields are unique even when their potentials are not. We give explicit projectors, a sparse implementation, integrability and gauge results, a verified numerical example, and a redesigned attention interface. The attention bias is defined on allowed ordered query-key pairs, remains consistent under arbitrary choices of edge orientation, and preserves a decoder's causal information boundary by constructing its complex from the visible prefix. Gauge invariance of the attention output is conditional on using invariant or appropriately compensated features. A simple difference of vertex embeddings has no coexact or harmonic component; a genuine relation encoder is therefore indispensable. Local circulation is not automatically contradiction, and harmonic flow is not automatically missing knowledge. These interpretations and any reduction in factual error require controlled empirical evaluation. This paper presents a mathematical and architectural proposal, not external natural-language performance results.

Closest papers

Nearest neighbours by meaning across the whole index.

ModularPhaseNet: Finite-Cyclic Phase Geometry for Computable Semantic Hierarchy, Direction, and Context Consistency in Standard Transformers

cs.CL cs.LG ·2026-09-05 ·Kiyotaka Kasubuchi, Kazuo Fukiya
theory similarity 0.59
Abstract · 16 pages, 1 figure. Extends arXiv:2602.14419 (WavePhaseNet) and arXiv:2608.15820 (QuantumPhaseNet). Theory and a pre-registered evaluation p…

We propose ModularPhaseNet, a classical and integer-computable discretization of the continuous complex phase geometry introduced in QuantumPhaseNet. The real-valued hidden states of a standard Transformer are retained, while only an auxiliary phase channel is quantized into a cyclic subgroup G = <g> of order q | (p-1) in the multiplicative group of F_p. A continuous phase e^{i phi} is represented by z = g^a mod p; phase composition becomes group multiplication, relative phase becomes group division, conceptual hierarchy is induced by a filtration of cyclic quotients, semantic direction is represented by oriented relative group elements, and contextual consistency is measured by gauge-invariant cycle holonomy. The method introduces three components into an otherwise standard Transformer: a finite-phase encoder, a quotient-filtration hierarchy module, and a group-valued connection module. Their outputs enter self-attention as real-valued bias terms. Training uses distributions in the real group algebra or straight-through Gumbel-Softmax, whereas inference uses exact modular exponentiation and precomputed tables. No quantum hardware, complex-valued matrix multiplication, or discrete-logarithm computation is required. We prove quantization-distortion bounds, nesting of quotient-induced partitions, gauge invariance, a discrete integrability result for flat connections, and boundedness of the resulting attention output. The central empirical hypothesis is that these exact discrete invariants improve hierarchy recovery, discourse alignment, contradiction detection, and calibrated hallucination-risk prediction under a controlled compute budget. This paper reports the theory together with a pre-registered evaluation plan; the experiments described in Section 14 have not yet been carried out, and no empirical result is claimed here.

0.45

Updating a Discrete Morse Vector Field for a Lower Star Filtration Vineyard

cs.CG math.AT ·2026-09-25 ·Kevin Woytowich, Nkechi Nnadi, Elizabeth Munch
similarity 0.54
Abstract

In this paper, we provide a construction of an acyclic discrete vector field that is compatible with a total order associated with a lower star filtration on a simplicial complex, called the colex vector field. We show that the colex vector field induces a filtered acyclic vector field, whose resulting Morse complex computes the persistent homology of the lower star filtration on the underlying simplicial complex. We show that the colex vector field can be recomputed quickly when the vertex function that induces the lower star filtration is modified via order-adjacent vertex swaps. We provide a framework for storing and computing the number of paths between cells in the simplicial complex, as well as a method to update these values quickly when the colex vector field changes. Finally, we provide publicly available proof-of-concept code for the ideas shown. When applying it to the Persistent Homology Transform, we show that its runtime is comparable to a more standard matrix reduction approach.

0.27

QuantumPhaseNet: A Gauge-Covariant Geometric and Quantum-Spectral Theory of Semantic Concept Hierarchies with Prototype Validation of a Classical Quantum-Inspired Model

cs.CL cs.LG ·2026-08-16 ·Kiyotaka Kasubuchi, Kazuo Fukiya
similarity 0.52
Abstract · [PAGES] pages, 8 figures, 4 tables. Extends arXiv:2602.14419 (WavePhaseNet). Includes prototype validation with an offline Validation Studio…

We present QuantumPhaseNet, a gauge-covariant geometric and quantum-spectral extension of Transformer representations. Context-dependent semantic states are modeled as complex amplitudes; a covariant phase rate induces a semantic wavelength used as a proxy for conceptual scale; and low-frequency graph modes define a document-level discourse direction. The theoretical part establishes local gauge invariance, unitarity of the quantum block, boundedness and conditional stability of WavePhase Attention, and a calibratable hallucination-risk formulation. We also implemented a fully offline Validation Studio for the classical quantum-inspired pipeline in Section 14.1 and evaluated the five research questions in Section 16.1 on its built-in synthetic setting (n=240, observation noise 0.22, circuit noise 0.08, five seeds). RQ1 yielded a wavelength-hierarchy Spearman correlation of 0.852 versus 0.707 for the baseline, 87.3% direction accuracy, and AUC 0.953. RQ2 achieved discourse alignment 0.933 versus 0.589 and 41.2 versus 16.2 paragraphs before drift. RQ3 achieved AUROC 0.881 versus cosine 0.765 and phase-shuffle 0.536. RQ4 achieved error-detection AUROC 0.854 versus entropy 0.634, with Brier 0.150 and ECE 0.098. RQ5 did not show quantum advantage: target probability and end-to-end cost efficiency were 25.5% and 0.107, compared with 70.7% and 0.707 for the Chebyshev classical approximation. These results provide initial synthetic evidence for the classical quantum-inspired components, but not external validity or unconditional quantum speedup.

0.35

An Omnidirectional WECT: Closed-Form Computation of the Directionally Integrated Weighted Euler Characteristic Transform

cs.CG ·2026-11-17 ·Jessi Cisewski-Kehe, Brittany Terese Fasy, Alexander McCleary, Eli Quist, Jack Ruder +1 more
similarity 0.51
Abstract · 27 pages, 12 figures

The weighted Euler characteristic transform (WECT) and related directional descriptors have become popular, efficiently computable tools for shape analysis across a variety of domains. In practice, however, they are approximated over a finite set of filtration directions, and thus the vectorized descriptor depends on this choice of directions and the rotational orientation of the data. In this manuscript, we formally introduce the directionally integrated weighted Euler characteristic transform (DIWECT), which averages the WECT over all directions $s \in \mathbb{S}^n$ for a weighted simplicial complex immersed in $\mathbb{R}^{n+1}$. A framework for computing the DIWECT exactly, without sampling directions, is outlined: for each simplex, we partition $\mathbb{S}^n$ into the sets of directions in which a given vertex enters the filtration last, and then the DIWECT at height $t$ reduces to measuring intersections of these regions with a set of directions in which the simplex has entered the filtration by height~$t$. We provide implementations for complexes immersed in $\mathbb{R}^2$ and $\mathbb{R}^3$, in which case the problem reduces to computing arc lengths and spherical areas. Experiments on synthetic and real-world data show that the DIWECT, while resulting in more compact vectorizations, also successfully encodes shape information and discards noise from data orientation. On a barley seed classification task, it outperforms the WECT in every pose except a hand-curated frame, whose advantage disappears under a two-degree rotation error. Compared with averaging the WECT over sampled directions, the DIWECT is often faster at matched accuracy. In one instance, this is upwards of a $50 \times$ speedup on a one-million-cell image with an error of $10^{-3}$.

0.46

Topological Signal Processing With Unoriented Operators

cs.LG ·2026-09-21 ·Andrea Cavallo, Varun Sarathchandran, Geert Leus, Elvin Isufi
similarity 0.46
Abstract

Topological signal processing (TSP) processes signals on simplicial complexes with oriented boundary operators, which is the natural choice for flow signals or when the topological invariants play a role for the task at hand. However, many higher-order signals carry no orientation, and applying oriented operators to them is not well-defined since it introduces an arbitrary choice of simplex orientation. We study an unoriented TSP (UTSP) framework that replaces oriented boundaries with unoriented incidence matrices. First, we show that unoriented incidence and Laplacian matrices between arbitrary simplicial levels admit graph-like spectral properties. Second, since dropping orientation removes the Hodge decomposition, we introduce an unoriented counterpart, termed interaction-order decomposition, which quantifies how much of a higher-order signal is explained by aggregating lower-order signals. Third, we use this decomposition to derive regularizers for signal reconstruction that penalize each interaction order separately. Experiments on real-world data show that the order-aware regularizers outperform oriented baselines, with the largest gains when the signal energy is unevenly distributed across orders.

0.20

HySPE: Positional Encoding via Symplectic Dual Shears

cs.CL ·2026-10-07 ·Zhongping Ji
similarity 0.46
Abstract · 11 pages

We introduce Hyperbolic Symplectic Positional Encoding (HySPE), grounding positional attention in non-compact symplectic transformations. While canonical Rotary Position Embedding (RoPE) parameterizes the compact, elliptic branch of $\Sp(2,\R)$ via rotations, HySPE operationalizes its hyperbolic branch via a damped symmetric composition of dual shears, yielding a conformally symplectic contraction with two spectral decay rates per channel pair. To eliminate the exponential representation drift inherent to naive absolute factorizations, we diagonalize the operator in its invariant eigenbasis and introduce blockwise coordinate rebasing with adaptive centered execution. This guarantees length-independent numerical bounds while matching cached RoPE forward latency (7.21\,ms on an RTX 4090). On TinyShakespeare, HySPE-UltraLong maintains an invariant perplexity of 4.810 up to $16\times$ zero-shot extrapolation ($L=4096$), whereas RoPE degrades to 131.198. Scaled to a 51M-parameter subword Transformer on WikiText-103 ($L_{\text{train}}=512$), HySPE closely matches RoPE in-domain while robustly extrapolating to length 8192, reducing tail perplexity by 83.9\% over RoPE. While these controlled experiments establish HySPE's extrapolation robustness and numerical stability, evaluating its scaling behavior on large-scale foundation models remains an important direction for future investigation.

0.26

Unbelievably Complex

cs.LO ·2026-10-26 ·Hans van Ditmarsch, Djanira Gomes, Rojo Randrianomentsoa, Thomas Studer
similarity 0.45
Abstract

We present the directed simplicial complex: this is an extension of a simplicial complex with a direction on its faces. This enables us to model a local notion of belief in a three-valued semantics, in which formulas may be true, false, or undefined. Of particular interest is a class of directed simplicial complexes called cups, in which any maximal set of vertices of different colors is a facet. Cups permit a more concise relational representation. We give examples and applications of our logical semantics. We then provide a sound and complete axiomatization for the class of directed simplicial complexes and extend it to an axiomatization for the class of cups. We include a detailed technical comparison with other works on belief on complexes. Our work generalizes a prior axiomatization for knowledge on (undirected) impure simplicial complexes.

0.23

Consensus and Persistent Harmonic Edge Circulation in a Hodge-Theoretic Model of Networked Information Flow

cs.SI ·2026-08-15 ·Moses Boudourides
theory similarity 0.44
Abstract

We propose a finite-dimensional cochain model for information flow on an online communication complex. Node variables represent issue positions, while edge variables represent independently modelled signed information flow. The coupling is written in terms of the coboundary operator $d_0$ and the $1$-cochain Hodge Laplacian $Δ_1=d_0d_0^*+d_1^*d_1$. We prove conservation of the mean opinion, a Lyapunov energy law, and convergence to an equilibrium determined by the initial harmonic projection of the edge flow. In particular, node opinions converge to consensus for every initial condition, whereas the edge flow converges to $P_{\mathcal H^1}u_0$. Thus, trivial first cohomology implies decay of the entire edge-flow variable. Nontrivial first cohomology supplies a topological capacity for residual edge circulation. A particular trajectory has a nonzero residual circulation if and only if $P_{\mathcal H^1}u_0\neq 0$, in which case the limiting edge flow is $P_{\mathcal H^1}u_0$. The model therefore establishes that node consensus need not imply decay of an independently represented edge-flow variable; it does not model the formation, reinforcement, or amplification of behavioral echo chambers. We also consider linear damping and a bounded nonlinear saturation as modifications that remove persistent edge flow under the stated assumptions.

0.04