CS Paper Radar

InKAN: B-Spline KANs via Truncated Power Form

Naveen Mysore

cs.LG math.NA ·submitted 2026-09-02 00:17 UTC · v3
code/data

Abstract

Kolmogorov-Arnold Networks (KANs) place learnable B-spline activations on network edges rather than fixed activations on nodes. The standard Cox-de Boor recursion evaluates these activations through $k$ sequential passes for degree-$k$ splines, consuming over 90% of forward-pass time. InKAN replaces this recursion with the truncated power form, a classical result from approximation theory that expresses each uniform cubic B-spline as five $(x)_+^3$ terms at shifted knot positions. The resulting expression computes exact B-spline basis values: the same mathematical function as the Cox-de Boor recursion, evaluated without sequential passes. This paper documents three contributions: (1) an implementation structured for torch . compile fusion, eliminating recursion, span lookup, and scatter-gather operations; (2) a bounded-coordinate evaluation that clamps the normalized input to $[0, k{+}1]$, preventing the growth of cancellation error at large off-support coordinates; and (3) an open-source package (pip install inkan). In the tested configurations, InKAN has 2.8--3.5$\times$ lower forward-pass latency than the Cox-de Boor recursion. Partition-of-unity errors remain below $10^{-5}$ for grid sizes up to 200.

Comment
Open-source implementation: pip install inkan, experiments (speed, classification, regression), 8 Pages

Closest papers

Nearest neighbours by meaning across the whole index.

Hybrid Parallel Bessel KAN Model: a Kolmogorov Arnold Network: integrated framework for developing a novel architecture to reconstruct the fused-basis approach via a parameter free quadratic interaction

cs.LG ·2026-10-13 ·Mintu Pathak, Meshv Patel, Mohendra Roy, Jwngsar Brahma
similarity 0.60
Abstract

The Kolmogorov-Arnold Network (KAN) challenges traditional MLPs by placing learnable activation functions on network edges. However, scaling KANs to spatial data exposes limitations in default B-Splines. While hybrid architectures mix multiple basis families on a single edge to resolve this, monolithic superposition causes geometric overlap, parameter explosion, and severe numerical ill-conditioning ($κ(G) \approx 10^{16}$).To overcome this, we propose Parallel BesselKAN, which isolates B-Spline and low-order Bessel branches into parallel processing pipelines integrated via a parameter-free quadratic interaction. This decoupled architecture acts as an efficient internal ensemble, bypassing monolithic stability bottlenecks. It compresses the parameter footprint by $35\%$ while achieving $97.99\%$ accuracy on MNIST. Although standard MLPs retain a hardware speed advantage for pure vision tasks, Parallel BesselKAN provides a robust, parameter-efficient framework stabilizing mixed-basis networks and paving the way for scalable spatial adaptations like Convolutional KANs.

0.32

Draining Fictitious Knots: Restoring Distance-Awareness Guarantees for High-Dimensional Spline Networks

cs.LG ·2026-09-14 ·Masoud Ataei, Mohammad Javad Khojasteh, Vikas Dhiman
benchmarktheory similarity 0.59
Abstract

Kolmogorov-Arnold Networks (KANs) with spline activations have recently shown promise for interpretable function approximation. Distance-Aware Error for Kolmogorov Networks (DAREK) introduces a computationally efficient bottom-up approach to uncertainty quantification by equipping KANs with distance-aware error bounds; yet, in high-dimensional settings, the theoretical guarantees can be weakened by the emergence of fictitious knots. Inspired by the Kolmogorov-Arnold representation theorem, DAREK adopts a componentwise formulation in which each input dimension is treated separately; as a result, induced knot locations may appear in the combined input space without corresponding to actual training data. These fictitious knots mislead the DAREK uncertainty estimator into reporting low uncertainty far from any real observation, violating the distance-awareness guarantee. We identify this failure mode precisely, characterize its geometric structure, and propose a drainage uncertainty mechanism that restores distance-awareness by constructing a monotonically decreasing uncertainty path from any fictitious knot region toward the nearest real knot. The proposed drainage method provides a practical heuristic correction that mitigates the fictitious-knot failure mode while restoring theoretical distance-awareness in high-dimensional settings. Experiments on a 2D synthetic benchmark and a 100-dimensional face dataset show that drainage raises sampled distance-awareness (SDA) from 85% to 98-99%, matching Gaussian processes at lower computational cost.

0.27

Kolmogorov-Arnold Networks: Curse of Dimensionality and Structural Bias

cs.LG ·2026-10-15 ·Yunhao Ni, Yuxin Guo, Jie Luo, Wenjun Wu, Lei Huang
theory similarity 0.57
Abstract · 25 pages

Kolmogorov-Arnold networks (KANs) have a dimension-independent approximation exponent when the target admits a sufficiently smooth representation by univariate edge functions. We ask whether this favorable scaling belongs to the architecture or to the assumed target class. For arbitrary-depth standard spline-KANs, we prove a worst-case lower bound on isotropic Sobolev balls: below a dimension-independent accuracy threshold, the required number of spline coefficients grows at least exponentially with input dimension. Existing composition-matched MLP results, by contrast, show that favorable exponents on low-arity targets are not exclusive to KANs. We also revisit empirical comparisons. On four scaling-law targets, spline-KAN approximants constructed from known decompositions transfer exactly to MLPs with the cubic ReLU activation $σ(x)=(\max\{0,x\})^3$, although their full dense parameter counts are larger. In controlled ridge-profile scans, KANs have a strong advantage when each nonlinear component depends on one input coordinate. When a component couples multiple input coordinates, this advantage may narrow sharply. At tight budgets, interacting targets often favor MLPs. In the random-label test on MNIST, ReLU-MLPs fit the randomized training labels more efficiently than spline-only KANs. Together, these results locate favorable scaling in target structure and a compatible inductive bias, not a general KAN-specific escape from the curse of dimensionality.

0.29

SW-KAN: Kolmogorov-Arnold Networks with Stieltjes-Wigert q-Orthogonal Polynomials

cs.LG cs.AI ·2026-09-03 ·Amirhosein Azarpour, Seyyed Moein Kazemi
code/data similarity 0.56
Abstract · 22 pages, Code and pretrained models available at: https://github.com/amirhoseinazarpour/SW-KAN

Kolmogorov-Arnold Networks (KANs) represent a paradigmatic shift in deep learning by replacing fixed node activations with learnable univariate functions on edges, offering enhanced interpretability and parameter efficiency. While recent polynomial-based KAN variants have addressed the computational overhead of original B-spline implementations, they introduce a fundamental yet underexplored challenge: the domain mismatch between unbounded real-valued inputs and the bounded or semi-infinite support of orthogonal polynomial bases. To address this limitation, we propose the Stieltjes-Wigert Kolmogorov-Arnold Network (SW-KAN), a novel architecture that employs Stieltjes-Wigert q-orthogonal polynomials defined on the semi-infinite domain (0, infinity). We introduce a smooth exponential-of-tanh mapping that stably bridges the domain gap while preserving well-conditioned gradients, and leverage a numerically stable three-term recurrence that evaluates polynomial expansions in O(N) operations without special-function calls. Through comprehensive experiments spanning image classification and continuous function approximation, we demonstrate that SW-KAN achieves superior accuracy-efficiency trade-offs across diverse tasks. The log-normal weight structure and learnable q-parameter of Stieltjes-Wigert polynomials provide a distinct inductive bias that enables robust performance under resource-constrained conditions, including reduced feature dimensionality and limited training data. The proposed architecture not only outperforms established polynomial KAN baselines on standard benchmarks but also exhibits strong representational capacity for approximating complex multivariate functions with remarkably few parameters, making it a compelling alternative for efficient function approximation and classification in resource-constrained settings.

0.43

TorchCurves: Differentiable Parametric Curves

cs.LG stat.ML ·2026-11-10 ·Alex Shtoff
code/data similarity 0.55
Abstract · Software paper for a library I've been working on for more than a year

We present TorchCurves, a PyTorch library that treats vector-valued parametric curves as learnable primitives. Its central operation maps batches of scalar inputs to points on curves represented in B-spline or Legendre polynomial bases, with differentiation through both inputs and coefficients. Curve coefficients can be optimized jointly with the surrounding model or produced by another network. The library provides trainable modules, reusable basis modules, and a functional interface, supporting applications ranging from continuous feature embeddings to Kolmogorov-Arnold networks and functional regression. Its implementation combines classical evaluation algorithms with vectorized PyTorch operations, emphasizing readability and maintainability without custom hardware kernels. Timing experiments compare curve evaluation against NumPy and SciPy and KAN training against EfficientKAN across a range of problem sizes. The results illustrate where this generality remains computationally practical and where overhead is substantial. Library is available on GitHub at https://github.com/alexshtf/torchcurves.

0.57

Combinatorial maps for hierarchical splines

cs.CG ·2026-08-30 ·Caleb B. Goates, Kendrick M. Shepherd, Derek C. Thomas
similarity 0.54
Abstract

Hierarchical splines are an important part of multiscale and adaptive isogeometric analysis formulations. The Bézier meshes of these splines are an essential part of their definition and of several important hierarchical spline algorithms, such as adaptive refinement and Bézier extraction. Topological data associated with the Bézier mesh-such as adjacency information-can be used to improve the performance of many of these algorithms as well as downstream applications of the splines, but typical hierarchical spline formulations do not compute the topological data, storing instead just a list of elements. In this work we present algorithms to build a performant topological data structure, namely the combinatorial map, to represent Bézier meshes of hierarchical splines over cubical cell complexes where the refinement levels have conforming Bézier meshes. This includes hierarchical and truncated hierarchical B-splines, as well as subsets of other hierarchical spline formulations. We show the performance characteristics of the construction algorithms of these hierarchical combinatorial maps, as well as an example use case, showing that the topological information can provide up to an order of magnitude reduction in computation time in downstream applications of the splines.

0.24

A note on the rectangular Schoenberg-Whitney theorem for clamped B-splines

cs.GR math.NA ·2026-10-17 ·Shutao Tang, Zixuan Zhao
theory similarity 0.53
Abstract · 7 pages, 1 figure

Wang et al.(Computer-Aided Design 40 (2008) 999-1008) proposed a knot-subsequence characterization of full row rank for rectangular B-spline collocation matrices. We identify an incorrect inequality in their Appendix proof, which invalidates the argument as written, and make explicit the endpoint and multiplicity conventions on which the criterion depends. The defect lies in the proof, not in the underlying result, which is valid under suitably stated hypotheses; in the lofting construction of Wang et al. these hypotheses are implicitly satisfied, so the lofted curves are unaffected. We state the corrected result and give a new proof, independent of the disputed argument, for clamped B-splines of arbitrary degree with continuous interior multiplicities. In our proof, sufficiency follows from inclusion of spline spaces and knot insertion; necessity selects independent columns and builds the reduced knot vector from them. The proof uses no recursive column-selection construction.

0.29

Energy-minimized interpolatory B-spline lofting for sequences of closed contours

cs.GR math.NA ·2026-10-17 ·Shutao Tang, Zixuan Zhao
similarity 0.53
Abstract · 19 pages, 9 figures

B-spline lofting through closed cross-sections is common in reverse engineering, but interpolating each section on its own knot vector can produce an unnecessarily large control net. We construct a common-knot method for closed section curves of odd and even degree by minimizing the strain energy of each section subject to its interpolation constraints. Feasibility for closed section data and uniqueness of the resulting saddle-point solution require full row rank of the periodic collocation matrices, a property that a previously proposed periodic Schoenberg-Whitney window condition does not always guarantee. We establish the exact parity distinction: the condition is sufficient at odd point counts but admits singular configurations at every admissible even point count. For the odd and even degrees used here, the natural and shifting anchor knots are nonsingular; at odd point counts the window condition certifies the selected candidate, whereas at even point counts a rank test with an anchor fallback is applied. The lofting method therefore retains a nonsingular square subsystem for each section and uses nestedness to transfer full row rank to the rectangular common-knot system. Across six closed-contour models the common-knot method uses 83-98% fewer control points than traditional interpolating lofting, with section energies no larger than those of a previous knot-selection method within numerical precision.

0.29