CS Paper Radar

Memristive-Friendly Hadamard Reservoir Computing: Structured, Multiplier-Free Recurrences at Scale

Andrea Ceni, Gianluca Milano, Carlo Ricciardi, Claudio Gallicchio

cs.AI ·submitted 2026-08-28 12:58 UTC · v1

Abstract

Reservoir Computing (RC) designs Recurrent Neural Networks around a fixed, i.e., untrained, recurrent layer, and is a natural candidate for neuromorphic hardware. Memristive-friendly reservoirs derive the neuron dynamics from memristive-device kinetics, but still rely on dense recurrent matrices, which are expensive to realize physically. In this paper, we replace the dense matrix with a structured orthogonal operator, built from sign diagonals, a permutation, and a fast Walsh-Hadamard transform. The operator is multiplier-free, requires $O(N)$ parameters and $O(N\log N)$ operations per step, and is never materialized as a matrix. We instantiate it in a standard and in a memristive-friendly Echo State Network, with one binary input connection per unit. Our mathematical analysis shows that exact orthogonality yields an echo state condition that is tight in the recurrent scaling, and a noise response that is predictable at design time. Moreover, the operator mixes the whole state in a single application. Experiments on twenty classification and seven regression benchmarks, at reservoir sizes up to $N = 8192$, show that the structured models match dense orthogonal reservoirs, and achieve better mean performance than the cycle reservoir by a margin that widens with size. Furthermore, we time the recurrent step on three hardware platforms, where it is up to $50\times$ faster than a dense product and $10^4\times$ smaller in memory. Finally, we ablate the operator and measure the response to noise, quantization, device mismatch and discrete faults.

Comment
submitted to Neurocomputing

Closest papers

Nearest neighbours by meaning across the whole index.

A Time-Based Readout for Vector-Matrix Multiplication in Fully Analog Memristive SNNs

cs.ET cs.AIcs.AR ·2026-09-10 ·Elia Mateu-Barriendos, Álvaro Gómez-Pau, Josep Rius, Daniel Arumí, Rosa Rodríguez-Montañés +1 more
published similarity 0.64
Abstract · Accepted at 2026 IEEE 33rd International Conference on Electronics, Circuits and Systems (ICECS)

Artificial neural networks rely on vector-matrix multiplications (VMMs), whose implementation in von Neumann architectures is dominated by costly data movement between memory and processing units. Spiking neural networks (SNNs) mitigate this bottleneck by performing in-memory, analog VMMs using memristive crossbar arrays. However, conventional current-mode readout circuits incur significant area and power overhead. This work proposes a fully analog readout architecture based on voltage-to-time conversion of the VMM output. By sensing the column voltage, the proposed approach avoids current-mode summing and scaling circuitry, improving area and energy efficiency. Post-layout simulations of a 10x1 SNN implemented in a 130 nm CMOS technology validate the proposed architecture, while application to a trained 64x10 SNN for digit classification further demonstrates its feasibility for SNN inference.

0.52

BPU-SpikeMM:Exact Matrix Multiplication via Spatio-Temporal Spike Encoding on Real Neuromorphic Hardware

cs.DC ·2026-11-13 ·Rongyuan Guo, Yufeng Zhang, Haotian Wang, Canming Yao, Yuxiang Huan +2 more
theory similarity 0.64
Abstract

Matrix multiplication is the dominant computational kernel in deep learning, yet its growing scale strains conventional von Neumann hardware in energy efficiency and bandwidth. Neuromorphic architectures offer a promising alternative, but mathematical equivalence between matrix multiplication and spiking computation does not guarantee direct execution on real neuromorphic hardware, as the specific hardware paradigm may still require additional data recovery, bit-weight reconstruction, or state readout after neuromorphic execution. This paper presents BPU-SpikeMM (Brain Processing Unit-based Spike Matrix Multiplication), an exact spatio-temporal spike encoding framework for matrix multiplication on real neuromorphic hardware. We prove the exact equivalence of spike-encoded matrix multiplication under the BPU execution paradigm, distinguish mathematical equivalence from native direct-readout equivalence on BPU hardware, and build a spatio-temporal offloading pipeline supporting multiple encoding schemes. Furthermore, we extend the framework to a multi-dimensional encoding design space and evaluate the applicability of different encodings on real BPU hardware in terms of correctness, temporal resource cost, spatial resource cost, and event-driven metrics. The results confirm native direct-readout equivalence across all evaluated encoding schemes and show that their applicability to BPU execution depends on joint trade-offs among temporal cost, spatial resource consumption, and event activity.

0.14

Hardware-Aware Model Inversion in Memristive Spiking Neural Networks

cs.CR cs.ETcs.NE ·2026-10-29 ·Pablo Sorrentino, Fernando M. Quintana, Erika Covi, Fatih Turkmen
similarity 0.61
Abstract · 15 pages, 8 figures

Hardware-accelerated spiking neural networks (SNNs) implemented on memristive crossbar arrays offer significant gains in energy efficiency, while device variability and analog noise are sometimes assumed to hinder information extraction. However, whether these hardware effects improve, preserve, or degrade privacy after deployment remains largely unexplored. Therefore, we ask whether model-inversion leakage characterized on an SNN remains representative after the same model is mapped to a non-ideal memristive substrate, and how hardware non-idealities and reliability faults affecting synapses, neuron thresholds, and spike processing reshape that leakage. To study this problem, we introduce Spiking Domain Model Inversion (SDMI), an inversion method that combines Expectation over Transformation (EOT) with surrogate gradients to optimize inputs through stochastic analog behavior and non-differentiable spiking dynamics. We use SDMI consistently across the SNN model, its memristive SNN, and the same memristive SNN under additional hardware perturbations. Across four datasets, reconstruction leakage does not vary monotonically with model accuracy or hardware variability. At comparable accuracy levels, neuron-threshold perturbations increase reconstruction fidelity, measured by SSIM, by up to 51.8%, whereas spike-level perturbations primarily degrade utility without consistently improving reconstruction. Weight noise, in contrast, reduces leakage under the same inversion procedure. These results show that hardware variability is not inherently privacy-preserving: model inversion leakage in memristive SNNs depends on the hardware state and cannot be inferred from model accuracy alone.

0.14

Power-MSE trade-off of Factorized Low-rank Approximated Computation Scheme with Memristors

eess.SP ·2026-09-24 ·Binyu Lu, Matthias Frey, Stark Draper, Jingge Zhu
similarity 0.60
Abstract

Memristor crossbars enable analog vector-matrix multiplication (VMM) which is promising for machine learning applications. Scaling matrix entries to lower memristor conductance levels reduces power consumption but increases the impact of memristor programming noise on VMM accuracy. To investigate how low-rank factorization can improve this trade-off, we extend the previously proposed factorized low-rank approximation scheme (FLAS) to support adjustable conductance scaling. We then derive closed-form MSE and power expressions for both FLAS and baseline VMM. Based on these expressions, we establish an analytical power-MSE trade-off framework to capture the coupled effects of approximation rank, replication allocation, and conductance scaling under constraints on memristor count and conductance scaling bounds. Numerical results demonstrate FLAS's power-MSE advantage across matrices with different singular value spectra. The power decomposition explains how TIA feedback resistance affect this advantage.

0.13

RRAM circuit-enabled nonlinear precoding and bit precision analysis

eess.SP ·2026-08-15 ·Yuhao Zhang, Haifan Yin, Tao Wang, Jindiao Huang, Kewei Zhu
top venuetheory similarity 0.60
Abstract · 15 pages, 13 figures. Accepted for publication in IEEE Transactions on Communications

The rising number of users and antennas imposes exponentially growing computational loads on future communication systems. Yet conventional processors are facing a bottleneck for their nature of memory-computing separation. In-memory computing (IMC) emerges as a promising solution leveraging its intrinsic high parallelism. This work proposes an IMC architecture that employs resistive random access memory (RRAM) to reduce the computational complexity of the nonlinear Tomlinson-Harashima precoding (THP) to a linear scale. We present a computation-constraint principle for designing RRAM circuits to perform nonlinear matrix operations and construct an LQ decomposition RRAM circuit. Since the conductance of memristor is generally quantized, we perform the bit precision analysis and derive the lower bound of the Signal-to-Interference-plus-Noise Ratio (SINR) and achievable rate. Our analysis indicates that at a high Signal-to-Noise Ratio (SNR) or with a large number of antennas, each 1-bit precision increase yields 6 dB SINR gain and linear rate growth. For practical implementation, we derive the optimal bit precision to sustain SINR performance under varying system configurations. Simulation demonstrates the feasibility and accuracy of the RRAM-based circuit and our theoretical analysis. Our work proves that RRAM-based IMC holds significant potential for high-complexity nonlinear precoding, addressing the escalating computational demands for future communications.

0.35

Scaled Hippocampus-inspired Neural Networks on Neuromorphic Memristive Hardware

cs.NE cs.ET ·2026-09-14 ·Joseph A. Kilgore, Jeffrey D. Kopsick, Zahin Ahmed, Giorgio A. Ascoli, Gina C. Adam
similarity 0.59
Abstract

The hippocampus, a key brain region for learning and memory, exhibits rich structural diversity, sparse communication, and robust dynamics with incredible energy efficiency. It offers promising insights for novel computing capabilities, particularly when co-designed with emerging hardware technologies. In this work, we draw inspiration from the rodent CA3 hippocampal subregion to develop the first spiking neural network with neuronal diversity and biologically-realistic resting state dynamics demonstrated on memristor hardware. We propose a network downscaling methodology utilizing a 4-prong objective function and demonstrate a small-scale CA3-inspired network with 179 Izhikevich-modeled neurons, 3 neuronal types and 17,996 synapses with similar resting-state dynamics as the orders-of-magnitude larger full-scale network. The small-scale network is mapped to an FPGA/memristor platform using a greedy algorithm and 18,316 memristors. Benefiting from memristor noise, the hardware implementation shows continuous periodic behavior, outperforming simulated hardware. This work showcases the potential of biologically-realistic algorithms on emerging hardware for neuromorphic computing.

0.25

Input-dependent Neuromodulation Enhances Mixed-Signal Neuromorphic Hardware

cs.NE cs.ET ·2026-10-30 ·Aashman Mehta, AbdelQader AlKilany, Dan F. M. Goodman, Giacomo Indiveri, Melika Payvand
similarity 0.59
Abstract · 5 pages, 3 figures. Submitted to IEEE ISCAS 2027

Gating mechanisms allow a fixed neural network to adapt its computation to the current input by dynamically modulating its effective parameters. In the brain, neuromodulation uses this principle to move neural circuits between dynamical regimes, and deep learning exploits input-dependent gating, e.g., in gated recurrent networks and self-attention. Input-dependent modulation has also recently been shown to improve spiking neural networks, with particularly strong benefits in small, parameter-limited ones. This makes neuromodulation especially promising for neuromorphic processors at the edge, where area, memory and energy budgets constrain network size, while circuit physics limits parameter precision. Here we demonstrate input-dependent, within-trial neuromodulation of a spiking recurrent neural network on a mixed-signal neuromorphic processor. An off-chip modulator reads the on-chip network's input and activity and adjusts its population-level gains while the chip's analog circuits compute with the physics of the silicon. Neuromodulation raises binary spoken-digit classification accuracy by $+17.3 \pm 10.4$ percentage points, tested across five hardware network instantiations.

0.23

Local learning with imperfect analog synapses

cs.ET ·2026-10-20 ·Théo Dupuis, Adrien Renaudineau, Guillaume Bourgeois, Joel Minguet Lopez, Gabriele Navarro +4 more
similarity 0.58
Abstract

Analog in-memory computing delivers efficient neural network inference at the edge, but systems deployed in non-stationary environments may need to adapt in situ to locally acquired data. Backpropagation faces two structural obstacles here. Its global error transport lets stochastic write errors compound across layers, and its backward pass demands bidirectional, high-precision peripheral circuitry absent from inference-oriented crossbar arrays. We introduce Channel-wise Spatial Gradient learning (CwSG), a strictly local, forward-only rule that trains each convolutional layer by rewarding spatial variation in its feature maps. In simulations replaying the measured trajectories of 1,189 phase-change memory and 1,268 filamentary memristor devices, CwSG learns with single, unverified, sub-1 V pulses. It matches backpropagation on phase-change memory with 59-fold fewer pulses and outperforms it by 53 percentage points on highly variable filamentary memristors, with 8-bit forward converters and without transposed crossbar reads or network-wide activation storage. Analog training thus becomes a problem of credit assignment, in which algorithmic design rather than hardware compensation alone overcomes severe programming noise.

0.15