CS Paper Radar

Power-MSE trade-off of Factorized Low-rank Approximated Computation Scheme with Memristors

Binyu Lu, Matthias Frey, Stark Draper, Jingge Zhu

eess.SP ·submitted 2026-09-24 12:47 UTC · v1

Abstract

Memristor crossbars enable analog vector-matrix multiplication (VMM) which is promising for machine learning applications. Scaling matrix entries to lower memristor conductance levels reduces power consumption but increases the impact of memristor programming noise on VMM accuracy. To investigate how low-rank factorization can improve this trade-off, we extend the previously proposed factorized low-rank approximation scheme (FLAS) to support adjustable conductance scaling. We then derive closed-form MSE and power expressions for both FLAS and baseline VMM. Based on these expressions, we establish an analytical power-MSE trade-off framework to capture the coupled effects of approximation rank, replication allocation, and conductance scaling under constraints on memristor count and conductance scaling bounds. Numerical results demonstrate FLAS's power-MSE advantage across matrices with different singular value spectra. The power decomposition explains how TIA feedback resistance affect this advantage.

Closest papers

Nearest neighbours by meaning across the whole index.

A Time-Based Readout for Vector-Matrix Multiplication in Fully Analog Memristive SNNs

cs.ET cs.AIcs.AR ·2026-09-10 ·Elia Mateu-Barriendos, Álvaro Gómez-Pau, Josep Rius, Daniel Arumí, Rosa Rodríguez-Montañés +1 more
published similarity 0.71
Abstract · Accepted at 2026 IEEE 33rd International Conference on Electronics, Circuits and Systems (ICECS)

Artificial neural networks rely on vector-matrix multiplications (VMMs), whose implementation in von Neumann architectures is dominated by costly data movement between memory and processing units. Spiking neural networks (SNNs) mitigate this bottleneck by performing in-memory, analog VMMs using memristive crossbar arrays. However, conventional current-mode readout circuits incur significant area and power overhead. This work proposes a fully analog readout architecture based on voltage-to-time conversion of the VMM output. By sensing the column voltage, the proposed approach avoids current-mode summing and scaling circuitry, improving area and energy efficiency. Post-layout simulations of a 10x1 SNN implemented in a 130 nm CMOS technology validate the proposed architecture, while application to a trained 64x10 SNN for digit classification further demonstrates its feasibility for SNN inference.

0.51

RRAM circuit-enabled nonlinear precoding and bit precision analysis

eess.SP ·2026-08-15 ·Yuhao Zhang, Haifan Yin, Tao Wang, Jindiao Huang, Kewei Zhu
top venuetheory similarity 0.66
Abstract · 15 pages, 13 figures. Accepted for publication in IEEE Transactions on Communications

The rising number of users and antennas imposes exponentially growing computational loads on future communication systems. Yet conventional processors are facing a bottleneck for their nature of memory-computing separation. In-memory computing (IMC) emerges as a promising solution leveraging its intrinsic high parallelism. This work proposes an IMC architecture that employs resistive random access memory (RRAM) to reduce the computational complexity of the nonlinear Tomlinson-Harashima precoding (THP) to a linear scale. We present a computation-constraint principle for designing RRAM circuits to perform nonlinear matrix operations and construct an LQ decomposition RRAM circuit. Since the conductance of memristor is generally quantized, we perform the bit precision analysis and derive the lower bound of the Signal-to-Interference-plus-Noise Ratio (SINR) and achievable rate. Our analysis indicates that at a high Signal-to-Noise Ratio (SNR) or with a large number of antennas, each 1-bit precision increase yields 6 dB SINR gain and linear rate growth. For practical implementation, we derive the optimal bit precision to sustain SINR performance under varying system configurations. Simulation demonstrates the feasibility and accuracy of the RRAM-based circuit and our theoretical analysis. Our work proves that RRAM-based IMC holds significant potential for high-complexity nonlinear precoding, addressing the escalating computational demands for future communications.

0.35

Memristive-Friendly Hadamard Reservoir Computing: Structured, Multiplier-Free Recurrences at Scale

cs.AI ·2026-08-28 ·Andrea Ceni, Gianluca Milano, Carlo Ricciardi, Claudio Gallicchio
similarity 0.60
Abstract · submitted to Neurocomputing

Reservoir Computing (RC) designs Recurrent Neural Networks around a fixed, i.e., untrained, recurrent layer, and is a natural candidate for neuromorphic hardware. Memristive-friendly reservoirs derive the neuron dynamics from memristive-device kinetics, but still rely on dense recurrent matrices, which are expensive to realize physically. In this paper, we replace the dense matrix with a structured orthogonal operator, built from sign diagonals, a permutation, and a fast Walsh-Hadamard transform. The operator is multiplier-free, requires $O(N)$ parameters and $O(N\log N)$ operations per step, and is never materialized as a matrix. We instantiate it in a standard and in a memristive-friendly Echo State Network, with one binary input connection per unit. Our mathematical analysis shows that exact orthogonality yields an echo state condition that is tight in the recurrent scaling, and a noise response that is predictable at design time. Moreover, the operator mixes the whole state in a single application. Experiments on twenty classification and seven regression benchmarks, at reservoir sizes up to $N = 8192$, show that the structured models match dense orthogonal reservoirs, and achieve better mean performance than the cycle reservoir by a margin that widens with size. Furthermore, we time the recurrent step on three hardware platforms, where it is up to $50\times$ faster than a dense product and $10^4\times$ smaller in memory. Finally, we ablate the operator and measure the response to noise, quantization, device mismatch and discrete faults.

0.25

OTTER - Two Transistor - One RRAM Architecture for Reliable In-Memory-Computing in 28 nm CMOS Technology

cs.ET ·2026-09-08 ·Yang Chen, Daniele Storelli, Xinyi Zhao, Ankit Bende, Paul-Philipp Manea +18 more
similarity 0.57
Abstract

This work presents OTTER, a 28 nm CMOS platform co-integrated with TaOx-based valence-change mechanism (VCM) RRAM, demonstrating a two-transistor-one-memristive-device (2T1R) architecture for reliable in-memory computing. The 2T1R cell combines a low-drive-current (LD) transistor and a high-drive-current (HD) transistor in parallel, providing dedicated bias paths for SET programming and RESET operation, respectively. Through systematic experimental and simulated comparison of various transistor-pairing configurations using the physical compact model JART VCM Rth, design guidelines for transistor sizing are derived, establishing the minimum RESET transistor W/L required for complete RESET as a function of the SET current compliance. The 2T1R cell is further characterized under pulse-based programming, demonstrating multilevel analog conductance tuning with narrow, well separated conductance states across six programmable levels. An analog content-addressable memory (aCAM) design based on the same 2T1R cell is additionally analyzed at the circuit level, evaluating trade-offs between top- and bottom-connected RRAM comparator configurations. A hardware implementation of compute-in-memory (CIM) multiply-and-accumulate (MAC) operations is further demonstrated on a 15 x 15 2T1R crossbar array.

0.29

Continuous Kinetic Model of Counterion-Mediated Redox Switching in 14-Bit Molecular Memristors for Analog In-Memory Computing

cs.AR ·2026-11-02 ·Logan Larsh, Dhiman Biswas, Nazmus Saadat As-Saquib, Su-in Yi, Thirumalai Venkatesan +1 more
similarity 0.57
Abstract

Kinetic molecular memristors offer a compelling path toward high-density analog in-memory computing by achieving 14-bit precision, wherein discrete redox transitions and counterion displacements dictate non-volatile conductance across a deterministic energy landscape. However, integrating these nanoscale kinetics into macroscale circuit simulators has remained bottlenecked by derivative discontinuities and solver convergence failures. Here, we present a physics-inspired continuous kinetic model that bridges microscopic molecular transport with scalable circuit architectures. By casting discrete intramolecular states, counterion relaxation dynamics, and Marcus-Hush-Chidsey electron transfer rates into continuously differentiable state variables, we derive a robust, Spectre-compatible compact model and a matching vectorized Python solver. This work culminates in a unified computational platform to reliably predict the behavior of complex circuits built on these molecular memristors.

0.22

Local learning with imperfect analog synapses

cs.ET ·2026-10-20 ·Théo Dupuis, Adrien Renaudineau, Guillaume Bourgeois, Joel Minguet Lopez, Gabriele Navarro +4 more
similarity 0.57
Abstract

Analog in-memory computing delivers efficient neural network inference at the edge, but systems deployed in non-stationary environments may need to adapt in situ to locally acquired data. Backpropagation faces two structural obstacles here. Its global error transport lets stochastic write errors compound across layers, and its backward pass demands bidirectional, high-precision peripheral circuitry absent from inference-oriented crossbar arrays. We introduce Channel-wise Spatial Gradient learning (CwSG), a strictly local, forward-only rule that trains each convolutional layer by rewarding spatial variation in its feature maps. In simulations replaying the measured trajectories of 1,189 phase-change memory and 1,268 filamentary memristor devices, CwSG learns with single, unverified, sub-1 V pulses. It matches backpropagation on phase-change memory with 59-fold fewer pulses and outperforms it by 53 percentage points on highly variable filamentary memristors, with 8-bit forward converters and without transposed crossbar reads or network-wide activation storage. Analog training thus becomes a problem of credit assignment, in which algorithmic design rather than hardware compensation alone overcomes severe programming noise.

0.15

State-Dependent Memristor Dynamics for Device-Informed Spike-Timing-Dependent Plasticity in Spiking Neural Networks

cs.NE ·2026-10-28 ·Samiur Rahman Khan, Saifur Rahman Sabuj
similarity 0.56
Abstract · 14 pages, 8 figures. Manuscript under review

This work investigates device-informed spike-timing-dependent plasticity (STDP) in spiking neural networks using a literature-derived threshold-memristor model. Local STDP commands determine programming polarity and a programming coordinate for state-dependent conductance updates in the first fully connected layer, while a backpropagation-trained readout performs classification. HSPICE simulations characterize thresholded, polarity- and state-dependent device dynamics and differential crossbar multiply-accumulate behavior. Experiments on MNIST and Fashion-MNIST compare the hybrid learning rule with direct clipped STDP and evaluate programming asymmetry, device-parameter variation, write noise, stuck-at faults, and input corruption. The hybrid model achieved 95.15% accuracy on MNIST and 85.92% on Fashion-MNIST. In a separate seed-matched comparison, it reached 95.02% and 84.79%, versus 92.33% and 83.25% for direct clipped STDP. Potentiation-dominant asymmetry reduced input-dependent feature selectivity, and endpoint faults introduced during training were less damaging than faults introduced after training. The network-level mapping is a reduced-order, validation-selected abstraction rather than a pulse-accurate physical programming implementation. These results quantify how state-dependent memristor dynamics shape local-STDP learning and its sensitivity to hardware nonidealities.

0.18

An Emerging NVM-Based On-Chip Training Architecture with Non-Ideality Mitigation Through Bipolar Weight Distributions

cs.AR ·2026-09-01 ·Peng Dang, Youna Huang, Yintao He, Huawei Li
top venuebenchmark similarity 0.55
Abstract · 14 pages. Accepted for publication in IEEE Transactions on Very Large Scale Integration (VLSI) Systems

The rapid advancement of deep learning has presented significant energy efficiency challenges to the conventional von Neumann architecture. In-memory computing (IMC) architectures based on emerging non-volatile memory (eNVM) are widely regarded as a promising solution for accelerating neural network training due to their high parallelism and low power consumption. However, the intrinsic non-idealities of eNVM devices can cause conductance updates to deviate from target values, thereby limiting the performance of on-chip training. To address this challenge, this paper presents a Non-ideality Optimized eNVM Accelerator (NOVA) architecture for on-chip training. Specifically, we first fabricate a two-dimensional (2D) ferroelectric field-effect transistor (FeFET) and develop a conductance modulation behavioral model calibrated with experimental data. Building upon this device model, we propose, for the first time, a Non-ideality Avoidance Training (NAT) algorithm tailored for eNVM devices, which mitigates accuracy degradation by guiding weight convergence toward the most stable conductance regions of eNVM devices. Experimental results demonstrate that, even under severe device asymmetry, NAT improves the accuracy by an average of 15.1\% over the baseline methods across multiple benchmark tasks. Meanwhile, the NOVA achieves an average energy efficiency gain of approximately 33.58$\times$ compared with the peak energy efficiency of graphics processing units (GPUs).

0.68