CS Paper Radar

A Regularized Block Diagonal RLS Algorithm for Acoustic Echo Cancellation

Ruibin Hou, Chenggang Zhang, Yufeng Diao

cs.SD eess.AS ·submitted 2026-08-21 03:00 UTC · v1
unusual

Abstract

While the recursive least square (RLS) algorithm is widely used in adaptive filtering applications like acoustic echo cancellation (AEC) due to its fast convergence rate, its high computational complexity severely limit its practical deployment for long filters. In this paper, a regularized block-diagonal RLS (RBD-RLS) algorithm is proposed to address these challenges. By approximating the inverse covariance matrix as a block-diagonal structure, RBD-RLS simplifies the update process into independent parallel computations of sub-blocks, effectively reducing the computational complexity. Additionally, Tikhonov regularization is applied to each sub-blocks for enhance numerical stability. A series of experimental results demonstrate that RBD-RLS maintains good convergence while significantly reducing computational complexity. Moreover, it still exhibits relative robustness in real-world scenarios.

Closest papers

Nearest neighbours by meaning across the whole index.

A Lightweight Hybrid Framework for Acoustic Echo Cancellation and Suppression via Constrained Recursive Training

eess.AS ·2026-10-07 ·Huawei Zhang, Rilin Chen, Hao Zhang, Meng Yu, Dong Yu
similarity 0.60
Abstract · Accepted by the 19th International Workshop on Acoustic Signal Enhancement (IWAENC 2026)

We propose a hybrid framework that combines deep learning with adaptive filtering for acoustic echo cancellation (AEC) and suppression. It integrates a multi-output neural network to jointly update filter parameters and perform post-processing. A learnable variant of the normalized least mean squares (NLMS) filter is introduced, incorporating a variable step size and a variable transition factor that are recursively updated for dynamic adaptation. In addition, an enhanced near-end speech estimate is generated from the filter output to suppress the residual echoes. To ensure training stability, we propose a constrained recursive training strategy that aligns with the adaptive nature of the filter, where an upper-bound constraint is introduced on the filter output. For efficiency, the framework adopts a lightweight implementation with only 253 k parameters. Experimental results show that the framework outperforms the baselines in terms of both signal quality and speech intelligibility.

0.12

ARIA: Anti-diagonal Reduced-cost Index-masked Adaptive BLMS Algorithm

eess.SP ·2026-11-04 ·Mohd Tasleem Khan
similarity 0.55
Abstract

The block least-mean-square (BLMS) algorithm supports high-throughput adaptive filtering but incurs high computational cost as the filter length and block size increase. This letter proposes anti-diagonal reduced-cost index-masked (ARIA) adaptive BLMS, which reduces coefficient-update multiplications through anti-diagonal index masking and tap-wise step-size scaling while keeping the filtering exact. Mean-square error (MSE) analysis establishes an explicit step-size bound, and misadjustment. An extension, ARIA-MF (ARIA with masked filtering), also applies the mask during filtering; its analysis shows that the excess MSE is redistributed across block rows while its block average is approximately preserved. Simulations validate the analysis and shows very good agreement with the estimates

0.28

Knowledge Distillation for Efficient Acoustic Echo Control

eess.AS ·2026-08-26 ·Ernst Seidel, Pejman Mowlaee, Tim Fingscheidt
published similarity 0.54
Abstract · 5 pages, accepted to EUSIPCO 2026

In recent years, many efforts have been made to supersede classical acoustic echo control (AEC) algorithms with more powerful machine-learned approaches. While surpassing the performance of well-established adaptive filters is very much possible, a remaining challenge is computational complexity. Popular architectures, such as convolutional recurrent networks (CRNs), are by multiple orders of magnitude computationally more expensive than classical signal processing solutions. Scaling down such models is usually straight-forward, but it comes at the cost of a notably reduced performance. We show - to the author's knowledge for the first time in AEC - how these performance drops can be successfully alleviated to a large degree by employing an effective knowledge distillation (KD) process, enabling more potent efficient AEC. Our proposed CGGN16 student AEC models show significantly less near-end speech distortion at only 2% of its teacher's computational complexity, surpass the overall performance of a six times more complex model trained on ground-truth labels, and outperform other AEC-focused architectures from recent literature.

0.22

Structured Pruning of Feedback Delay Networks

eess.AS eess.SPmath.NA ·2026-10-28 ·Facundo Franchino, Karolina Prawda
similarity 0.53
Abstract · 11 pages, 8 figures, 4 tables. Submitted to the IEEE Open Journal of Signal Processing

Feedback delay networks (FDNs) are recursive filter structures used to synthesise artificial reverberation. Their feedback matrix governs both energy exchange between delay lines and the computation required at every sample, making its design central to balancing an FDN's acoustic performance and implementation efficiency. In this work, we develop an FDN-specific structured pruning method that connects these acoustic and computational concerns, allowing high-order dense orthogonal designs to be fitted to efficient implementations. The feedback matrix is replaced by stages of fixed permutations and small orthogonal blocks. We characterise connectivity growth with the network depth and derive exact conditional block updates for matrix fitting, followed by refinement against the reference FDN magnitude response. The resulting factors admit direct vectorised evaluation, with arithmetic cost and coefficient storage scaling linearly with network size for fixed block size and depth. On an Apple M2, the selected staged kernels achieve feedback-multiplication speedups over dense BLAS ranging from approximately threefold to over twentyfold across the tested network sizes, while substantially reducing coefficient storage. Objective metrics and listening tests indicate that the proposed staged approximations closely preserve the spectral and temporal character of their dense references. An analysis of processor utilisation and register reuse explains why execution time depends on more than the operation count. Finally, block size and depth provide practical control over response fidelity, storage, and real-time cost, allowing acoustic design to precede the choice of an efficient implementation.

0.26

Adaptive Filtering With Reduced Computational Complexity Using SOPOT Arithmetic

eess.SP ·2026-11-18 ·Luiz F. da S. Coelho, Lisandro Lovisolo, Michel P. Tcheou
published similarity 0.50
Abstract

Implementing finite impulse response (FIR) adaptive filters by employing the sums of signed-powers-of-two (SOPOT) arithmetic may lead to simpler hardware and consequently reduced power consumption. In this paper, one evaluates the effects of SOPOT arithmetic on the adaptive filter's recursion algorithms. The filters' coefficients and algorithms' underlying variables are fully operated using SOPOT arithmetic in the whole iterative process. More specifically, one evaluates convergence rate, numerical stability, and accuracy since using few signed-powers-of-two (SPT) terms propagates numerical errors during the adaptive cycle that may impair the algorithm behavior. The SOPOT approximations are obtained through the technique known as Matching Pursuits with Generalized Bit-Plane (MPGBP) algorithm, with notable cost-performance trade-off and low computational complexity. Results are provided for the Least-Mean-Squares (LMS), the Normalized Least-Mean-Squares (NLMS) and the Recursive-Least-Squares (RLS) algorithms, considering adaptive filters employed for system identification and change detection.

0.41

Blind Noise Equalization for Large Data Matrices under General Variance Profiles

cs.LG stat.MLeess.SPmath.ST+1 ·2026-11-05 ·Boris Landa, Francesco Strino, Fabio Parisi, Ruiqi Li, Yuval Kluger
theory similarity 0.48
Abstract

Low-rank approximation is a basic tool for inference from large and noisy data matrices. However, when noise variances differ across entries, a setting known as heteroskedasticity, the noise can distort the observed spectrum, producing spurious components and obscuring weak signals. To address these challenges, we develop BRINE (Blind Resolvent-based Iterative Noise Equalizer), a data-driven procedure that iteratively rescales rows and columns to equalize the average noise variance across both dimensions. Under suitable conditions, this procedure restores the Marchenko-Pastur law for the noise spectrum and can amplify signal components without prior knowledge of the signal or noise structure. A key idea underlying our approach is to equalize the diagonal entries of the data resolvent as a proxy for equalizing the unknown noise variances. At the population level, we identify a potential function that characterizes this equalization and motivates an iterative minimization procedure. We prove convergence of the iterations to the true equalizer for arbitrary positive variance profiles, with a geometric rate under mild conditions. The updates can be estimated directly from noisy data, and we establish probabilistic error bounds for the scaling factors. Simulations and experiments across diverse biological data modalities and preprocessing pipelines illustrate the effectiveness of our approach.

0.30

Gaussian-trigonometric functional link artificial neural network: design and analysis

eess.SP ·2026-09-13 ·Jie Wang, Lu Lu, Yi Yu, Xiaodong Li, Chengshi Zheng +1 more
top venueunusual similarity 0.48
Abstract · 16 pages, 9 figures

This paper proposes a Gaussian function-based trigonometric functional link artificial neural network (GTFLN) filter for linear-in-the-parameters nonlinear filtering. Compared with the adaptive exponential TFLN (AETFLN) filter, the GTFLN filter provides smooth and localized basis functions with reduced computational complexity, where modeling advantages are theoretically established through the smoothness, reproducing kernel Hilbert space, approximation error, and operator theory properties. To maximize the modeling performance, an optimized scaling parameter for the GTFLN filter is derived, yielding the optimized GTFLN (OGTFLN) filter. Least mean square (LMS) adaptation is applied to the GTFLN and OGTFLN filters for nonlinear system identification, resulting in the GTFLMS and OGTFLMS algorithms, respectively. Moreover, the theoretical steady-state excess mean-square error of the GTFLN filter is analyzed. Simulations validate the effectiveness of the theoretical analysis and demonstrate the improved performance of the GTFLN and OGTFLN filters over the linear-in-the-parameters benchmarks in nonlinear system identification and nonlinear acoustic echo cancellation. Based on the GTFLN filter, the filtered-g LMS (FgLMS) algorithm is proposed for nonlinear active noise control. Simulations demonstrate improved stability and noise reduction performance compared to the benchmarks.

0.46

Online Algorithms for Independent Low-Rank Matrix Analysis and Rank-Constrained Spatial Covariance Matrix Estimation Based on Maximum Weighted Likelihood Estimation

cs.SD ·2026-09-18 ·Yuto Ishikawa, Norihiro Takamune, Tomohiko Nakamura, Daichi Kitamura, Hiroshi Saruwatari +2 more
similarity 0.48
Abstract · Under review for IEEE OJSP

Real-time multichannel speech extraction (MSE) under diffuse noise conditions is an important task with a wide range of applications, such as speech recognition and hearing aids. In this paper, we propose online algorithms for independent low-rank matrix analysis (ILRMA) and rank-constrained spatial covariance matrix estimation (RCSCME). Previously, we proposed a real-time extension of the RCSCME-based method: an MSE method based on ILRMA and RCSCME using the blockwise batch algorithm. However, it assumes that the spatial characteristics are stationary within a single batch, and thus, in dynamic situations where the target speaker moves, its performance may degrade. To address this problem, we derive the online algorithms for ILRMA and RCSCME in the following three steps. First, we formulate framewise cost functions for ILRMA and RCSCME on the basis of maximum weighted likelihood estimation. Second, we derive the update rules for the framewise cost functions on the basis of auxiliary-function techniques. These naive update rules are computationally costly for real-time execution on a practical machine. Thus, we finally derive the online algorithms by approximating some intermediate parameters with their estimates. Furthermore, we propose stabilization and further acceleration techniques for these online algorithms. In experiments, we simulate situations where a target speaker is stationary or moves and show that the proposed method achieves superior speech extraction performance compared with conventional methods. In addition, using real-world recorded signals, we demonstrate the effectiveness of the proposed method in practical scenarios.

0.29