CS Paper Radar

Spectral-NFP: Certified Low-Rank Curvature Majorization for Accelerating WMMSE

Jianhang Zhu, Tsung-Hui Chang, Kaiming Shen

cs.IT ·submitted 2026-09-23 05:16 UTC · v1
theory

Abstract

Weighted sum-rate maximization in multicell multiple-input multiple-output (MIMO) networks is commonly addressed by the weighted minimum mean-square error (WMMSE) algorithm or fractional programming (FP), both of which, after fixing their auxiliary variables, solve a power-constrained quadratic transmit problem that requires costly dense operations for large arrays. Replacing the underlying curvature matrix with a scaled identity can avoid the matrix inverse operation and thereby reduce complexity, but it discards the curvature eigenvalue structure and yields a loose lower bound. We propose Spectral-NFP, which retains selected dominant curvature eigenpairs and uses a scaled identity matrix to bound the curvature on the remaining subspace from above. The retained rank thus traces a continuous path from NFP to the exact WMMSE transmit update. With the surrogate curvature fixed, Spectral-NFP can be interpreted as Euclidean projected-gradient ascent after a linear coordinate transformation, admitting Nesterov-type acceleration. We derive a lower bound on the one-step transmit-objective gain of Spectral-NFP relative to WMMSE, expressed in terms of the curvature eigenvalues. Under an idealized Wishart model, we analyze this bound in both finite dimensions and the large-system limit, obtaining an asymptotic rank-selection rule. Experimental results show that retaining at most 20% of the transmit dimension, and often less than 10%, achieves more than 99% of the WMMSE WSR. In large-array settings, the measured update time is below 20% of that required by WMMSE.

Closest papers

Nearest neighbours by meaning across the whole index.

Surrogate-Enhanced Fractional Programming for MIMO Device-to-Device Interference Networks

cs.IT eess.SP ·2026-09-29 ·Zihan Jiao, Xinping Yi, Shi Jin, Giuseppe Caire
similarity 0.63
Abstract · Corrected a typo in the abstract metadata; manuscript unchanged

Interference management in multi-stream multi-input multi-output (MIMO) device-to-device (D2D) networks often leads to weighted sum-rate maximization with sum-log-determinant involving matrix-valued signal-to-interference-plus-noise ratios (SINRs). The state-of-the-art paradigms, including weighted minimum mean-square error (WMMSE) and fractional programming (FP), have achieved tremendous success in link scheduling, power control, and beamforming problems. Recently, an upgraded FP approach, named surrogate-enhanced FP (SEFP) in a scalar form, has attained improved performance in joint uplink scheduling and power control in coordinated multicell SISO networks. The proposed SEFP improves the surrogate construction of the classical Lagrangian dual transform plus quadratic transform for logarithmic fractional objectives with a novel reciprocal-inverse transform (RIT), yet its extension to the matrix form for MIMO settings does not seem straightforward because the matrix ratio and the auxiliary matrix generally do not commute. In this paper, by leveraging mathematical tools from Hermitian functional calculus, we extend RIT to matrix ratios by lifting the scalar RIT along the eigendirections of an auxiliary matrix and recasting the resulting directional construction in an operator form. Following, we develop a matrix SEFP framework for weighted sum-log-determinant maximization. Further, we establish a unified view of SEFP and the recently proposed XMMSE method, specify when the two algorithms attribute to identical minorization-maximization (MM) surrogates and variable update trajectories, and prove XMMSE can be considered as a special case of SEFP under the algorithmic family perspective. Inspired by the unified view, we develop SEFPLinQ for the joint scheduling and beamforming optimization in flexible-association MIMO D2D networks. Numerical results demonstrate consistent performance gains.

0.22

Reduced-Complexity WMMSE Approach for Cell-Free Massive MIMO Systems With Finite-Capacity Fronthaul Links

cs.IT eess.SP ·2026-11-11 ·Wonsik Yoo, Hoon Lee, Seok-Hwan Park
published similarity 0.60
Abstract

We propose a reduced-complexity weighted minimum mean squared error (R-WMMSE) framework for cell-free massive MIMO (CF-mMIMO) systems with finite-capacity fronthaul links. To maximize the system capacity, we need to jointly design beamforming vectors at distributed access points (APs) and fronthaul quantization noise covariances. Such a task would be addressed using conventional WMMSE algorithms and their variants. However, existing WMMSE-based methods either assume ideal infinite-capacity fronthaul links or incur high computational complexity when jointly optimizing the network-wide beamforming and fronthaul compression variables. To this end, the proposed method jointly optimizes beamforming and fronthaul compression by leveraging a sequential per-AP optimization strategy. Since each subproblem is efficiently solved via Lagrangian duality with closed-form updates, the overall computational complexity can be significantly reduced compared to the conventional WMMSE method. To further reduce hardware cost, we extend the R-WMMSE framework to hybrid analog-digital beamforming systems, tackling the joint design of digital beamforming, fronthaul compression, and analog beamforming. Numerical results show that the proposed scheme achieves performance nearly identical to that of the conventional WMMSE while reducing the runtime by over 99%.

0.36

Beyond the Matrix Sign: Quadratic Spectral Descent

cs.LG cs.AI ·2026-09-07 ·Qiaozhe Zhang, Jun Sun, Yingzhuang Liu
similarity 0.59
Abstract

Muon emerges as a strong competitor of the AdamW for LLM pretraining, because the matrix-wise update it employs can potentially incur smaller second-order penalty than the once dominating AdamW, which performs coordinate-wise update. However, the spectral flattening procedure in Muon is quite debatable since it discards the spectral amplitude information totally. To seek for better spectral allocation (and the associated spectral subspace), we propose to solve the quadratic model of loss function under the spectral norm constraint \textit{directly} (i.e., in a genuinely Newtonian way) and thus obtaining the Quadratic Spectral Descent (QSD) algorithm. In contrast, many existing curvature-aware methods either exploit the second-order information in an \textit{implicit} way by changing the weight update geometry (such as Mousse, FISMO) or rely on strong assumptions (such as the weight displacement isotropy assumption in Newton-Muon). QSD's potential advantage over these methods is best illustrated in the isotropic curvature scenario, where Mousse, FISMO and Newton-Muon all reduce to Muon while the spectral allocation in QSD is still \textit{non-flat} (since the spectral allocation in QSD depends on the \textit{gradient to curvature ratio}). Meanwhile, to control the complexity of QSD, we employ inversion-free K-FAC and \textit{online} Frank-Wolfe update which is essentially a matrix sign operator. Overall, the complexity increase can be rather mild. Experiments on GPT pre-training show that QSD consistently improves validation loss over Muon and recent Muon variants, while achieving up to an $8.49\%$ wall-clock speedup at matched validation loss.

0.48

The Interference-Conjugate Transform: The Tightest Interference-Linear Surrogate for Power Control, Scheduling and Beamforming in Wireless Networks

cs.IT eess.SP ·2026-10-27 ·Ahmad Khan
benchmarktheory similarity 0.59
Abstract

Closed-form fractional programming (FP), weighted MMSE (WMMSE), and the 2026 surrogate-enhanced methods SEFP and XMMSE all maximize the weighted sum rate by iteratively maximizing a surrogate linear in the interference power. We show that this family admits a unique best member: the interference-conjugate transform (ICT), which replaces each rate term $\log(1+a/b)$ by $\max_{κ\ge0}[Ω(κa)-κb]$, where $Ω$ is the closed-form partial convex conjugate of the rate in the interference variable and the optimal multiplier is the interference price $a/(b(a+b))$. We prove that, for any fixed price, $Ω(κ\,\cdot)$ is the pointwise largest own-signal function compatible with a valid interference-linear lower bound, and that tightness at an anchor forces the price. Hence all four benchmark surrogates, which share this price and differ only in their own-signal term, are dominated pointwise by ICT. At SINR $γ$, the benchmarks' own-signal curvature exceeds the true curvature by factors behaving as $γ/2$ (FP/WMMSE) and $(\logγ)/2$ (SEFP/XMMSE), against $1+1/(γ(γ+2))$ for ICT, and this ordering carries over to the certified ascent per iteration and the asymptotic linear convergence rate. ICT yields closed-form updates at the benchmarks' per-iteration cost for single-antenna power control, uplink joint scheduling and power control, and multi-cell MISO beamforming, and the first solver-free algorithm for sum-least-$q$th-percentile rate maximization, via a $K$-dimensional convex dual with closed-form gradient and Hessian and a certified duality gap. In uplink scheduling, ICT improves proportional-fairness utility over FP by +7.03 and over SEFP by +3.35 (60/60 drops) using 18.7 iterations per slot vs. 49.7 and 38.0; in MISO beamforming with $M=8$, it reaches 99.9% of its final value in a median of 9 iterations vs. 16 (XMMSE) and 1160 (FP/WMMSE).

0.11

Tri-Hybrid Cell-Free Massive MIMO Systems

eess.SP ·2026-10-08 ·Janith Dassanayake, Gayan Aruma Baduge
similarity 0.59
Abstract

This paper proposes a tri-hybrid precoder design, cascading digital, analog, and electromagnetic processing layers, for cell-free massive multiple-input multiple-output (CFmMIMO) systems. We jointly optimize the three-layer precoders and access point (AP) transmit power to maximize global energy efficiency (GEE) under per-AP power and fronthaul constraints. To solve this, we develop an alternating optimization algorithm. The first sub-routine maximizes sum spectral efficiency (SE) for precoder design using weighted minimum mean square error, Riemannian manifold optimization, and gradient ascent over Lorentzian phases. The second optimizes power allocation via Dinkelbach's fractional programming and successive convex approximation. Convergence and computational complexity are also analyzed. Simulation results show the proposed design improves GEE by 87% and 11% over fully digital and classical hybrid precoders, respectively, at 20dBm transmit power. Moreover, joint power optimization yields 22% SE and 16% GEE gains over equal-power baselines, while outperforming colocated architectures in SE. Finally, we identify GEE-optimal regimes for AP and RF chain counts, and demonstrate that increasing dynamic metasurface antenna sizes enhances GEE in low-power regimes with negligible active power overhead.

0.23

An Efficient SIM Beamforming Scheme Based on Physical-Empowered Projected Gradient

eess.SP ·2026-10-29 ·Yuzhi Yang, Hao Liu, Tianhao Guo, Jiancheng An, Lu Gan +2 more
similarity 0.58
Abstract · under review by ieee trans

Stacked Intelligent Metasurfaces (SIMs) have emerged as a promising technology for next-generation wireless systems. Especially in multi-input multi-output (MIMO) systems, it has the potential to realize complicated wave-domain transformations with low hardware costs and energy consumption. However, SIM-assisted MIMO systems face two major challenges in channel estimation and beamforming. As the SIM elements do not have the signal processing capability, channel estimation can only be conducted in an indirect manner, which makes it challenging. Moreover, the precoding optimization after channel estimation is non-convex and also difficult. Targeting these issues, we exploit the time-division duplex (TDD) channel reciprocity to calculate the gradient backpropagation in an over-the-air manner. Based on this structure, we propose a gradient-based optimization framework that optimizes beamforming without explicitly estimating the SIM--UE channel. The proposed method, namely the physical projected gradient descent (P2GD) method, optimizes the achievable sum rate while incorporating zero-forcing (ZF) constraints. Based on the method of incorporating the ZF restriction, we propose two variations of P2GD, namely user equipment (UE)-P2GD and base station (BS)-P2GD. We also provide a theoretical convergence analysis and projected gradient techniques to ensure physical feasibility. Simulation results show that the proposed approach can achieve suboptimal beamforming in the multi-user system within a small number of over-the-air iterations, using a per-direction signaling budget below the pilot cost of explicit SIM--UE channel estimation. The proposed method provides a low-overhead beamforming scheme for SIM systems without explicit SIM--UE channel estimation.

0.48

A Bussgang-based Latent Lifting Method: Discrete RIS Channel Estimation and Beamforming

eess.SP ·2026-11-07 ·Mintaek Oh, Namyoon Lee, Jinseok Choi
similarity 0.58
Abstract · 13 pages, 8 figures

This paper addresses the challenge of discrete phase-shift optimization in reconfigurable intelligent surface (RIS)-aided multiuser communication systems. Practical RIS hardware often utilizes low-resolution phase shifters, leading to challenging combinatorial optimization problems. To address this challenge, we propose a Bussgang-based latent lifting (BuLL) method that represents discrete phase shifts as quantized outputs of continuous latent variables. Our BuLL method calibrates the Bussgang gain and distortion covariance under a reference distribution and keeps these moments fixed during deterministic latent optimization. These fixed moments are then used to construct a distortion-aware continuous surrogate that incorporates reference-averaged discretization effects without penalty terms. For uplink channel estimation, we develop a matrix quadratic transform-based algorithm to optimize a mean-square-error surrogate. For downlink beamforming, we develop a generalized power iteration-based RIS phase-shift optimization algorithm for a spectral efficiency (SE) surrogate. Numerical results demonstrate improvements in channel estimation accuracy and sum SE over conventional benchmarks in the evaluated low-resolution RIS settings.

0.34

Cost-free Spectral Estimation for Adaptive Newton--Schulz in Matrix Optimizers

cs.LG ·2026-09-27 ·Kristi Topollai, Anna Choromanska
similarity 0.57
Abstract

Matrix optimizers such as Muon transform each momentum matrix through an approximate orthogonalization, typically implemented by a small number of Newton-Schulz matrix multiplications. The quality and cost of this approximation depend strongly on the singular-value spectrum of its input, yet existing implementations use the same fixed polynomial routine for every layer and throughout training. We show that this uniform treatment is unnecessary: the computations in the Newton-Schulz method already reveal enough information to make the method adaptive. The Gram matrices formed inside Newton-Schulz iterations yield spectral moments through inexpensive scalar reductions, requiring no additional matrix multiplications. From these moments, we recover an estimate of the empirical singular-value distribution and use it to select a polynomial routine specialized to the current matrix. This turns Newton--Schulz orthogonalization into a spectrum-adaptive procedure that responds to differences across both layers and training time. On saved momentum matrices, spectral estimation substantially reduces orthogonalization error at a fixed iteration budget or reaches the same accuracy with fewer iterations, and in GPT pretraining up to 1B parameters it lowers the validation loss of two matrix optimizers. Our results suggest that matrix-function operations inside optimizers need not be designed for a conservative worst-case spectrum: they can cheaply measure the spectrum they are already processing and specialize computations accordingly.

0.15