CS Paper Radar

Fold First, Detect Directly: Communication Symbol Detection Without Unfolding for Low-Bitrate Modulo-ADCs

Krunal Vaghela, Kumar Appaiah, Satish Mulleti

eess.SP ·submitted 2026-09-10 09:27 UTC · v2

Abstract

Modulo-folding analog-to-digital converters (MF-ADCs) enable low-dynamic-range quantizers to sample high-amplitude signals without clipping. However, downstream processing traditionally relies on waveform unfolding algorithms, which require high oversampling rates and are highly sensitive to noise. For communication receivers, where the goal is symbol detection rather than signal reconstruction, unfolding is a redundant intermediate step. In this paper, we propose an unfolding-free maximum-likelihood symbol-detection framework for oversampled MF-ADCs in the presence of joint channel and quantization noise. By leveraging modulo wrap cancellation, we derive an exact, single-term Mahalanobis-distance metric that operates directly on folded observations. To handle long sequences, we introduce a parallelized block search algorithm that reduces computational complexity to scale linearly with sequence length. Simulations show our detector significantly outperforms existing unfolding baselines and approaches unclipped conventional ADC performance.

Comment
9 pages

Closest papers

Nearest neighbours by meaning across the whole index.

IMC-CLINIC: Coupled Loss-Informed Newton Iterations for Clipping in Analog In-Memory Computing

cs.AI ·2026-09-28 ·Yung-Chin Chen, Chia-Yu Chen, Naveen Verma
similarity 0.58
Abstract

Analog in-memory computing (IMC) offers a promising path toward energy-efficient large language model (LLM) inference by executing matrix multiplications (MatMul) directly within memory arrays in the analog domain. Its efficiency, however, comes with an additional source of error: limited-precision analog-to-digital converters (ADCs) quantize accumulated analog partial sums, introducing output-side error distinct from conventional activation and weight quantization at the MatMul inputs. Clipping can mitigate both operand and ADC quantization errors, but the optimal clipping factors must jointly balance activation rounding and clipping, weight rounding and clipping, and ADC quantization. Existing clipping methods, designed for digital quantization, do not explicitly optimize these coupled sources of IMC error and often rely on costly search-based calibration. We introduce IMC-CLINIC (Coupled Loss-Informed Newton Iterations for Clipping), a clipping calibration framework based on an analytical surrogate for IMC MatMul output error. The surrogate jointly models operand quantization, accumulated clipping-induced bias, and ADC quantization, enabling efficient evaluation of its gradient and approximate curvature from a small calibration set. IMC-CLINIC jointly optimizes activation and weight clipping factors using a safeguarded Newton-type method. Across multiple models and datasets, it improves average zero-shot accuracy by 6.5-11.5 percentage points over the grid search baseline while reducing calibration time by factors of 10.0-12.1. Its analytical surrogate closely tracks empirical IMC output error, and its optimizer is certified within 1% of the global optimum under the loss objective across all projections on two representative models.

0.53

XOR-Trellis: Ultra-Low-Complexity Dequantization and Curvature-Aware Hadamard-Free LLM Quantization

cs.LG cs.AI ·2026-09-30 ·Xiaofan Que, Nir Elkayam, Spandan Pyakurel, Shuokai Pan, Dibakar Gope
similarity 0.57
Abstract

Trellis-coded quantization enables high-dimensional compression of large language model (LLM) weights at ultra-low bit widths without the exponentially large codebooks required by conventional vector quantization. Practical deployment, however, presents two challenges: reconstructing compressed weights at sufficient parallel throughput to avoid making dequantization an inference bottleneck, and maintaining quantization accuracy without costly incoherence transformations. We address these challenges with two complementary techniques. First, we introduce an ultra-low-complexity trellis dequantizer that uses a structured, hardware-efficient state-to-value mapping while preserving diverse reconstruction choices for trellis search. Second, we reformulate discrete trellis path optimization with a curvature-aware objective that reflects model sensitivity directly in the original coordinate space. Together, these techniques enable high-quality ultra-low-bit trellis quantization with inexpensive, highly parallel runtime reconstruction and without relying on Hadamard-based incoherence processing.

0.20

HADVQ: Hessian Aware Directional Vector Quantization

cs.LG ·2026-11-17 ·Daniil Li, Mars Davletshin, Vadim Klyzhenko, Artem Danilishin, Valery Sandul +2 more
similarity 0.57
Abstract

Ultra-low-bit quantization of large language models is a challenging task because aggressive compression severely distorts model parameters and disproportionately harms a small number of highly sensitive channels. We present a vector quantization method tailored for this regime. Our approach begins with random preconditioning, which regularizes the weight space and makes it more amenable to quantization. We then represent weights in polar coordinates and decouple the quantization of directions and magnitudes. To quantize directions, we leverage the structure induced by random preconditioning and design a structured codebook based on the $E_8$ lattice, yielding a compact yet expressive representation. To further reduce degradation, we detect extremely important channels using a proxy Hessian and preserve them with an additional cost of only 0.16 bits. Together, these components provide an effective quantization pipeline for LLMs in the extremely low-bit regime. Empirical results demonstrate improved accuracy, highlighting the benefit of combining geometric structure, lattice-based codebooks, and selective channel preservation.

0.19

Low-Complexity Sequential Detection Framework for Single-Channel Co-Frequency Signal Separation

eess.SP ·2026-09-03 ·Heng Wang, Kexian Gong, Peng Sun, Wei Wang, Hua Jiang
benchmark similarity 0.55
Abstract · This work has been submitted to IEEE for possible publication. Copyright may be transferred without notice, after which this version may no …

Practical separation of single-channel co-frequency signals (SCCFSs) is hindered by the prohibitive computational complexity of benchmark algorithms. To address this issue, we propose a low-complexity separation framework based on sequential detection (SD), in which signal separation is cast as a sequential path search over a trellis. To support both hard-decision detection and log-likelihood ratio (LLR) extraction, we develop two algorithms within this framework: the SD-based separation (SDS) algorithm and its soft-output variant (SO-SDS). Furthermore, SDS employs a windowing strategy combined with dynamic pruning to concentrate computational resources on high-probability paths, thereby enabling efficient detection of transmitted symbol sequences. Building upon SDS, SO-SDS further incorporates a state completeness verification mechanism (SCVM) to estimate bit LLRs, thus facilitating subsequent soft decoding. Numerical results show that, compared to benchmark algorithms, SDS achieves significant complexity reduction without degrading separation performance, while SO-SDS offers notable computational savings with only modest LLR accuracy loss. Notably, the computational complexity advantage of the proposed algorithms over benchmark algorithms grows substantially with increasing modulation order.

0.47

Hardware-Friendly Token-Group Activation Quantization for Low-Bit Mamba Super-Resolution

cs.AI cs.CVcs.LG ·2026-10-12 ·Jinwoo Chung, Jangho Kim
top venuecode/data similarity 0.54
Abstract · Accepted to NeurIPS 2026. 32 pages, 6 figures. Code: https://github.com/imaboybut/TGQ-MambaSR

Mamba-based super-resolution models are efficient alternatives to Transformer-based restoration backbones, but their low-bit post-training quantization remains challenging because selective scan, Mamba's input-dependent state-space operator, induces different activation ranges across spatial tokens. Thus, a single layer-wise clipping range poorly matches all tokens. We propose Token-Group Quantization, a hardware-friendly activation PTQ framework that statically approximates a hardware-unfriendly post-scan grouping oracle, where tokens with similar preferred clipping ranges are assigned to the same group. To avoid runtime post-scan grouping in static low-bit inference, a lightweight predictor infers the groups from pre-scan features available before the quantized scan path. During calibration, we form pseudo-labels by clustering post-scan activation descriptors that capture similar rounding--clipping behavior. At inference, the frozen predictor maps pre-scan features to groups and selects entries from offline-calibrated group-wise clipping-bound tables, without runtime statistics collection, dynamic clipping updates, or post-scan group assignment. To address low-bit restoration degradation, we further introduce a Frequency-Preserving Refinement (FPR) objective for clipping-bound calibration. FPR aligns Fourier amplitude and phase between full-precision teacher and quantized student outputs to preserve high-frequency structures. Across PTQ protocols, bit-widths, backbones, and tasks, our method consistently outperforms prior Mamba and SR PTQ baselines, transfers to Transformer SR and Vision Mamba classification, composes with rotation-based quantization, and achieves 2.23x speedup on Jetson Orin Nano over FP16. Code is available here.

0.42

LoopQuant: Accurate and Efficient Post-Training Quantization for Looped Transformers

cs.LG cs.AI ·2026-10-12 ·Zhixiong Zhao, Zukang Xu, Xing Hu, Lifeng Liu, Guangyu Sun +1 more
code/data similarity 0.53
Abstract

Looped Language Models (LoopLMs) improve parameter efficiency by recursively reusing shared Transformer modules, yet their repeated computation over evolving recurrent states poses new challenges for low-bit deployment. Existing post-training quantization (PTQ) methods, largely designed for feed-forward Transformers, fail to account for cross-loop activation dynamics, heterogeneous loop sensitivity, and recursive error propagation, leading to substantial performance degradation at low precision. To address these challenges, we propose LoopQuant, a loop-aware PTQ framework for accurate and efficient low-bit quantization of LoopLMs. LoopQuant is built on three core components: 1) Cross-Loop Distribution Canonicalization (CLDC) learns a shared quantization-friendly representation across recurrent states while preserving parameter sharing; 2) Interaction-Aware Loop-wise Precision Allocation (ILPA) allocates activation precision under a fixed bit budget by modeling task-level loop sensitivity and cross-loop interactions; and 3) Loop-Conditioned Task Calibration (LCTC) further aligns quantized inference with the low-bit recursive trajectory through lightweight task-space calibration. Extensive experiments across LoopLM architectures demonstrate that LoopQuant consistently outperforms existing low-bit PTQ methods. On Ouro-2.6B, LoopQuant under W4A4 surpasses all W4A8 baselines in performance, while reducing model memory by 65.3% with only 3.4% additional storage overhead over naive INT4 and achieving a 1.7 times decoding speedup over BF16. These results demonstrate a strong balance among accuracy, compression, and inference efficiency, providing a practical and deployment-friendly solution for low-bit LoopLM inference. The code is available at [https://github.com/Kishon-zzx/LoopQuant].

0.34

Joint Quantized Precoding and Bit Allocation for Fronthaul-Constrained Cell-Free Massive MIMO

cs.IT eess.SP ·2026-08-12 ·Özlem Tuğfe Demir
published similarity 0.53
Abstract · 5 pages, 2 figures, to be presented at IEEE SPAWC 2026

We study quantization-aware precoding for the downlink of cell-free massive MIMO systems with limited-resolution fronthaul. In such systems, the centrally designed precoder must be quantized before being conveyed to distributed access points (APs), creating a strong coupling between precoder design and fronthaul compression. To capture this effect, we develop an end-to-end signal model based on Bussgang decomposition, where the quantization distortion depends explicitly on the precoder coefficients. Building on this model, we formulate a joint precoding and bit allocation problem under per-AP power constraints and a total fronthaul bit budget. We propose an efficient block coordinate descent algorithm that iteratively updates the precoder, receive scaling, and distortion levels. Numerical results demonstrate that the proposed method significantly outperforms uniform bit allocation and quantization-unaware precoding schemes, particularly in fronthaul-limited regimes.

0.49

DualQuant: Dual-scale Calibration-free Weight-and-Activation Quantization for LLMs

cs.LG cs.AI ·2026-10-09 ·Mahsa Salmani, Sayeh Sharify, Hesham Mostafa
similarity 0.53
Abstract

Low-bit inference on accelerators with native 4-bit support requires quantizing both weights and activations to realize the full throughput gains these formats provide. While post-training weight quantization has been extensively studied, activation quantization remains considerably more challenging and typically requires calibration data. In this work, we introduce DUALQUANT, a dual-scale, calibration-free post-training quantization framework that directly minimizes the weight-reconstruction Mean Squared Error (MSE) and, as an immediate by-product, yields per-channel activation rescalings prior to activation quantization. Our key observation is that the scaling factors obtained by minimizing weight-reconstruction error provide effective activation rescalings, enabling competitive activation quantization without calibration data. We formulate DUALQUANT as a non-differentiable weight-reconstruction problem and develop an efficient solver based on variable splitting and block coordinate descent, where each subproblem admits a closed-form update. DUALQUANT provides a unified algorithm supporting a wide range of formats, including the full MX family and NVFP4. To our knowledge, DUALQUANT is the first dual-scaling method to formally support MX and NV block formats. Across Llama and Qwen models evaluated on WikiText-2, C4, and zero-shot downstream tasks, DUALQUANT matches or exceeds the accuracy of calibration-based SmoothQuant across most models and formats, and substantially outperforms calibration-free baselines, with large gains for MX and NV block formats. We validate these gains with a real packed W4A4 inference path for Llama-3.1-8B on an RTX 4090. The resulting implementation closely matches the accuracy of fake quantization while delivering up to 2.61x memory reduction and up to 2.46x throughput speedup over BF16.

0.43