CS Paper Radar

AirGC-CD: Gaussian-Circulant Precoding for Exactly Debiasable PAPR Reduction in Over-the-Air Federated Learning

Jonggyu Jang, Hyeonsu Lyu, Hyun Jong Yang

cs.LG eess.SP ·submitted 2026-09-19 15:30 UTC · v1
theory

Abstract

Over-the-air federated learning lets edge devices transmit their local updates simultaneously, reducing the communication overhead. The resulting waveform, however, has a peak-to-average power ratio (PAPR) that grows with the model dimension, and keeping the amplifier in its linear range leaves two remedies: clipping the peaks or backing off the transmit power. Neither remedy is without cost: i) the clipping distortion appears at the receiver as a bias that cannot be removed, and ii) back-off keeps the signal intact but degrades the average signal-to-noise ratio (SNR). Independent of this trade-off, the transmission remains uncompressed, spending one channel use per model parameter, which keeps large-model training out of reach. To address these challenges, we propose AirGC-CD, an over-the-air scheme that precodes each local update with a partial Gaussian circulant matrix before clipping. In AirGC-CD, the precoder's output is exactly Gaussian regardless of the update's sparsity, so the clipping function is designed for a known distribution instead of inheriting it from the data. This enables the clipping to be inverted on average by a single scalar Bussgang gain in closed form, and we prove that the resulting aggregate is exactly unbiased, with clipping adding only variance. The clipping ratio is then the only free parameter left, trading the variance of the clipping against the SNR loss from back-off, and we derive its near-optimum in closed form. Since the precoder is linear, it also acts as a compressor, reducing the transmission from the model dimension d to the sketch dimension m at a cost of only O(dlog d) via two fast Fourier transforms, whereas a Gaussian sketch costs O(md). Experiments on five image datasets show that AirGC-CD outperforms baseline over-the-air FL schemes in most settings, particularly at low SNR, while using fewer channel uses per round.

Closest papers

Nearest neighbours by meaning across the whole index.

Over-the-Air Federated Learning in Heterogeneous Mobile Wireless Networks

cs.LG cs.DCmath.OC ·2026-09-26 ·Ming Xiang, Nicolò Michelusi, Yonina C. Eldar, Lili Su
published similarity 0.64
Abstract · MobiHoc 2026 (the 27th International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Comput…

Over-the-air computation has emerged as a scalable and efficient solution for deploying federated learning algorithms in wireless networks by exploiting waveform superposition for simultaneous model aggregation. Most existing work struggles with heterogeneous fading channels. These approaches either enforce unbiased updates from all devices or allow partial device contributions, requiring careful tuning of the convergence bound to mitigate bias under specific fading models. However, the former significantly amplifies receiver noise due to the weakest channel, whereas the latter is sensitive to fading model mismatch and converges only to a biased objective. To tackle these challenges, we propose FedOAG, which employs algorithmic components to automatically satisfy energy constraints via gradient normalization and evenly mix devices' updates through implicit gossiping. Importantly, FedOAG does not require transmission from all devices, nor does it rely on a specific fading model or knowledge of time-varying statistical channel distributions. We show that FedOAG converges to a stationary point of an unbiased non-convex objective at the best possible rate $O(1/\sqrt{T})$ for any stochastic first-order method. We corroborate our analysis with numerical experiments over dynamic wireless conditions on real-world datasets.

0.19

Non-Coherent Over-the-Air Federated Learning: Protocol, Convergence, and Device Scheduling

cs.IT cs.LGeess.SP ·2026-09-08 ·Haifeng Wen, Nicolò Michelusi, Osvaldo Simeone, Yang Yang, Hong Xing
theory similarity 0.63
Abstract · 13 pages, 8 figures, submitted for possible journal publication

To mitigate the scalability bottleneck in the radio access network (RAN) in federated edge learning (FEEL), over-the-air federated learning (AirFL) exploits waveform superposition over multiple-access channels (MACs) for analog model aggregation. However, coherent AirFL typically relies on stringent PHY-layer conditions such as accurate channel state information (CSI), tight time/frequency synchronization, and frequent transceiver calibration for signal alignment. However, these requirements, if not impossible to be met, incur substantial communication and computation overhead. In this paper, we propose a non-coherent AirFL (NCAirFL) protocol over a broadband single-antenna MAC, leveraging binary dithering, unbiased non-coherent detection, and long-term error feedback to waive the need for instantaneous CSI. For NCAirFL with general smooth non-convex objectives and a constant learning rate, we establish a convergence bound achieving the convergence rate in the same order of $\mathcal{O}(1/\sqrt{T})$ as communication-ideal FedAvg, where $T$ is the total number of communication rounds. To further improve communication efficiency under data and wireless resource heterogeneity, we also derive a lower bound on the expected single-round objective decrease in the global loss conditioned on device scheduling, building upon which a surrogate objective function is obtained for jointly optimal device selection and power control. Experimental results on MNIST and CIFAR-10 corroborate that NCAirFL achieves learning performance close to FedAvg in practical settings, with the proposed device scheduling policy substantially accelerating convergence.

0.31

Multi-Model Over-the-Air Federated Learning via Transceiver Beamforming and Device Grouping

eess.SP cs.IT ·2026-11-05 ·Chong Zhang, Min Dong, Ben Liang, Ali Afana, Yahia A. Eldemerdash Ahmed
top venue similarity 0.59
Abstract · 16 pages, 6 figures. Accepted by IEEE Transactions on Wireless Communications, 2026

This paper considers uplink communication design for training multiple independent machine learning models via wireless federated learning. To reduce communication delay, we utilize multi-antenna beamforming and propose a multi-model over-the-air (M-OTA) uplink transmission and aggregation method for simultaneous training of multiple models. Devices are formed into groups for local model training based on the model assignments per communication round and simultaneously perform OTA aggregation over a multi-access channel. Based on the M-OTA transmission and reception process, we formulate a joint optimization of transmit and receive beamforming and device grouping over $T$ communication rounds to maximize the training convergence rates of all models. We analyze the per-model optimality gap, which captures the impact of noisy aggregation and inter-model interference on the learning performance. We further show that the $T$-round joint optimization problem can be decomposed into per-round online optimization to devise solutions. Following this, we propose a device grouping strategy that explores channel correlation among devices to maximize OTA aggregation performance. Furthermore, we present a low-complexity iterative algorithm for joint transmit-receive beamforming with closed-form updates. Simulation shows that our proposed M-OTA approach substantially outperforms the conventional single-model sequential OTA approach and other commonly used beamforming schemes.

0.31

Fixed pilot sequences can overstate the gains of learned MIMO-OFDM receivers under power amplifier distortion

eess.SP ·2026-10-24 ·Mohammad Tasin, Al Imran
code/data similarity 0.59
Abstract

Neural-network receivers are proposed to undo the distortion of a power amplifier driven close to saturation, where it is most efficient. They estimate the channel from pilots, known symbols sent in every frame. The pilots pass through the same amplifier as the data, so the channel estimate carries a small error that depends on the pilot sequence. If one sequence is always sent, as by default in the Sionna simulator, the error never changes, and a network can learn it instead of undoing the amplifier. We tested this in simulated two- and four-antenna orthogonal frequency-division multiplexing links; results are for binary pilots at the highest signal-to-noise ratio tested. A network with separate weights for each subcarrier lowered the bit error rate by 14 to 22% with its training pilot but raised it by 2 to 18% with every other pilot tested, and longer training widened this gap. A convolutional neural receiver following an open-source tutorial gained 37 percentage points more on its training pilot than on unseen pilots after short training, and 9 points more after nine times longer training, much of which also appeared with a linear amplifier. The gap shrank with amplifier back-off but persisted where the in-band distortion meets the 5G limit. On a channel with short delay spread, smoothing the channel estimate across subcarriers without training lowered the error rate on all 107 pilot sequences tested, by 30% on average. Learned receivers should therefore be tested on unseen pilots and against such simple baselines.

0.29

The Computing Channel: How Modulation Programs the Airwaves

cs.DC ·2026-09-10 ·Saeed Razavikia, Carlo Fischione
similarity 0.59
Abstract

Distributed computing and distributed artificial intelligence require frequent exchanges of intermediate results, although many applications need only an aggregate rather than messages from individual devices. Conventional systems recover each message before computing the aggregate, whereas over-the-air computation (OAC) exploits simultaneous transmission to obtain it directly. However, dominant OAC implementations rely on analog signaling, creating a mismatch with finite-precision data and digital communication procedures. This article presents digital function-oriented communication, in which finite-alphabet symbol representations and receiver decisions are jointly designed so that multiple-access superposition encodes the desired function without recovering individual inputs. We introduce its computational-constellation principle, main design approaches, extensions, and implementation challenges. Federated edge learning illustrates how the framework can reduce user-dependent data-bearing resources while operating directly on quantized model updates.

0.12

Polar Code Based Federated Learning: Convergence Analysis and Resource Allocation

cs.LG ·2026-08-14 ·Han Xiao, Wei Kang, Nan Liu
theory similarity 0.57
Abstract

Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data; however, it faces significant communication bottlenecks and channel impairments in practice. Conventional network layer treatments either idealize the channel as error free or apply equal error protection (EEP) to transmitted model updates, failing to account for the inherently unequal importance of quantization bits within a single local model. To address this limitation, we propose a cross layer polar code based FL scheme that leverages the unequal error protection (UEP) property of polar codes under finite block lengths. Specifically, the proposed design selectively protects more significant quantization bits, thereby mitigating the detrimental effects of channel noise. We further provide a rigorous convergence analysis of the proposed scheme, deriving an upper bound on the convergence gap, which we then jointly optimize over the number of quantization bits and the polar code block length across all training iterations. Experimental results demonstrate that both constant and variable block length configurations of our polar code based scheme consistently achieve substantial performance gains over uncoded and LDPC-based EEP benchmarks, with the advantage becoming increasingly pronounced as the channel quality deteriorating. These findings confirm the efficacy of our cross-layer design in enhancing FL robustness and efficiency under realistic channel conditions.

0.04

AIR-LLM: Broadcasting AI Weights over Radio for Memory-Free Edge LLM Inference via RF Computing

cs.IT cs.ETcs.LGeess.SP+1 ·2026-09-30 ·Zhihui Gao, Tingjun Chen, Dirk Englund
similarity 0.57
Abstract · 14 pages, 12 figures, 6 tables. Appendix: 12 pages, 7 figures, 11 tables

Next-generation large language models (LLMs) are expanding from the cloud to ubiquitous edge devices. However, edge devices typically either lack the memory to store increasingly large LLM weights or, even with enough memory, spend unaffordable energy on loading the weights. This raises our question: can an edge device run an LLM without storing or loading its weights, but receive them over the air and consume them on the fly? Inspired by wireless broadcasting, we present AIR-LLM, an LLM inference architecture for edge devices, which is composed of: (i) a central radio (e.g., 5G base stations) that broadcasts the LLM weights into the air, and (ii) the edge user that receives the weights and completes the general matrix-vector multiplication (GEMV) of LLM inference directly in the radio frequency (RF) domain using RF mixers. To further shorten the airtime, AIR-LLM exploits MIMO spatial multiplexing and proposes an energy-efficient precoder-postcoder pair on the edge to calibrate its own wireless channel. Since the central radio stays user-unaware, AIR-LLM is user-scalable so that one broadcast serves unlimited users within its coverage. We implement AIR-LLM on the NVIDIA Sionna ray-traced channels of two real-world urban scenes and the profiling of a real RF mixer. With a WikiText-2 perplexity degradation of 4.0% on LLaMA-3.1-8B, AIR-LLM saves the energy by 157.7x/40.4x against the FP16 and weight-only quantization baselines; with 20 users, its airtime is 104.1x/26.0x shorter, respectively.

0.27

Learning OTA: A Unified Framework for Edge Sensing, Computation, and Communication

cs.IT cs.NIeess.SP ·2026-10-03 ·Mehdi Karbalayghareh, David J. Love, Christopher G. Brinton
code/data similarity 0.56
Abstract

Most federated learning (FL) studies implicitly assume that training data is readily available at participating edge devices. In practice, this data must first be acquired through heterogeneous sensors with potentially different measurement modalities, and the quality and cost of this acquisition process can directly affect the learning performance. This dependence creates a coupled relationship among sensing, computation, and communication, necessitating a system model that captures their joint effect on resource efficiency and learning accuracy. This paper develops such a unified treatment for an over-the-air (OTA) FL system in which each device configures its sensing modality, power, resolution, and sample size, with aggregations conducted OTA at the server. We derive models for sensing noise, energy consumption, latency, and OTA aggregation distortion, and establish a non-convex convergence bound quantifying how these factors influence the global model trajectory. Guided by this analysis, we formulate a per-round optimization that balances energy, latency, and learning quality under physical device constraints. The resulting mixed optimization is addressed through an alternating procedure with closed-form and one-dimensional updates for continuous variables and a lightweight discrete search. Numerical experiments corroborate the advantage of jointly optimizing sensing, computation, and communication decisions.

0.21