CS Paper Radar

Communication-Efficient Clustered Federated Learning in Non-IID Wireless Networks

Martin Isaksson, Rickard Cöster, Šarūnas Girdzijauskas, Seif Haridi

cs.LG ·submitted 2026-10-28 21:56 UTC · v2

Abstract

Current and emerging mobile networks face increasing privacy, scalability, and performance challenges as distributed learning becomes essential for advanced 6G services. These challenges are amplified by the presence of non-IID data, naturally arising in heterogeneous wireless environments, that degrade the performance of standard Federated Learning (FL) approaches. To address non-IID data across clients, we propose a Clustered Federated Learning (CFL) framework that assigns clients to specialized models during training. Data-domain clustering initializes model-based clustering, enabling identification and exploitation of client similarities without sharing raw data while reducing communication cost. Motivated by mmWave beam selection, we evaluate our methods on a wireless simulation dataset (DeepMIMO) and complement it with two non-IID benchmarks (FEMNIST, Rotated CIFAR-10) to isolate different non-IID characteristics. Our best configurations improve accuracy over IFCA by 4.8 pp on DeepMIMO and 10.6 pp on FEMNIST while reducing downlink data volume by 83.1 % on FEMNIST compared to IFCA. We demonstrate that different clustering strategies suit different non-IID characteristics. These results show that our CFL methods enable resource-efficient, and high-performance distributed learning in future 6G networks.

Comment
64 pages (25 main text + appendices)

Closest papers

Nearest neighbours by meaning across the whole index.

Latent Information Sharing for Accelerating Federated Learning

cs.LG ·2026-10-01 ·Seungjun Lee, Ensieh Khazaei, Dimitrios Hatzinakos, Baturalp Buyukates, Sunwoo Lee
similarity 0.68
Abstract

Federated learning (FL) is a communication-efficient distributed learning paradigm. However, client drift remains one of the most critical challenges, hindering the efficient training of a global model. In this study, we propose a novel latent information sharing scheme that directly mitigates data heterogeneity across clients. Our theoretical and empirical results show that sharing a small amount of hidden-layer activations significantly improves training efficiency while preserving convergence guarantees and data privacy. Furthermore, we compare our method with existing FL approaches designed to address client drift, including FedProx, SCAFFOLD, FedPVR, FedProto, and SplitFed, and demonstrate superior model accuracy under a fixed round budget without incurring excessive communication overhead. Overall, this work presents a promising new knowledge aggregation scheme and provides a comprehensive analysis of the impact of activation sharing on federated optimization.

0.30

Client and Training Data Selection for Computationally Efficient Synchronized Federated Learning

cs.LG cs.DC ·2026-09-30 ·Muzaffer Citir, Hiroki Nishikawa, Sangyoung Park
published similarity 0.67
Abstract · Accepted for publication in the 29th Euromicro Conference on Digital System Design (DSD 2026)

Federated learning (FL) is a promising paradigm of machine learning, which preserves user privacy by enabling learning without sharing raw data with a cloud server. Straggling clients have been a problem for FL as they introduce delays in aggregating the local models and hence, the convergence of the global model. Therefore, it is important to have a mechanism that ensures fast convergence of the global model as well as good FL participation rate. Another issue for the convergence of a model in FL is the non-independent and identically distributed (non-iid) data across the clients. Prior approaches based on probabilistic client selection do not work well under non-iid data especially when the number of clients is small. We show scenarios where such approaches fail and propose a joint client-training data selection algorithm for fast convergence of FL models. Our experiments on CIFAR-100 dataset show that convergence of the FL model can be significantly improved over prior works that can consider non-iid data and heterogeneous computation and higher model accuracy.

0.20

Joint Optimization for Federated Learning and Transmission over Unreliable Wireless Networks with Heterogeneous Data

cs.DC cs.LG ·2026-09-13 ·Changheng Wang, Xianchao Zhang, Zhiqing Wei, Lingzhu Zhao, Zhongming Yang +1 more
theory similarity 0.67
Abstract

In wireless federated learning (FL), data heterogeneity and multiple local updates induce client drift, degrading model convergence. It is further affected by unreliable wireless links, as transmission errors may invalidate model updates. To address these challenges, we propose a federated random walk averaging (FedRW) framework, which is a variant of federated averaging (FedAvg) that mitigates data heterogeneity by updating models along random walk (RW) paths and aggregating them at the server. Model parameters are transmitted in packets with retransmission support to improve training quality by mitigating wireless errors along RW paths. Meanwhile, wireless transmission delays hinder the exploration of FedRW. To this end, we formulate a joint optimization problem that integrates learning, RW path selection, and transmission parameter tuning, aiming to minimize the training loss under delay constraints. By deriving an upper bound on the expected convergence of FedRW over unreliable wireless networks, we reduce the problem to a general form agnostic to task type and model architecture. A distributed solution is then proposed, in which the server or clients optimize packet size and maximum number of retransmissions locally, and efficiently select reliable and expandable next-hop nodes via a resilience-aware beam search with dynamic pruning. Simulation results show that FedRW achieves 2.26%-9% higher accuracy than state-of-the-art baselines under high data heterogeneity. Furthermore, the jointly optimized FedRW yields at least 2.78% higher accuracy and faster convergence compared to baselines.

0.09

Diversity-Aware Client Selection for Communication-Efficient Federated Learning

cs.LG cs.AI ·2026-11-06 ·Max Halleryd, Sima Sinaei, Viktor Valadi, Mina Alibeigi, Henrik Abrahamsson +1 more
published similarity 0.67
Abstract · 4 pages, 6 figures, 2 tables. Accepted at SNCNW 2026

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it attractive for privacy-sensitive and bandwidth-constrained applications. A practical challenge in deploying FL is reducing communication overhead while maintaining model performance under heterogeneous, non-IID data distributions. Selecting which subset of clients participates in each training round offers a principled way to address both challenges simultaneously, yet its impact on data diversity and representativeness remains underexplored. In this paper, we investigate three client selection strategies, Power-of-Choice, Fisher information, and Centered Kernel Alignment, evaluating them not only by accuracy and convergence, but through the lens of participation diversity using the Gini coefficient and KL divergence. Under non-IID conditions, restricting participation to 15% of clients per round achieves significant communication savings, and when selection promotes diverse and balanced contributions, it also improves generalization over biased alternatives. This work provides a systematic and reproducible analysis demonstrating that diversity-focused client selection renders communication efficiency and model quality complementary rather than competing objectives.

0.25

FedA2L: Adaptive layer-wise learning rate adjustment in decentralized federated learning

cs.LG cs.AIcs.CVcs.DC ·2026-08-10 ·Van Truong Vo, Khoa Nguyen, Taehong Kim
publishedcode/data similarity 0.67
Abstract

Decentralized intelligence systems with heterogeneous devices and limited coordination increasingly rely on decentralized federated learning (DFL). However, DFL suffers from convergence inefficiency under data heterogeneity due to the use of a uniform learning rate (LR) that ignores layer-specific optimization needs. Foundational layers are responsible for maintaining network consensus, while specialized layers adapt to local data characteristics, leading to conflicting gradients and degraded performance under non-IID conditions. To address this fundamental tension, this work introduces FedA2L, a method that dynamically adjusts layer-wise LRs based on model divergence signals. By leveraging local update intensity and network consensus constraints, FedA2L seamlessly integrates into existing DFL protocols without additional communication or coordination. Extensive evaluations across DFL algorithms, various model architectures, and datasets demonstrate that FedA2L achieves up to 4.94 times faster convergence than vanilla DFL and reduces communication rounds by up to 59% compared to scheduler-based baselines. Furthermore, FedA2L exhibits resilience to severe data heterogeneity, larger network sizes, and sparse topologies, reducing communication overhead and establishing it as a versatile optimization tool for resource-constrained or large-scale distributed learning in edge and IoT deployments. The code is released at https://github.com/nclabteam/FedA2L.

0.48

Communication-Learning Co-Design for Pinching-Antenna-Assisted Federated Learning in Heterogeneous Wireless Networks

cs.IT ·2026-11-10 ·Shuai Wang, Wenxuan Sun, Mingjie Shao, Wantao Jiang, Yanqing Xu +2 more
similarity 0.67
Abstract

Wireless federated learning (FL) suffers from two coupled bottlenecks: statistical heterogeneity across clients and communication-constrained model synchronization over unreliable wireless links. Instead of focusing on algorithmic design and/or wireless resource optimization, this paper provides a systematic study of pinching antenna (PA)-empowered FL for heterogeneous wireless networks and develops a unified communication-and-learning framework. Specifically, we integrate a segmented waveguide-enabled pinching antenna (SWAN) architecture with a heterogeneity-robust FL algorithm based on client variance reduction and dual quantization, so as to jointly mitigate communication bottlenecks and client drift. On this basis, we further develop a two-stage SWAN-assisted downlink protocol and formulate fairness-oriented uplink optimization problems for PA positioning, bandwidth allocation, and quantization design. Efficient solution frameworks are then derived for the resulting downlink and uplink optimization problems. Experimental results show the superiority of the proposed design in convergence speed and final accuracy under non-independent and identically distributed data and communication bottlenecks.

0.16

Multi-Model Over-the-Air Federated Learning via Transceiver Beamforming and Device Grouping

eess.SP cs.IT ·2026-11-05 ·Chong Zhang, Min Dong, Ben Liang, Ali Afana, Yahia A. Eldemerdash Ahmed
top venue similarity 0.67
Abstract · 16 pages, 6 figures. Accepted by IEEE Transactions on Wireless Communications, 2026

This paper considers uplink communication design for training multiple independent machine learning models via wireless federated learning. To reduce communication delay, we utilize multi-antenna beamforming and propose a multi-model over-the-air (M-OTA) uplink transmission and aggregation method for simultaneous training of multiple models. Devices are formed into groups for local model training based on the model assignments per communication round and simultaneously perform OTA aggregation over a multi-access channel. Based on the M-OTA transmission and reception process, we formulate a joint optimization of transmit and receive beamforming and device grouping over $T$ communication rounds to maximize the training convergence rates of all models. We analyze the per-model optimality gap, which captures the impact of noisy aggregation and inter-model interference on the learning performance. We further show that the $T$-round joint optimization problem can be decomposed into per-round online optimization to devise solutions. Following this, we propose a device grouping strategy that explores channel correlation among devices to maximize OTA aggregation performance. Furthermore, we present a low-complexity iterative algorithm for joint transmit-receive beamforming with closed-form updates. Simulation shows that our proposed M-OTA approach substantially outperforms the conventional single-model sequential OTA approach and other commonly used beamforming schemes.

0.31

FedPCD: Priority-Constrained Federated Aggregation

cs.LG ·2026-10-09 ·Yousef Irshaid, Dara Varam, Mohamed I. AlHajri
similarity 0.66
Abstract · 30 pages, 17 figures, 5 tables

Federated learning (FL) seeks to optimize a shared global model from decentralized client data. While effective for average performance, this process can produce unfair performance across clients, particularly under statistically heterogeneous data distributions. Existing fairness-aware and multi-objective FL methods address this through client re-weighting, gradient correction, or common-descent formulations, but often change the global optimization direction or treat client objectives symmetrically. We propose FedPCD, a priority-constrained federated optimization framework that separates the global optimization objective from client protection. FedPCD preserves the conventional federated aggregate as the primary objective, while allowing only the minimum correction necessary to meet client performance constraints. Across heterogeneous FL benchmarks, FedPCD consistently outperforms state-of-the-art baselines, achieving the highest global accuracy across all configurations and leading worst-10% client accuracy in nearly all. FedPCD further preserves competitive trade-offs between global accuracy and client performance variability. Beyond this trade-off, FedPCD demonstrates faster empirical convergence, reaching matching or superior performance in substantially fewer communication rounds.

0.10