CS Paper Radar

FedGenSC: Federated Generative Semantic Communication with Channel-Aware Adaptation

Rita Abou Fares, Razan Al Kakoun, Maher Nouiehed, Hadi Sarieddeen

eess.SP cs.LG ·submitted 2026-09-08 11:30 UTC · v1
published

Abstract

Integrating generative adversarial networks (GANs) into federated semantic communication (SemCom) is a natural progression, as generative priors can recover semantic fidelity under channel distortion that discriminative decoders cannot. However, naive GAN federation introduces three failure modes that prior work has, to the best of our knowledge, neither identified nor resolved: discriminator aggregation instability under non-independent and identically distributed (non-IID) data, semantic drift caused by divergent local embedding spaces, and channel-agnostic generation that cannot adapt to heterogeneous link conditions. We propose federated generative semantic communication (FedGenSC), which mitigates all three by employing a global generator with local-only discriminators, providing cross-client semantic information through a semantic prototype bank, and conditioning generation on the instantaneous signal-to-noise ratio (SNR). Experiments on the Europarl dataset over Rayleigh fading channels (K=10 clients, Dirichlet α=0.5) show that FedGenSC under non-IID data outperforms the FedDeepSC baseline across the tested SNR range, achieving up to a 58.2% relative improvement in bilingual evaluation understudy (BLEU)-1 at 18 dB. Ablation studies confirm the independent contribution of each component.

Comment
6 pages, 3 figures, 4 tables. Accepted for presentation at IEEE GLOBECOM 2026, Macau. This is the author's accepted version; the final published version will be available via IEEE Xplore

Closest papers

Nearest neighbours by meaning across the whole index.

Federated Learning for Semantic Communications over Multiple Access Channels

cs.IT cs.DCcs.LGcs.NI+1 ·2026-10-27 ·Yalin E. Sagduyu, Tugba Erpek, Yi Shi
published similarity 0.64
Abstract

This paper presents a federated learning (FL) framework for semantic communication (SemCom) over the multiple access channel (MAC), where multiple distributed transmitters simultaneously convey semantic information to a common receiver using end-to-end learned semantic representations. Semantic feature extraction, compression, wireless transmission, and semantic inference are jointly optimized through FL-based SemCom. Unlike conventional SemCom systems that train users independently, simultaneous semantic transmissions over the MAC enable concurrent training of multiple transmitters within the same transmission interval, thereby reducing training overhead and channel usage. Federated semantic aggregation is incorporated with shared and personalized encoder components, allowing transmitters with limited local training data to benefit from semantic representations learned from transmitters possessing larger datasets while preserving local adaptation. Evaluated using the CIFAR-10 dataset over fading channels, the proposed approach maintains high semantic inference accuracy under shared wireless access and significantly improves performance under severe data imbalance. In the meantime, simultaneous semantic transmissions can significantly reduce training overhead while preserving robust semantic performance across distributed transmitters with heterogeneous local datasets. These results highlight the potential of combining FL and SemCom to support scalable and communication-efficient edge intelligence in future wireless networks.

0.28

FedCFM: Federated Continual Domain Generalization for Fake Speech Detection via Conditional Flow Matching

eess.AS ·2026-10-01 ·Yingjian Yu, Haiyan Guo, Tianshun Wang, Xinzhou Xu, Zirui Ge +2 more
publishedcode/data similarity 0.60
Abstract · Accepted to IEEE SLT 2026

The generalization ability of Fake Speech Detection (FSD) models is crucial for real-world deployment. Existing multi-dataset co-training methods rely on fixed training sets and cannot adapt to emerging spoofing types. Although con-tinual learning has been explored, many approaches overlook limited data storage at individual devices, thereby restricting practical applicability. To address this, we propose FedCFM, a Federated continual domain generalization framework via Conditional Flow Matching (CFM) for collaboration without sharing raw speech data across distributed clients facing diverse and evolving spoofing attacks. Each client trains a CFM-based generator to model spoof-type-specific embedding distributions, and cross-client generator exchange enables synthesis of unseen spoof-type embeddings for continual classifier updating through generative replay and knowledge distillation. With the same training datasets, FedCFM achieves lower EER than the eval-uated centralized and federated domain generalization baselines, demonstrating strong cross-domain generalization. Code will be released on https://github.com/jspycpp/FedCFM.

0.45

Loss-Resilient Semantic Communication over Packet-Loss Networks at Extreme-Low Bandwidth

eess.IV ·2026-08-20 ·Shengshi Yao, Jincheng Dai, Sixian Wang, Guo Lu, Kai Niu +3 more
top venue similarity 0.60
Abstract · Accepted to appear in IEEE TMC. 14 pages, 15 figures, and 5 tables

In extreme-low bandwidth network scenarios, generative semantic codecs have emerged as promising solutions to reduce bandwidth cost for visual communications. However, these learned codecs are usually optimized solely for compression efficiency and thus not robust against transmission errors. Corruptions due to packet-loss among these highly compact generative latent representations often cause more critical degradation in fidelity and realism, intensified by the severe error propagation across the latent contexts and multi-step decoding process. In this paper, we propose ResiGLC, a novel loss-resilient generative latent coding framework designed for robust semantic communication over extreme-low bandwidth packet-loss networks. Motivated by the inherent goal-consistency between generation and compression, we sufficiently exploit the impressive in-context predictive capabilities of language models. Integrated with the masked learning strategy, our model supports arbitrary context modeling of latent codes, which could mitigate the error propagation and handle unpredictable packet loss patterns. At the receiver, a progressive resilient decoding pipeline is presented, which leverages both the contextual relationship of the latent codes and the multi-modal semantic prior in the generative latent space, separately. By jointly optimizing toward both compression efficiency and packet-loss resilience, our proposed progressive decoding mechanism offers graceful performance when dealing with dynamic packet losses. Through extensive experimental evaluations, we establish that under packet-loss network conditions, ResiGLC can effectively improve the loss-resilience in terms of perceptual fidelity and realism qualities with extreme-low bandwidth cost.

0.31

MetaCom: Meta Codebook Learning for Robust V2X Semantic Communications

cs.IT ·2026-11-11 ·Muge Yu, Danlan Huang, Xinyi Zhou, Shuqi Chai, Zhiyong Feng
published similarity 0.59
Abstract · 5 pages, 5 figures. Accepted by IEEE Communications Letters

Collaborative perception in Vehicle-to-Everything (V2X) networks faces dual challenges: strictly limited bandwidth and channel impairments. Existing static quantization schemes often suffer from feature manifold drift caused by highly non-stationary traffic environments. To address this, we propose MetaCom, a robust digital semantic communication framework featuring a Meta-Codebook Learning paradigm. First, we introduce a Differentiable Quantized Semantic Communications (DQSemCom) module trained with perturbations induced by the simulated digital modulation and channel via Gumbel-Softmax relaxation. Building on this, we design a Bi-Level Meta-Evolution Mechanism (Bi-MEM) that treats manifold drift as a sequence of rapid adaptation tasks, aligning the codebook via data-level smoothing and parameter-level meta-updates. Furthermore, we validate MetaCom under AWGN, Rayleigh, and Rician fading channels. Experimental results demonstrate that MetaCom achieves superior trade-offs between perception precision and communication overhead, outperforming state-of-the-art methods by a significant margin under low-SNR conditions.

0.43

Where to Defend? Layer-Wise Adversarial Training for Robust Transformer-Based Semantic Communications

eess.SP ·2026-09-11 ·Maria Slim, Razane Tajeddine, Mariette Awad, Hadi Sarieddeen
similarity 0.58
Abstract

Deep learning-based semantic communication (DeepSC), a Transformer-based encoder-decoder, achieves semantic fidelity over noisy channels but remains vulnerable to adversarial perturbations injected at multiple stages of the pipeline. We present a layer-wise robustness framework that compares fast gradient sign method (FGSM), projected gradient descent (PGD), and l2-normalized fast gradient method (FGM) defenses at the embedding output, and then uses PGD to analyze three attack and defense points: the embedding output, encoder output, and channel-encoder bottleneck. We evaluate reconstruction on Europarl and UK Hansard and sentiment classification on SST2 and YELP under additive white Gaussian noise (AWGN) and Rayleigh fading. A first-order damage budget, {epsilon} times the l1 norm of the clean-input loss gradient at each injection point, predicts the attack-severity ordering, and the transfer matrix reveals asymmetric defense transfer: the embedding defense transfers strongly to encoder attacks, whereas encoder defenses degrade robustness against upstream attacks. For reconstruction, encoder-point training yields the largest matched gain but fails severely under embedding attacks; joint embedding-plus-encoder training retains comparable gains under encoder attacks while mitigating this mismatch failure, and Rayleigh fading attenuates robustness gains and degradation. For classification, three of four defenses collapse to constant predictors; only the channel-encoder defense remains non-degenerate, suggesting a protective role for the 128D-to-16D bottleneck. At a signal-to-noise ratio (SNR) of 9 dB and perturbation budget {epsilon} = 0.3, the matched encoder defense recovers bilingual evaluation understudy (BLEU) from ~ 0.10 to ~ 0.64 on Europarl/AWGN, whereas the mismatched encoder defense yields a -0.444 BLEU change relative to the undefended baseline under an embedding attack.

0.19

FedUDG: Federated Domain Generalization with Unlabeled Clients

cs.LG cs.AI ·2026-11-01 ·Junyu Ren, Wensheng Gan, Philip S. Yu
code/data similarity 0.57
Abstract · 12 pages, 4 figures

Federated domain generalization (FDG) aims to learn models that generalize reliably to out-of-distribution (OOD) environments without centralizing client's data. However, existing FDG methods assume that all source clients have labeled data, limiting their ability to leverage the abundant unlabeled client data available in practice. To address this limitation, we propose FedUDG. At the federation level, FedUDG utilizes a parameter-functional differentiation strategy that maintains a semantic anchor updated solely using ground-truth labels. The remaining parameters absorb knowledge from unlabeled domains under bounded aggregation, preventing domain-biased noise from eroding the class semantics. Within each unlabeled client, FedUDG utilizes a student-teacher framework with two complementary objectives: (1) semantic self-training on high-confidence samples, using the functional differentiation between the semantic anchor and classifier to constrain the model to learn semantically pure and cross-domain stable features; and (2) label-free representation distillation on all unlabeled samples to stabilize learning under appearance variations. Together, these objectives guide the model toward a transferable feature space, while mitigating overfitting to domain-specific characteristics. Furthermore, to address the lack of systematic evaluation of FDG under formal privacy constraints, we develop a sample-level differentially private extension, DP-FedUDG, to quantify the trade-off between privacy and OOD generalization. Across four evaluation protocols, FedUDG consistently outperforms state-of-the-art baselines. The code is available at https://github.com/Jr10426/FedUDG

0.19

TwinViT-DeepJSCC: Adversarially Robust Semantic Image Communication

cs.CR eess.SP ·2026-10-06 ·Maedeh Fallahreyhani, Paeiz Azmi, Nader Mokari, M. Reza Abedi, Melike Erol-Kantarci +1 more
similarity 0.57
Abstract · 13 pages, 7 figures

Learning-based semantic communication is vulnerable to adversarial perturbations introduced before semantic encoding or over wireless channels. This paper proposes TwinViT-DeepJSCC, a preventive-corrective semantic image transceiver operating under a fixed channel-use budget. Two Vision Transformer (ViT)-based deep joint source-channel coding (DeepJSCC) branches learn complementary latent representations protected by sensitivity-aware masking. At the receiver, confidence-aware fusion, blind corruption-severity estimation, and signal-to-noise ratio (SNR)-severity-conditioned denoising diffusion implicit model (DDIM) purification mitigate residual corruption without requiring attack metadata. Experiments on the Canadian Institute for Advanced Research 100-class (CIFAR-100) dataset consider fast gradient sign method (FGSM), projected gradient descent (PGD), natural evolution strategies (NES), and Carlini-Wagner (CW) source-domain attacks, as well as random jamming and channel-aware adversarial waveforms over additive white Gaussian noise (AWGN) and block-flat Rayleigh fading. Under matched channel-use and attack budgets, TwinViT-DeepJSCC achieves maximum peak signal-to-noise ratio (PSNR) gains of approximately 9.5 dB under 20-step PGD and 10.8 dB under channel-aware waveform attacks over block-flat Rayleigh fading. Under PGD, it also improves Top-1 accuracy by up to approximately 38 percentage points over the undefended baseline and 13 percentage points over the strongest competing defense. Ablation results confirm the complementary contributions of the proposed transmitter- and receiver-side mechanisms.

0.37

Leakage-Aware Encrypted Semantic Communication with Key-Conditioned Signal Perturbation

cs.CR eess.SP ·2026-11-02 ·Omar Kaaki, Maria Slim, Mariette Awad, Hadi Sarieddeen
published similarity 0.57
Abstract · Accepted for presentation at IEEE GLOBECOM 2026

Encrypted semantic communication systems protect transmitted messages by inserting key-conditioned modules into a deep-learning semantic communication pipeline, but existing designs rely on a fixed adversarial weight and operate mainly at the semantic-feature level. We propose two changes to the encrypted semantic communication system (ESCS): a key-conditioned signal-domain perturbation layer, called learned adversarial perturbation injection (LAPI), and an information noise-contrastive estimation (InfoNCE)-guided adaptive training rule that {adds an adaptive leakage penalty alongside the fixed adversarial objective} using an InfoNCE-based proxy for mutual information leakage. Experiments on the Europarl corpus over additive white Gaussian noise (AWGN) and Rayleigh fading channels show that InfoNCE-guided training is the primary source of eavesdropper suppression, reducing the eavesdropper's bilingual evaluation understudy (BLEU) score to approximately 0.07 at high signal-to-noise ratio (SNR). Adding LAPI to the InfoNCE-guided objective further lowers the InfoNCE-estimated leakage by 5-9% with low measured inference overhead, while its impact on legitimate-receiver BLEU depends on channel conditions. The two mechanisms operate on different parts of the pipeline and can be jointly applied.

0.45