CS Paper Radar

Variational Probabilistic Quantization for Secret Key Generation

Xinyang Li, Vlad C. Andrei, Peter J. Gu, Yiqi Chen, Ullrich J. Mönich, Holger Boche

cs.IT ·submitted 2026-09-02 22:43 UTC · v1
publishedtheory

Abstract

Secret key generation from correlated observations at Alice and Bob, in the presence of an eavesdropper Eve, underpins physical-layer security. Classical pipelines quantize by hand, amplify privacy afterwards, and optimize no objective tied to a key rate. We propose Variational Probabilistic Quantization (VPQ): neural encoders that map the correlated sources directly into a discrete key alphabet, trained by a variational adversarial objective whose entropy, mismatch, and leakage terms match the three terms of the one-way secret key rate. A linear code-offset secure sketch then reconciles the encoder outputs into an identical key without a separate privacy amplification step. We prove that the VPQ losses lower-bound the one-way secret key capacity of the induced source, and derive in closed form the optimal worst-case key rate over the source class of a given alphabet size and mismatch probability, attained by finite-field linear sketches. On Gaussian fading channels, VPQ leaks less to a correlated eavesdropper than one classical and two recent learning-based baselines, and Reed--Solomon reconciliation operates within the predicted finite-blocklength gap.

Comment
6 pages, 4 figures. Accepted at IEEE GLOBECOM 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Second-Order Expansion of Privacy Amplification Under f-Divergence Criteria

cs.IT ·2026-09-10 ·Mario Berta, Hao-Chung Cheng, Marco Tomamichel
similarity 0.61
Abstract

We derive the second-order asymptotics of randomness extraction from memoryless sources with side information under security criteria based on a broad class of Csiszàr f-divergences, treating both a fixed reference side-information marginal and optimization over that marginal. The conditional varentropy decomposes into fluctuations of the conditional entropy across different values of the side information and the average variance of the conditional surprisal for each value. Without marginal optimization, these contributions yield a Gaussian-mixture second-order profile. With marginal optimization, they combine into the total conditional varentropy, yielding a single Gaussian profile. As corollaries, we obtain second-order expansions for Rényi-entropy criteria of all orders $α\in (0,1)$ and recover the known expansion for total variation distance.

0.30

Adaptive Coding for Two-Way Wiretap Channels with One-Sided Strong Secrecy

cs.IT ·2026-09-12 ·Masahito Hayashi, Yanling Chen
theory similarity 0.60
Abstract

We study a discrete memoryless two-way wiretap channel under strong one-sided secrecy, where User 1's message is confidential and User 2's message is not required to be secret. We develop non-adaptive and key-assisted adaptive inner bounds from a common resolvability estimate for selected index components. For the adaptive construction, we prove a multiround leakage theorem that accounts both for information revealed about a key before its later use and for the possibility that an encoder uses an incorrectly decoded key. The proof includes an ideal-to-implemented coupling, deterministic codebook selection, and a growing-round argument that removes the initialization-rate loss. We eliminate the internal component rates exactly and characterize the adaptive gain at each fixed auxiliary distribution. For an open two-parameter family of binary channels, we also prove a converse for arbitrary non-adaptive stochastic codes and obtain an operational adaptive-versus-non-adaptive separation. For one representative channel, the complete non-adaptive strong one-sided secrecy capacity region is identified exactly.

0.16

SANAI: Secure ECC Distributed Keyed Parity Embedded in Weights for Protecting Neural Networks against Bit-Flip Attacks

cs.CR ·2026-11-01 ·Habibur Rahaman, Daniel Lobo, Md Rezoan Ferdous, Swarup Bhunia
similarity 0.60
Abstract

Quantized neural networks store weights in dense memory, where bit flips caused by voltage scaling, aging, radiation, or deliberate attacks such as RowHammer can severely degrade model behavior. A single corrupted high-order bit can cause misclassifications or nonsensical language-model outputs. Embedded error-correcting codes (ECC) avoid dedicated parity storage by hiding parity within model weights, but existing schemes embed uniformly across layers and bit planes, leave parity unsecured, and tolerate bit-error rates (BERs) only up to about 6%. An adversary aware of sensitive weights and the ECC scheme can also bypass protection by exceeding the correction capability of targeted codewords. We propose SANAI, a sensitivity-guided, bit-plane-selective scheme that protects critical model weights against bit flips with zero additional parity-storage overhead. SANAI secures parity through keyed embedding across a two-dimensional weight space: spread-transform dither modulation binds parity to a secret key, and keyed interleaving disperses concentrated attacks across codewords. We derive a survival law showing that robustness is governed by the correctable fraction t/n rather than by t alone, and a closed-form bound on the protectable fraction of a model. As a streaming checker on an 8x8 systolic array, SANAI verifies weights on the load path with 0.41% area overhead and no additional memory. Across ten vision backbones, three quantization schemes, and ten language models from 82M to 13B parameters, SANAI stays within about one percentage point of clean accuracy at BERs up to 12%, twice the maximum of prior embedded-ECC approaches. It survives fine-tuning bit-exactly, neutralizes progressive and targeted bit-flip attacks, and exactly corrects AttentionBreaker and SilentStriker attacks.

0.28

Leakage-Aware Encrypted Semantic Communication with Key-Conditioned Signal Perturbation

cs.CR eess.SP ·2026-11-02 ·Omar Kaaki, Maria Slim, Mariette Awad, Hadi Sarieddeen
published similarity 0.60
Abstract · Accepted for presentation at IEEE GLOBECOM 2026

Encrypted semantic communication systems protect transmitted messages by inserting key-conditioned modules into a deep-learning semantic communication pipeline, but existing designs rely on a fixed adversarial weight and operate mainly at the semantic-feature level. We propose two changes to the encrypted semantic communication system (ESCS): a key-conditioned signal-domain perturbation layer, called learned adversarial perturbation injection (LAPI), and an information noise-contrastive estimation (InfoNCE)-guided adaptive training rule that {adds an adaptive leakage penalty alongside the fixed adversarial objective} using an InfoNCE-based proxy for mutual information leakage. Experiments on the Europarl corpus over additive white Gaussian noise (AWGN) and Rayleigh fading channels show that InfoNCE-guided training is the primary source of eavesdropper suppression, reducing the eavesdropper's bilingual evaluation understudy (BLEU) score to approximately 0.07 at high signal-to-noise ratio (SNR). Adding LAPI to the InfoNCE-guided objective further lowers the InfoNCE-estimated leakage by 5-9% with low measured inference overhead, while its impact on legitimate-receiver BLEU depends on channel conditions. The two mechanisms operate on different parts of the pipeline and can be jointly applied.

0.45

Revisiting Privacy Risks in Quantized Deep Neural Networks

cs.CR ·2026-10-27 ·Jie Fu, Ren Li, Wendy Hui Wang
publishedcode/data similarity 0.60
Abstract · Accepted by 2026 IEEE International Conference on Big Data

Model quantization has become a fundamental technique for enabling the efficient deployment of large-scale deep neural networks (DNNs) in data-intensive applications by reducing model size. Despite its widespread adoption, the impact of quantization on training data privacy --- particularly vulnerability to membership inference attacks (MIAs) --- remains largely unexplored. In this paper, we present the first comprehensive empirical study of privacy risks in quantized DNNs, evaluating eight state-of-the-art MIA attacks across six representative quantization methods. Our results reveal that practical quantization levels (4-8 bits) have limited impact on membership privacy risks, with quantized models remaining largely as vulnerable as their full-precision counterparts. Although aggressive low-bit quantization (e.g., 2-bit) can provide meaningful privacy gains, these benefits come at the cost of substantial utility degradation. To understand the underlying causes of these observations, we systematically analyze how different quantization strategies affect model behaviors and outputs, and how these changes influence privacy vulnerability. Beyond evaluating attack risks, we further investigate whether existing privacy defenses developed for full-precision DNNs can effectively protect QNNs. Our results show that these defenses provide only limited additional privacy protection when applied to quantized models, while further amplifying utility degradation. Our study provides practical guidance for privacy-aware deployment of quantized DNNs and motivates the development of new attack and defense mechanisms for QNNs. Our code and datasets are publicly available at https://github.com/JeffffffFu/Priv-QDNN.

0.43

Privacy-Preserving Deep Joint Source-Channel Coding with In-Loop Concept Erasure

eess.SP cs.LG ·2026-09-11 ·Rami Eid, Maria Slim, Mariette Awad, Hadi Sarieddeen
similarity 0.59
Abstract

Deep joint source-channel coding (DeepJSCC) transmits learned semantic features efficiently but can leak sensitive attributes such as gender, race, or speaker identity. We propose LEAPSC (LEACE-in-the-loop privacy for semantic communication), whose core contribution is the integration of in-loop least-squares concept erasure (LEACE) within a variational information bottleneck (VIB) encoder. By periodically refitting the projection operator during training, LEAPSC couples the encoder dynamics to the erasure mechanism, driving attribute-conditional mean differences toward zero within each task-label group on the fitting sample. Additional components, namely conditional value-at-risk (CVaR) tail-sensitive privacy, feature-wise linear modulation (FiLM) signal-to-noise ratio conditioning, and Lagrangian dual ascent, improve robustness across channel conditions and over the high-leakage tail of samples. On CelebA, FairFace, and Google Speech Commands, LEAPSC reaches task accuracy of 0.862, 0.755, and 0.925 respectively, with attacker accuracy at or below the label-only floor on CelebA (0.548 vs. floor 0.580) and within 2 percentage points (pp) of chance elsewhere, improving over an information-bottleneck adversarial baseline (IBAL) at a matched 52-epoch budget by +3.6, +2.5, and +1.3 pp (Welch's t-test, p=0.019 on CelebA).

0.24

Adversarial Entropy Inflation Against Gumbel-Based Inference Verification

cs.CR cs.AI ·2026-08-24 ·Nikita Kezins
similarity 0.58
Abstract · 4 pages, 1 figure, 1 table

Gumbel-based inference verification bounds LLM weight exfiltration by only forgiving token choices that plausibly arise from honest GPU nondeterminism, reporting a >200x slowdown for a steganographic adversary under benign prompt traffic. This bound assumes a passive attacker; we show it degrades sharply against an adversary who instead controls the prompt distribution. Because the verifier's admissible-token-set size is driven by the model's own output entropy, prompts engineered to break grammatical and sub-word structure -- rather than benign conversational traffic -- widen that set and open a materially larger covert channel. Across six instruction-tuned models spanning 1B to 32B parameters and three random seeds, our strongest attack (character- and script-level disruption) roughly doubles bits leaked per token relative to benign prompts, cutting the slowdown factor to 60x - 118x. These results indicate that static, benign-traffic-calibrated thresholds are insufficient for this defense, and that jitter-forgiveness thresholds should instead be calibrated dynamically against local token entropy.

0.19

Spectrum-Aware Bounds on Invertibility for Privacy-Enhancing Instance Encoding

cs.LG cs.CR ·2026-08-24 ·Seokjin Hwang, Yuting Li, Kiwan Maeng
similarity 0.58
Abstract

Instance encoding is a popular empirical technique for privacy enhancement when sharing data to an untrusted server. It transforms sensitive data through an encoding process before sharing, with the hope that the encoding process retains utility but makes it hard to reconstruct the original data. However, most work offers no theoretical guarantee that the encoding process is actually irreversible. A recent work derived a mean-squared error (MSE) bound limiting any adversary's reconstruction accuracy, offering one of the first theoretical results in this domain. This bound, however, has three critical limitations: it is often too loose, only works with randomized encoders (excluding many deterministic encoders practitioners use), and only bounds MSE. We introduce a family of new bounds that (1) are tighter, (2) applicable even to fully deterministic encoders, and (3) can extend beyond MSE to other norm-based similarity metrics, by properly accounting for the encoder's spectral structure. We evaluate our bounds across a range of encoders, datasets, and attacks, showing they hold consistently and improve upon the existing bound.

0.29