CS Paper Radar

Variable-Length Feedback Coding With Universal Decoding and Bandit Channel Selection

Recep Can Yavas

cs.IT cs.LG ·submitted 2026-10-27 08:22 UTC · v1
theory

Abstract

We study variable-length feedback (VLF) coding over $K$ additive white Gaussian noise (AWGN) channels whose noise variances are unknown to both terminals but lie in a known interval. The receiver selects one channel at each time, conveys the selection over noiseless feedback, and must learn the channel qualities while decoding, to avoid overusing suboptimal channels. This setting, which we call the VLF-Bandit problem, combines VLF coding, universal decoding, and bandit channel selection. We develop two joint coding and channel-selection schemes. The VLSF-Bandit scheme is a single-phase variable-length stop-feedback (VLSF) scheme based on a Gaussian random codebook, a score formed from a ratio of likelihood mixtures, and the asymptotically optimal $\text{kl-UCB}^{++}$ bandit algorithm applied to the received power. The VLF-Bandit scheme sends the message in packets by Schalkwijk--Kailath transmission, uses its normalized outputs as noise samples to learn the variances, and lets its exploration packets carry message bits. We prove second-order achievability bounds for both schemes, which are first-order optimal. In the logarithm of the achievable codebook size, the magnitude of the $\log N$ coefficient, with $N$ the average decoding time, is a baseline of one plus a channel-exploration term for VLSF-Bandit. For VLF-Bandit, this magnitude is smaller, with a universal-decoding term replacing the baseline and a smaller channel-exploration term. The VLF-Bandit bound improves on the universal VLF bound of Yavas and Tan (2025) for $K=1$ and on the bound of an explore-then-commit strategy whenever $K\geq2$.

Comment
34 pages, submitted to Transactions on Information Theory

Closest papers

Nearest neighbours by meaning across the whole index.

Scaling Bayesian Bandit Encoding with Shared Learning

cs.IT ·2026-09-05 ·Bhaskar Krishnamachari
similarity 0.69
Abstract · 15 pages, 2 figures, 5 tables; includes appendices

A communication system must choose error protection and decoding effort as channel conditions change. A Bayesian bandit encoder (BBE) uses receiver feedback to learn which transmission configuration to select. We study a receiver that decodes by guessing error patterns, using Guessing Random Additive Noise Decoding (GRAND). We extend BBE's selection component to 1,008 code and decoder configurations by learning shared performance patterns offline and updating their weights online. Decoder noise models remain fixed. On a six-configuration training-selected shortlist, sharing reduces accumulated utility loss by 33.5% relative to independent learning. A fixed training-selected configuration matches the shared learner that searches the full catalog. After channel changes, the pruned shared learner first meets a near-optimal selection criterion in 88.5% of events by 2,000 packets, compared with 54.2% for pruned independent learning with the same discounting. The results support combining sharing and pruning for configuration selection, although packet losses remain high for the tested codes under severe noise.

0.35

Feedback Capacity of Stationary Gaussian Channels: An Optimal Schalkwijk-Kailath Scheme

cs.IT ·2026-09-10 ·David Fay, Oron Sabag
theory similarity 0.59
Abstract

We consider channels with additive colored Gaussian noise and noiseless feedback. Kim's seminal work derived a stationary variational characterization of feedback capacity and further asserted that the capacity-achieving stationary input need not contain a feedback-independent Gaussian component. These results led to the construction of a simple coding scheme, based on the Schalkwijk--Kailath (SK) refinement principle, which was shown to be capacity-achieving. A recent note identified a gap in the proof of the feedback-independent component-removal assertion, thereby leaving the optimality of the SK scheme and subsequent results that rely on it incomplete. In this paper, we prove the component-removal assertion for channels with stationary Gaussian noise that has a rational power spectral density. Our proof uses a perturbation analysis of a convex optimization formulation of feedback capacity and, indeed, shows that every optimizer assigns zero power to the feedback-independent component. Using this stronger property, we construct from any optimizer an explicit SK coding scheme that achieves every rate below feedback capacity with doubly-exponentially decaying maximal error probability.

0.44

Online Learning with LLM Experts from Limited Feedback

cs.LG stat.ML ·2026-09-05 ·Wang Wei, Soumyabrata Pal, Koyel Mukherjee, Franck Dernoncourt, Ryan A. Rossi +2 more
similarity 0.58
Abstract · 21 pages, 4 figures

We study adaptive routing of prompts to large language model (LLM) experts to maximize response quality in an online setting with limited feedback. We formulate it as a bandit problem with $K$ actions that represent experts and $d$ features that encode prompts, over a horizon of $T$ rounds. We propose algorithms that strategically select and observe rewards to minimize regret. In the full-information setting, we achieve a regret of $\tilde{O}(d T / \sqrt{m})$, while in the bandit setting we achieve $\tilde{O}(d T \sqrt{K / m})$, where $m \ll T$ is a budget on feedback. Our experiments show that we efficiently learn high-quality routing strategies across diverse LLMs from limited feedback.

0.32

Soft GRAND under Channel Switching and Drift

cs.IT ·2026-08-24 ·Behrooz Razeghi
published similarity 0.58
Abstract

Under channel switching or drift, the posterior used to order Guessing Random Additive Noise Decoding (GRAND) queries can differ from the matched correction posterior, increasing query rank and finite-budget error. We bound log query rank by matched posterior self-information plus positive log-posterior mismatch; exact random-subset collision probabilities bound GRAND with abandonment (GRANDAB) error. Under switching, a state-path mixture achieves vanishing error uniformly over admissible paths below the minimum constituent capacity when log path-class size is sublinear and uniform input is capacity achieving. Under drift, pilot refresh bounds mismatch and yields a continuous refresh-period minimizer. Generalized-Gaussian BPSK simulations evaluate both regimes.

0.36

A Parameter-Free Best-of-Both-Worlds Policy for Queueing Bandits

cs.LG ·2026-11-02 ·Jongyeong Lee, Chansoo Kim
theory similarity 0.58
Abstract · Preprint

We study online channel scheduling for a single queue served by $K$ channels under bandit feedback. We propose a simple best-of-both-worlds policy that explores when the queue is empty. During busy periods, it selects the empirical best channel while the prescribed conditions hold and, if any condition is violated, switches to a robust bandit policy to clear the queue. For arbitrary arrivals and services determined by an oblivious adversary, our policy achieves $\tilde{\mathcal{O}}(\sqrt{K L_T})$ worst-case queue length regret with high probability, where $L_T$ is the longest busy-period length. This result improves the previous $T^{3/4}$ dependence and matches the worst-case lower bound up to logarithmic factors. Under bounded i.i.d. stochastic models with a unique best stabilizing channel, we show that the cumulative queue length regret converges to a finite problem-dependent constant, and further establish the logarithmic expected worst-case queue length regret bound.

0.19

Minimax Last-Iterate Convergence in Matrix Games with Observed Actions

cs.LG cs.GT ·2026-09-28 ·Yuheng Zhang
theory similarity 0.57
Abstract

We study last-iterate convergence in unknown two-player zero-sum matrix games with bandit payoff feedback and observed opponent actions. For games with $d$ actions per player, we develop an algorithm achieving a duality gap of $\widetilde{\mathcal{O}}(\sqrt{d/t})$ with high probability, simultaneously at every round $t$. This improves the dimension dependence of the best previously known guarantee by a factor of $d^{3/2}$. The rate matches a standard bandit lower bound, establishing minimax optimality in both the number of actions and the number of rounds, up to logarithmic factors. The algorithm is computationally efficient, requiring only $\mathcal{O}(d)$ time and memory per round. Our technical contribution is a joint design of adaptive averaging and corrected exponential weights that absorbs estimation variance, together with a potential argument that bounds phase durations.

0.33

Efficient Online Submodular Maximization with Bandit Feedback

cs.LG ·2026-11-09 ·Iasonas Nikolaou, Evimaria Terzi
similarity 0.57
Abstract · 31 pages

We study online monotone submodular maximization under a cardinality constraint with bandit feedback. On each round, the learner selects at most $k$ elements from a ground set of size $n$ and observes only the value of the selected set. We develop an efficient algorithm achieving $O\!\left(k\sqrt{nT\log(n/k)}\right)$ expected $(1-1/e)$-regret over $T$ rounds. To our knowledge, this is the first polynomial-time algorithm with $\sqrt{T}$ dependence on the horizon for arbitrary monotone submodular functions in the bandit setting. Our approach uses randomized sampling and a carefully constructed potential to reduce online submodular maximization to online linear optimization over the probability simplex.

0.12

Thompson Sampling for Learning in Zero-Sum Games

cs.GT stat.ML ·2026-10-11 ·Kenshi Abe, Kaito Ariu, Po-An Wang
theory similarity 0.57
Abstract

Thompson sampling (TS) achieves logarithmic and asymptotically optimal regret in classical stochastic bandits, but its behavior in multi-agent learning remains less understood. We study TS in an unknown finite two-player zero-sum matrix game with Gaussian bandit feedback. Under centralized self-play, TS samples a single payoff matrix from the posterior and plays a Nash equilibrium of the sampled game. For every fixed zero-sum game with a unique Nash equilibrium, we show that the expected cumulative duality gap is $O(\sqrt T)$. The rate improves to $O(\log T)$ for pure equilibria. We then identify the exact coefficient of the $\sqrt T$ term, which depends only on the equilibrium strategies and the noise level. We also establish a minimax lower bound matching the square-root dependence on $T$ and an instance-dependent lower bound matching the logarithmic dependence on $T$ for a class of games with a unique pure equilibrium. Experiments support the predicted rates and coefficient.

0.21