CS Paper Radar

Shallow Probes Are Sufficient for Near-Oracle Personalization Depth Allocation in Federated Learning

Beyazit Bestami Yuksel, Emrah Dikbiyik, Ayse Yilmazer Metin

cs.LG ·submitted 2026-10-18 11:24 UTC · v1
publishedhot direction

Abstract

Rather than proposing a new federated optimizer, we study whether a small client-specific measurement budget can support cost-aware personalization-depth decisions under a utility that trades Macro-F1 against deployment cost. Exhaustive evaluation of six depths defines an offline oracle that is not deployable. We audit the Probe Sufficiency Hypothesis: three shallow probes (P0--P2) may contain most decision-relevant information for approaching that oracle. FedPBA is a secondary learned instantiation for deep-action extrapolation. On CIFAR-10/100 and patient-disjoint PTB-XL (45 sessions; 900 clients; 2700 evaluations; GroupKFold), training-free greedy probing achieves regret 0.0071 and 98.3 percent oracle recovery, beating metadata-only policies and FedPBA (0.0110 / 97.3 percent). Aggregate shallow-best versus oracle correlation is 0.9818 but falls to 0.578 on deep-oracle rows; PTB-XL deep-oracle cases remain a high-regret boundary without a validated escalation gate.

Comment
6 pages, 9 figures. Accepted and presented at SINCONF 2026 (18th International Conference on Security of Information and Networks), Beykent University, Istanbul, Turkiye, 14-16 October 2026
Journal ref
Proc. 18th Int. Conf. Security of Information and Networks (SINCONF), Istanbul, Turkiye, Oct. 2026

Closest papers

Nearest neighbours by meaning across the whole index.

When Is Personalized Federated Learning Worth Its Deployment Cost?

cs.LG ·2026-11-01 ·Beyazit Bestami Yuksel, Ayse Yilmazer Metin, Emrah Dikbiyik
published similarity 0.78
Abstract · 6 pages, 2 figures. Accepted and presented at UBMK 2026

Personalized federated learning (PFL) may improve client-level performance, but deeper personalization increases deployment cost. We formulate personalization-depth selection as a utility-based empirical decision problem in which client utility equals Macro-F1 minus a cost-sensitivity weight times deployment cost, over six personalization depths labeled P0 through P5. We compare fixed policies with an offline per-client Oracle reference and report allocation maps over Dirichlet data heterogeneity and cost sensitivity. Although evaluated on this hierarchy, the formulation can accommodate any finite candidate set. On CIFAR-10, CIFAR-100, and a PTB-XL subset, personalization shows empirical, setting-dependent decision regimes rather than a universal benefit: higher cost sensitivity shifts Oracle mass toward the global-only depth P0; low cost sensitivity can favor deeper actions. Patterns are grid observations (three seeds per cell), not theoretical boundaries. Best-uniform is competitive with Oracle assignment (6.5 percent plus or minus 7.8 percent relative regret; 95 percent confidence interval 5.9 to 7.1), whereas random and personalize-all incur much larger regret (189.3 percent plus or minus 367.1 percent and 409.0 percent plus or minus 803.2 percent). Under the same utility, Ditto full-model personalization is substantially suboptimal once cost is counted. The contribution is an offline characterization of when personalization depth is worth its cost, not a new PFL optimizer or deployment-time scheduler.

0.15

When is a better LLM worth paying for? Stochastic Optimization with Switching Mixed-Fidelity Oracles

cs.AI math.OCcs.LG ·2026-10-15 ·Swati Gupta, Tianjiao Li
similarity 0.64
Abstract

Large language models (LLMs) are increasingly used upstream of decision-making to clean data, detect label errors, and reconstruct missing values. Yet LLM-assisted data curation creates a new operational tradeoff: higher-fidelity models and richer prompts can be substantially more expensive, while the value of this additional fidelity depends on the downstream optimization accuracy. This raises the central question of this work: when should one pay for a better LLM, given a specific downstream task at hand? We study this question through stochastic optimization with mixed-fidelity first-order oracles, which can have systematic bias and state-dependent variance. We develop two cost-aware algorithmic frameworks that allow adaptive switching between stochastic oracles. With known bias, the first meta-algorithm applies a restarted, cost-aware policy that adaptively selects oracle fidelity across optimization stages. Its cumulative cost is no larger than that of the best fixed oracle in hindsight and can be substantially smaller. With unknown bias, we develop a budgeted certification scheme that uses occasional trusted-gradient evaluations to certify the optimization progress and eliminate unsuccessful oracle sources, and show an explicit tradeoff between certification cost and delayed detection of biased sources. We provide concrete realizations of these meta-algorithms by applying biased stochastic gradient extrapolation (SGE) and recursive regularization under state-dependent noise as subroutines. Synthetic and LLM-completion experiments illustrate the qualitative switching behavior predicted by the theory: the adaptive policy skips several expensive LLM oracles and substantially reduces cumulative cost relative to fixed high-fidelity alternatives while achieving comparable accuracy.

0.15

SkillLift: Learning Dense Rubrics from Sparse Oracles for Efficient Skill Evolution

cs.AI ·2026-09-14 ·Haoxiang Kang, Ming Wen
code/data similarity 0.64
Abstract

LLM-based agents increasingly rely on persistent skills, i.e., reusable procedural prompts, to adapt without weight updates. Existing skill self-evolution methods directly revise skill text based on execution feedback, but each oracle evaluation requires a full agent rollout, creating a supervision bottleneck that confines search to failure-patching updates. Our key insight is that ranking is a smoother supervision target than absolute outcome regression: identifying which skill is better requires fewer oracle evaluations than predicting exact scores. Building on this insight, we propose SkillLift, which decouples skill search from oracle cost by learning an oracle-aligned rubric as a structured evaluation space. We formalize this as a bilevel optimization problem solved via alternating optimization: an inner loop uses the frozen rubric as a cheap surrogate to guide skill revision at no oracle cost, while an outer loop invokes a small number of oracle rollouts to re-align the rubric via rank correlation, amortizing oracle cost and stabilizing text-space updates. Experiments on complex agent task benchmarks show that our method outperforms existing auto-skill methods with 40--70\% less token cost compared to frontier evolving methods. Codes are available at https://github.com/WalteR-MittY-pro/SkillLift.

0.51

RLGPA: A Reinforcement Learning-Guided Granularity Planning Attack for Decision-Based Sparse Adversarial Examples

cs.LG cs.CV ·2026-11-05 ·Chao Zhou, Shenghua He, Jiaxin Mo, Qiangguo Yu, Fengchuang Xing
code/data similarity 0.62
Abstract

Decision-based sparse attacks must reduce perturbation support using only the victim's predicted label. The best restoration strategy varies as support contracts: coarse removal works early, while tail states need finer, history-aware tests. We propose RLGPA, an online reinforcement learning method that schedules support-reduction executors and their granularity under a hard query budget. A masked Dueling Double DQN selects among seven stable policy--scale actions; each action produces support-relative restoration groups that are rebuilt after every macro decision. A feasibility-preserving executor commits only adversarial restorations and feeds support gain and query cost back to the planner. Under the matched top-1-label oracle, RLGPA reaches 61\% targeted ASR at sparsity 0.01 on CIFAR-10 (vs. 25\% SparseEvo, 0\% Pointwise), and 75.5\%/73.0\% on ResNet50/ViT at sparsity 0.005 (vs. 29.0\%/15.5\%). A fixed-probe test reduces median \(L_0\) from 165 to 23 after 40 images without any update. State-blind and state-shuffled controls degrade significantly, confirming that the learned policy uses attack state; the main gains come from state-conditioned executor scheduling and dynamic repartition. The source code is publicly available at https://github.com/Acui001/RLGPA.git.

0.25

SERO: Learning from Executable Oracle Continuations for Long-Horizon Agentic Reinforcement Learning

cs.AI ·2026-10-14 ·Dingyi Rong, Yue Shi, Chaofan Ma, Zongrui Wang, Jiezhang Cao +3 more
similarity 0.62
Abstract

Long-horizon agentic RL is constrained by the futures visited by the current policy. When rollouts fail to reach useful behaviors, improved credit assignment cannot provide supervision for states and actions that were never encountered. On-policy distillation (OPD) introduces teacher guidance on policy-induced states, and recent multi-turn variants improve how this guidance is scheduled, replayed, refined, or validated. However, they do not directly use the oracle-controlled future itself as the training trajectory. We introduce \textbf{State-Rooted Executable Rollout Optimization (SERO)}, which augments on-policy agentic RL with executable oracle continuations. SERO restores a state actually reached by the current policy and lets a training-only oracle continue interacting with the real environment, making the downstream observations and oracle actions themselves available for learning. It then applies \textbf{policy-reachability weighting}, which weights each oracle step by the frozen behavior policy's compatibility with the preceding oracle actions. This allows deeper supervision to become effective as the policy becomes more compatible with the oracle branch. The oracle loss is optimized separately from the base RL estimator and no oracle is used at inference time. We evaluate SERO on two challenging interactive-agent benchmarks, ALFWorld and WebShop, using Qwen2.5-1.5B-Instruct and Qwen2.5-7B-Instruct. On ALFWorld, learning the full executable continuation is substantially more effective than supervising only the root oracle action, while policy-reachability weighting further improves out-of-distribution performance.

0.30

Measure Learning at Steady State: A BIRD-SQL Formula 1 Case Study

cs.LG cs.AI ·2026-09-11 ·Manoj Bajaj
similarity 0.61
Abstract

Continual Learning Bench scores learning as short-horizon gain versus a reset baseline and finds naive full-context ICL strongest among the memories it tested. We treat ICL as one learning system and score it on a longer shared-world schedule. Steady-state learning is the gap versus baseline on a pre-set late window (last 40 of 174 BIRD-SQL formula-1 questions). We split the score into exploration efficiency (SQL probes), task reward (hits), and delivery cost (API dollars and context size). On gpt-5.6-luna, late probes fall from 4.6-5.6 to 0.95 while hits rise only modestly and ICL context grows to about 95k tokens with cost roughly doubling. Short-horizon gain understates the late probe saving and misses the cost inversion, so we find that unbounded ICL is a poor candidate for the learning mechanism.

0.20

Mitigating the Length-Scaling Tax with Online Distillation

cs.LG cs.AI ·2026-09-30 ·Xu Wan, Wenyue Xu, Shengjie Zhao, Mingyang Sun
similarity 0.61
Abstract

Length scaling during reinforcement-learning (RL) post-training is often viewed as a sign of improved reasoning ability, especially on difficult problems, but may also make responses to already-solved problems unnecessarily verbose. We quantify this side effect as the length-scaling tax (LST): excess response length on already-solved queries without a commensurate accuracy gain. To mitigate LST, we propose Length Self-Distillation (LSD), which routes solved prompts to on-policy distillation and retains the original RL objective for unsolved prompts. LSD uses an exponential moving average of the online policy as its teacher, requiring no external model. We find that LSD achieves comparable or better performance than RL across multiple variants, while substantially curbing response-length growth on easy queries. LSD reduces LST from 19.0% to -3.7% on single-turn reasoning and from 31.4% to 13.7% on multi-turn agentic tasks, demonstrating that LSD effectively preserves concise response patterns on easy queries while supporting efficient exploration on difficult queries during RL post-training.

0.24

The Decision Value of Perception Compute

cs.LG cs.CV ·2026-09-28 ·Hoang Pham Cong, Ho Viet Duc Luong
benchmarktheory similarity 0.60
Abstract

Adaptive perception spends extra computation on inputs where perception is expected to improve. When perception feeds a downstream decision system, a better perception output need not produce a better decision. We define the decision value of perception compute as the change in downstream loss from escalating an input from a cheap to an expensive perception mode. Because this value can be negative, the allocation of perception compute should be judged against a budget-constrained decision oracle, with uniform full-fidelity inference as a baseline rather than an upper bound. We introduce DEEP (Decision Evaluation for Escalated Perception), a benchmark that scores pre-escalation allocators against this oracle under selection, latency and energy budgets, charging each allocator for its own computation. With deployed monocular geometry on KITTI and nuScenes, we find that 34--54% of the escalations that change downstream loss make it worse; harmful escalations also occur for the published PDM-Closed planner, evaluated open-loop on nuPlan with real detector outcomes. On nuScenes, perception-level gain frequently disagrees in sign with decision value. This mismatch has practical consequences: choosing among fixed deployable signals by missed-object perception gain rather than by decision value reduces realized test decision gain by 7.4% of the all-cheap loss on average. Learned allocators recover part of the oracle's value by finding beneficial escalations but select nearly as much harm as random, and once their own computation is charged at a 20% latency budget, only the lightweight routers, at about 3.5\% of a full detector pass, still beat random.

0.42