CS Paper Radar

On the Impact of Degradation-Balanced Scheduling in Manycore Systems

Maria Pantazi-Kypraiou, George Goudroumanis, George Floros, Anuj Pathania, George Stamoulis

cs.AR ·submitted 2026-10-06 11:41 UTC · v1
publishedunusual

Abstract

Electromigration degradation in manycore systems depends strongly on how runtime workload is distributed across cores. Task placement affects power, temperature, and current density, which in turn shape the spatial distribution of degradation over time. However, a scheduler that ranks cores only by their current reliability state may not always distinguish among candidate cores, especially when reliability values are close at decision time. In this case, scheduling decisions can be driven by secondary factors rather than by long-term degradation balance. This paper studies degradation-balanced scheduling and proposes a Reliability-Balanced (RB) policy that predicts the full-task effect of each candidate assignment. RB penalizes added imbalance in electromigration exposure, stress, active time, and task count while guarding the predicted Rvalue floor. On randomized continuous mixed workloads, the proposed scheduler preserves completed tasks while improving average Rvalue by 0.37% and minimum Rvalue by 4.35%. It reduces Rvalue, exposure, stress, and active-time standard deviation by 10.84%, 9.39%, 8.35%, and 16.38%, respectively.

Comment
Accepted at ICECS 2026

Closest papers

Nearest neighbours by meaning across the whole index.

Minimizing Bottleneck Overload Risk in Online Edge Task Placement under Workload Uncertainty

cs.DC ·2026-11-03 ·Lei Wang, Winston K. G. Seah, Gang Xu, Xiaodong Xu, Baoqi Huang
similarity 0.60
Abstract · 15 pages, 2 figures, 7 tables

In edge computing, tasks must be placed on servers of finite capacity before workloads are realized, often with only workload means and variances known. An assignment balanced on expected load can still leave a server with more fluctuations than its residual capacity can absorb. Per-server risk constraints can enforce a prescribed overload tolerance but do not distinguish the assignments that meet it by how close the riskiest server comes to the limit. We show that, for independent tasks, placement preserves a period's total variance and total residual capacity, and decides only how fluctuation, measured by standard deviation, is paired with residual capacity across servers. The risk ratio, the ratio of fluctuation to residual capacity, parameterizes a server's worst-case overload probability over all aggregate workload distributions with given mean and variance. We minimize the largest risk ratio, attained at the risk bottleneck. Risk-Bottleneck Placement (RBP) places tasks in descending order of standard deviation, each on the server with the smallest post-assignment risk ratio, and refines the assignment with relocations and swaps within a finite per-period online budget. On small instances solved exactly by enumerating every assignment, minimizing the maximum expected utilization leaves the largest risk ratio 25.66-29.19% above its exact minimum on average, even with risk-minimizing tie-breaking, and the corresponding gap for RBP is 1.77-2.64%. In trace-derived multi-period simulations at two workload pressures, RBP reduces the worst-server overload probability by 26.0% and 18.0% relative to the best baseline and remains the lowest at every tested pressure and scale.

0.32

ReBoT-MiCS: Reliability-Aware Bounding Time for Enhancing Timing Behavior of Embedded Mixed-Criticality Systems

cs.CE cs.SE ·2026-11-17 ·Mohammad Abbasinia, Behnaz Ranjbar, Akash Kumar
similarity 0.56
Abstract

In Mixed-Criticality (MC) systems, considering multiple Worst-Case Execution Times (WCETs) for the same task, corresponding to different system operation modes, presents a fundamental challenge in MC system design. Identifying suitable WCETs for lower (LO) criticality system operational modes is inherently difficult. Tight low WCET values may trigger frequent mode switches that degrade Quality-of-Service (QoS) by dropping/degrading the lower-criticality tasks and reducing their functionality. However, more conservative values reduce resource efficiency. Moreover, low WCET selection affects exposure assumptions under the adopted transient-fault model, which is used in reliability-aware scheduling analysis. Although some studies have considered low WCET determination to make a reasonable trade-off between processor utilization, mode switching probability and QoS, reliability constraints are typically addressed separately through fault-tolerance mechanisms. This separation overlooks the opportunity to use execution-time bounds as part of design-time reasoning about exposure-related reliability constraints. In this regard, we propose a reliability-aware analytical scheme, named ReBoT-MiCS, to determine low WCETs at design time, jointly balancing utilization, QoS, mode switches, and probabilistic reliability constraints of each task criticality level under a transient-fault exposure model. Experiments conducted with various synthetic and embedded benchmarks demonstrate the efficacy of the proposed scheme, in which utilization can be improved by up to 27.6% and 11.67% on average, while bounding the mode switching probability by up to 5.48%, and satisfying the specified reliability constraints

0.34

Regime-Dependent Value of CVaR in Preventive Maintenance Scheduling under RUL Uncertainty

eess.SY ·2026-09-27 ·Jerzy Baranowski, Waldemar Bauer
similarity 0.52
Abstract · This work has been submitted to the IEEE for possible publication

We study preventive-maintenance scheduling for a small fleet when several assets compete for a limited number of maintenance slots and their remaining useful lives (RULs) are uncertain. The planning horizon is divided into discrete periods; each asset may be maintained at most once, and at most $K$ assets may be maintained in any one period. Future usage and RUL errors are represented by scenarios. We compare a risk-neutral policy that minimizes expected cost with a risk-aware policy that minimizes expected cost plus conditional value-at-risk (CVaR), where $\operatorname{CVaR}_{0.90}$ is the mean cost among the worst 10\% of scenarios. Both policies are solved exactly by enumerating all capacity-feasible schedules. A $3\times5$ experiment combines capacities $K=1,2,3$ with five increasing levels of RUL uncertainty, with ten paired replications for each combination. The risk-aware policy provides its largest benefit when RUL uncertainty is low-to-moderate and more than one maintenance action can be executed per period. In the best observed case, it reduces CVaR by 13.4\% with an expected-cost increase of only 0.2 relative cost units. At high uncertainty, the benefit becomes negligible and the two policies can select identical schedules. The results show that risk-aware scheduling creates operational value only when prognostic information is sufficiently informative and the maintenance system has enough flexibility to act on it.

0.13

Quota-Based Aging for Prediction-Guided Scheduling in LLM Serving

cs.DC ·2026-10-13 ·Hanzhi Zhang, Anxuan Che, Hang Qi, Qiyue Li, Jingjin Wu
published similarity 0.51
Abstract · 8 pages, 10 figures. Accepted for publication at the 45th IEEE International Performance, Computing, and Communications Conference (IPCCC 20…

Large language model (LLM) serving systems use token-level continuous batching to improve resource utilization, but heterogeneous response lengths complicate request scheduling. Prediction-guided short-first scheduling reduces average latency but can severely delay long requests, while unrestricted aging may over-promote delayed long requests under congestion. We propose Quota-Based Aging (QBA), a lightweight policy that combines predicted short-first admission with quota-bounded, debt-enforced promotion of aged predicted-long requests. We also use a reduced M/G/n queueing surrogate, calibrated from simulator traces, to explain first-order mean-latency trends. QBA is evaluated using a serving-aware event-driven simulator that models decode-priority batching, chunked prefill, token-budget constraints, and KV-cache-safe admission. We compare QBA with FCFS, predicted short-first, and aggressive aging under asymmetric prediction errors on synthetic and production-derived workloads. The evaluation considers queueing delay, throughput, utilization, and class-conditional tail performance. Results show that QBA provides a controllable middle ground between aggressive short-first prioritization and unrestricted aging, substantially reducing long-request tail latency while retaining much of the mean-latency benefit of prediction-guided scheduling.

0.19

Rolling Round-Robin Rate: Standard Heterogeneous Throughput for SPEC CPU

cs.PF cs.ARcs.DC ·2026-08-30 ·Mahesh Madhav, Christoph Müllner, Jiangning Liu, Philipp Tomsich, Jeff Baxter
publishedbenchmark similarity 0.51
Abstract · 6 pages, 1 figure, Presented at the 2026 IEEE International Symposium on Workload Characterization (IISWC 2026), Boulder, Colorado

SPEC CPU has long provided a common foundation for comparing processor, compiler, memory-system, and platform performance. Its multi-copy SPECrate mode measures homogeneous throughput by running many copies of the same benchmark at once. That mode remains valuable, but modern cloud and server systems commonly run heterogeneous collections of jobs whose interactions are shaped by shared caches, memory bandwidth, power management, operating-system scheduling, and noisy neighbors. SPEC CPU 2026 introduces Rolling Round-Robin Rate (RRR), an exhibition run style that uses the existing rate suites to generate deterministic heterogeneous multiprogrammed workloads. This paper describes RRR as a benchmark methodology and proposes a SPEC-like scoring model for future RRR reporting: compute per-benchmark average throughput and coefficient of variation from per-copy ratios, compute a SPEC-style geometric mean for each copy across the suite, and average that population of copy geomeans to form a suite score with its own coefficient of variation. RRR therefore preserves the familiar SPEC throughput tradition while exposing richer information about variability, interference, and heterogeneous-system behavior.

0.28

ePACT: Energy-Performance-Aware Commitment Tracking for LLM Serving

cs.DC ·2026-10-01 ·You Peng, Youhe Jiang, Chen Wang, Binhang Yuan
similarity 0.51
Abstract

Reducing LLM serving energy does not by itself guarantee lower deployment cost when electricity procurement exposes operators to unfavorable deviations from preset commitments. We study hourly commitments with positive, potentially asymmetric costs for overuse and underuse, and formulate energy-Performance-Aware Commitment Tracking: minimize deviation costs subject to request-level service requirements. We implement ePACT, a two-level controller that adjusts serving capacity and GPU clocks as requests arrive. A global planner updates interval energy targets from measured consumption and the remaining hourly commitment. A local decision maker predicts candidate configurations' energy and completion times, checks predicted deadline misses, and selects among admitted configurations by asymmetric target-deviation cost, with a service-first fallback. Coarse-to-fine action search runs asynchronously with serving. We evaluate ePACT through single-hour comparisons, controller ablations, and full-day trace simulations for H20 and H200 GPU pools. In the 24-hour simulations, ePACT reduces the asymmetric deviation cost by $73.8\%$ and $75.7\%$ relative to vLLM while retaining near-vLLM SLO attainment. Mean absolute hourly deviations are $2.16\%$ and $2.31\%$, respectively.

0.38

Latency-Aware Orchestration for Multi-Agent LLM Workflows on Heterogeneous GPUs

cs.DC ·2026-09-03 ·Jinghao Wang, Yifeng Zhang, Xiao Zhou, Yao Lu, Yihui Zhang +5 more
similarity 0.50
Abstract · 13 pages, 7 figures

Concurrent multi-agent workflows expose future dependencies and serving-state requirements while running on heterogeneous GPU pools with time-varying load, model residency, and resource availability. The logical workflow defines the required computation, whereas its physical scheduling units, model-lifecycle actions, resource ordering, and placement must be selected according to the observed pool state. We present a prediction-guided runtime that uses workflow forecasts to construct and optimize a physical execution graph. Predictor estimates device-specific activation latency, peak memory, and model-loading cost, then propagates these predictions through workflow dependencies to forecast activation readiness and future model demand. Constructor builds semantics-preserving fusion and model-lifecycle alternatives, while Scheduler jointly optimizes their selection, placement, and execution order based on the live pool state. Across a workload spanning three workflow scenarios on a heterogeneous GPU pool, our system reduces end-to-end makespan and overall p95 completion latency under burst arrivals by up to 36.8% and 25.9%, respectively, over state-of-the-art workflow schedulers. It also saves up to 24.63 GPU-s per completed session.

0.21

Stochastic AI Model Placement for AI-and-RAN Coexistence in 6G Networks

cs.NI ·2026-11-05 ·Alaa M. Altarazi, Mohammad J. Abdel-Rahman
hot direction similarity 0.50
Abstract

This paper considers AI-service placement over geographically distributed RAN sites equipped with GPU resources partitioned into fixed, isolated multi-instance GPU (MIG) profiles. We propose C$^2$AIR, a chance-constrained optimization model that maximizes expected AI requests served while protecting uncertain RAN workloads and enforcing probabilistic capacity reliability requirements for admitted AI services. C$^2$AIR allows a service to run at multiple sites and accounts for discrete profile, memory, and GPU-slice constraints. We evaluate C$^2$AIR on a four-site deployment calibrated from NVIDIA Aerial RAN capacity figures and MLPerf Inference results, and on seven larger scenarios with up to 15 sites and 40 AI services, computing every violation and overload probability exactly from the demand distributions. C$^2$AIR keeps the RAN violation probability within its target at every hour of the day, whereas reserving for the mean RAN demand violates it in 24\% to 47\% of the intervals. The reliability condition prevents placing AI models that would be overloaded in 85\% of the intervals at an event hour, and multi-site replication serves 2.7 times more AI requests than single-site deployment. The evaluation also shows that coarse MIG instances and a heavy demand tail can make strict RAN protection expensive.

0.35