CS Paper Radar

An Availability Management Framework for Microservice-Based Safety-Critical CIoT Systems: Architecture and End-to-End Evaluation

Hassaan Siddiqui, Ferhat Khendek

cs.NI ·submitted 2026-10-09 18:47 UTC · v1

Abstract

Safety-critical Cellular Internet of Things (CIoT) systems increasingly rely on microservice architectures orchestrated across heterogeneous edge and cloud platforms. Although this paradigm improves modularity and scalability, the fault-tolerance mechanisms of contemporary orchestration platforms remain predominantly reactive, i.e., failed components are restarted or rescheduled only after an outage has already occurred. Such recovery can produce multi-second End to End Service Outage Time (E2E SOT), which can grow further under container restart backoff. This paper proposes an Availability Management Framework (AMF), a generic monitor-predict-recover loop that complements reactive recovery with machine learning-based anomaly detection and make-before-break switchover to a standby replica. Candidate ML models are evaluated offline under three protocols, including a change of operating regime, in order to select a model for live deployment. AMF is instantiated and evaluated on a three-tier tele-operated driving (ToD) testbed under a staged resource-exhaustion scenario. Relative to Kubernetes-only recovery, AMF completes switchover during the anomaly window, reduces E2E SOT, and avoids the tens-of-seconds outages associated with repeated in-place restarts under backoff. On this non-real-time testbed, residual E2E SOT lies inside healthy-path jitter and is therefore limited by path timing rather than by lateness of the recovery decision. The paper whows that coupling a validated ML based anomaly detector with proactive switchover can remove restart- and backoff-dominated outage from a critical path.

Comment
16 pages

Closest papers

Nearest neighbours by meaning across the whole index.

Argus: A Real-EKS Study of When Predicting Spot Interruptions Beats Simple Checkpointing

cs.LG cs.DC ·2026-09-30 ·Angshuman Chakravertty, MD Rayyan
benchmark similarity 0.62
Abstract · 8 pages, 5 figures, 3 tables

Elastic Compute Cloud (EC2) Spot is 60% to 90% cheaper than On-Demand but can be reclaimed on just a 2-minute notice; for expensive multi-node training this loss can be severe, with one reclaim costing hours of synchronous progress. We build Argus, a Kubernetes operator, and ask empirically, on a CIFAR-10 testbed, when predicting interruptions beats simple checkpointing. Argus on real EKS survives a real Spot drain with a graceful SIGTERM checkpoint, resuming from epoch 8 and losing only the in-progress epoch. Alongside, we further find that in an 80-trial benchmark, the reactive-on-notice degrades toward no protection once interruption outpaces the fixed 2-minute notice, and predictive wasted compute is driven to zero, but with an oversized fixed lead it over-migrates so severely that at the fastest rate only one of five runs completes, while periodic is a strong ML-free baseline. A lead-time sweep turns the lead prediction into a guideline where a small lead suffices for zero waste, but excess lead is wasteful. The predictor built is advisory (a proxy label); real interruption labels and large-model-scale validation are future work.

0.25

Offline-Tuned Service-Aware TN-NTN Feeder Allocation for 6G Post-Disaster Service Resilience

cs.NI eess.SY ·2026-10-12 ·Donglin Wang, Anjie Qiu, Qiuheng Zhou, Hans D. Schotten
similarity 0.60
Abstract · 6 pages, 5 figures, 2026 Globecom

Terrestrial network (TN) failures during disasters can overload surviving base stations (BSs) and disrupt emergency services. A non-terrestrial network (NTN) provides fallback, but its feeder link can become a bottleneck as users migrate. This paper studies post-disaster network resilience through service-priority-aware orchestration of constrained NTN feeder capacity in a post-failure snapshot. A lightweight Cross-Entropy Method (CEM) tunes feeder, offload, and user-ranking parameters offline, not as an online artificial intelligence (AI) controller. A Python system-level simulator sweeps operating regions under abstract TN-NTN link and queueing models. Gains depend on failure severity. At a 180-Mbps feeder under total TN outage, the proposed policy increases the absolute emergency-weighted continuity metric Cemg from 0.399 to 0.666 relative to the matched rule baseline with uniform feeder scaling (paired gain: 0.267; 95% bootstrap CI: [0.264, 0.271]); mild damage can reduce aggregate continuity. Offline CEM feeder-weight tuning further improves severe-failure continuity over fixed service priorities, whereas tuned offload and user ranking provide no detectable incremental gain.

0.32

Infrastructure-Aware Runtime Protection of Co-Deployed AI Services at the Industrial Edge

eess.SY ·2026-10-13 ·Nitya Sathyavageeswaran, Dibyajyoti Nath, Ziran Min, Pavan Athreya Narasimha Murthy
similarity 0.58
Abstract

In modern production lines, a single edge device simultaneously runs multiple AI services like a torque-control model, a vision inspector, a predictive maintenance routine. All these services run on the same CPU and same shared network segment. When the shared network segment saturates, the services do not crash. The services just produce outputs that are inaccurate or stale, and no longer reflect the plant's conditions. Our paper targets this class of silent, partial failure scenarios in Industrial Edge Systems. We treat each co-deployed service as an autonomous agent. We introduce the Runtime Criticality Score (RCS), which each service agent uses to express at any moment, its intrinsic utility and survival urgency under resource constraints. The score is computed from six normalized dimensions covering physical consequence, inference quality, input freshness, recent availability stress, actuator coupling, and available protective actions on the host. Its dimension weights are adjusted online through a lightweight Bayesian update driven by the type of disturbance currently observed, so the same service is ranked differently under a network delay than under thermal throttling. Agents publish their RCS to peers over an open, peer-to-peer discovery channel, and use it to negotiate three things without a central controller: (i) local threshold enforcement on their own host, (ii) migration to a willing peer when the current host can no longer protect them, (iii) reassignment of the coordination role when the incumbent coordinator is itself impaired. Beyond the immediate benefit of catching silent degradation, the framework contributes a concrete instance of decentralized, physically grounded agent coordination. Agents belonging to different owners can advertise capabilities, bid for protection, and reorganize across an open network.

0.14

Hybrid Monitoring for Early Fault Detection in Cloud-Native 5G Systems

cs.NI cs.DC ·2026-09-11 ·Anton Andersson, Sai Akshara Naineni, Mats Jansborg, Yixing Zhang, Romaric Duvignau
similarity 0.58
Abstract

This paper presents the design implementation and evaluation of NetMon a hybrid network monitoring system designed for Kubernetes-based 5G packet core deployments specifically evaluated on Ericssons Access and Mobility Management Function AMF clusters NetMon combines eBPF-based passive kernel-level traffic observation with active TCP probing and centralized correlation to detect and localize network degradation within seconds The evaluation results demonstrate that the system detects faults as subtle as 10ms of added latency or 5 packet loss correctly attributes them to the affected infrastructure component and maintains this capability under application loads up to 50 simulated UE load The total resource overhead of 34 millicores CPU and 45 MiB memory per pod suggests that the approach is promising for further validation without impacting the monitored workload The hybrid approach addresses a gap in existing monitoring tools standard health checks cannot detect partial degradation scrape-based systems introduce detection delays measured in tens of seconds and purely passive tools cannot verify idle network paths By combining these complementary techniques and centralizing the analysis the system provides the early detection and fault localization capabilities required for maintaining service quality in cloud-native 5G infrastructure.

0.27

Making Deployments Safe at Meta: Health Checks for Continuous Change-Safety

cs.SE cs.AI ·2026-08-20 ·Prakash KL, Anton Korenkov, Uttam Thakore, Christopher Hegre
top venue similarity 0.56
Abstract · 6 pages, 4 figures, Accepted to ISSRE 2026 Industry Track

Continuous deployment to large scale production systems creates a tension between release velocity and reliability. Every change is a potential reliability incident, yet every delay is a missed opportunity. This paper describes the deployment time health check infrastructure that Meta uses to mediate this tension across thousands of heterogeneous services. We summarize the architecture of this prevention based distributed system's service called Service Health Checker, explain how check authors compose templated metric queries, thresholds, and workflow predicates; and discuss how the system is integrated with tiered and phased rollouts so that regressions trigger automatic rollback. We then describe the operational problems that emerged at scale, such as noise, alert fatigue, drift, and uncovered regressions, and the program of measurement, tooling, and improved defaults we deployed to address them. We close with lessons learned from years of operating deployment health checks at Meta, and the directions we are exploring next, including AI assisted health check tuning. Index Terms: deployment safety, continuous deployment, monitoring, software reliability, release engineering, software reliability engineering, AIOps, anomaly detection

0.36

Seamless Deployment of Machine Learning Inference at the Far Edge: An Empirical AWS IoT Greengrass Architecture for Industrial Predictive Maintenance

cs.DC cs.AI ·2026-10-10 ·Prince Kwabena Appiah Boadu, Jeffery Baafi Kyei, Enoch Kofi Koranteng, Griffth Selorm Klogo
top venuehot direction similarity 0.56
Abstract · Conference paper draft in IEEE format, with code appendices. Already accepted in AiBThings - IEEE 4th International Conference on Artificial…

Industrial IoT sensors produce continuous, high-volume data streams that predictive maintenance needs to analyse in real time. Cloud-centric architectures send all raw telemetry to central servers, which costs latency, bandwidth and resilience. This paper presents a hybrid cloud-edge architecture for manufacturing predictive maintenance built on AWS IoT Core and AWS IoT Greengrass v2, with local machine learning inference at the edge and selective cloud synchronization. We deploy two configurations on real AWS infrastructure and compare them: a cloud-only baseline (Configuration A) and the proposed hybrid edge architecture (Configuration B). We measure end-to-end inference latency, bandwidth consumption and inference accuracy. Configuration B cuts cloud-bound bandwidth by 86.8% (63.6 KB to 7.2 KB per 200-reading window) and decision latency by 256x (23.1 ms cloud round trip to 0.09 ms local inference). At the edge, with no cloud involvement, it keeps an anomaly-class F1 score of 0.84 and 91% recall. The evaluation also instruments system uptime and Stream Manager queuing under cloud disconnection; the quantitative disconnection experiment is left as planned work. Our review of the literature points to four gaps that this work addresses: the lack of empirically validated Greengrass v2 deployments for predictive maintenance, unquantified bandwidth savings from selective edge synchronization, unmeasured resilience under cloud disconnection, and the open MLOps feedback loop at the edge.

0.44

SLO-Scaler: Uncertainty-Aware SLO-Driven Autoscaling for Microservices

cs.DC ·2026-08-18 ·Shuo Wang, Xiaoxuan Sun, Shao-yu Huang, Bencheng Su, Shuo Xu +1 more
benchmark similarity 0.55
Abstract

Autoscaling microservice-based applications to satisfy Service Level Objectives (SLOs) remains challenging due to bursty workloads, cascading latency across service dependencies, and cold-start overhead. Existing approaches such as the Kubernetes Horizontal Pod Autoscaler (HPA) rely on threshold-based CPU or memory metrics, which react too slowly to traffic spikes. Recent predictive methods improve responsiveness but generate point forecasts that ignore prediction uncertainty, leading to over-provisioning or oscillatory scaling. We propose SLO-Scaler, an uncertainty-aware autoscaling framework that predicts short-horizon request rates, tail latency, and SLO violation probability using a Bayesian LSTM model. SLO-Scaler integrates confidence-interval-based scaling decisions with a dependency graph analysis module that localizes bottleneck services, avoiding unnecessary whole-chain scaling. We evaluate SLO-Scaler on the DeathStarBench Social Network benchmark deployed on Kubernetes under periodic, bursty, and long-tail traffic patterns. Under bursty traffic, SLO-Scaler reduces the SLO violation rate by 29-56%, lowers the average replica count by 18-33%, and decreases scaling event frequency by 38-59% compared with the baselines, while achieving lower tail latency.

0.33

A Dynamic UPF Fault Recovery Mechanism for Enhanced Resilience in 5G Core Networks

cs.NI ·2026-10-02 ·Shirin Behnaminia, Pardis Yavari, Zeinab Zali, Mohammad Reza Heidarpour
similarity 0.55
Abstract

Ensuring fault tolerance in the User Plane Function is essential to maintain service continuity in 5G networks, particularly as latency-sensitive applications become more prevalent. This paper presents a novel mechanism for dynamic UPF failure detection and recovery within an OpenAirInterface-based 5G core environment. The approach introduces an application-layer session restoration mechanism to ensure service continuity and minimize disruptions during UPF failures. Experimental results demonstrate that the proposed mechanism reduces UPF downtime while maintaining low packet loss and enabling rapid service recovery. In tests with TCP and UDP traffic, connectivity was restored within a few seconds, minimizing service degradation. Furthermore, our failure-aware UPF selection mechanism improves long-term system resilience by considering recent failure history. The results highlight the effectiveness of our lightweight framework in improving the overall reliability of 5G networks, making it a valuable contribution to network robustness.

0.16