CS Paper Radar

Reliable and explainable analysis of AVS/RS by Statistical Model Checking and Process Mining

Emanuele Guerrazzi, Andrea Vandin

cs.SE eess.SY ·submitted 2026-11-10 17:28 UTC · v2
publishedcode/data

Abstract

Automated Vehicle Storage and Retrieval Systems (AVS/RS) are increasingly adopted to boost warehouse throughput while containing operational costs. We present a tool-supported analysis workflow that combines discrete-event simulation, Statistical Model Checking (SMC), and Process Mining (PM) techniques to quantify and explain AVS/RS performance. SMC, implemented through the MultiVeStA tool, delivers statistically reliable estimates of key indicators, such as cycle times and inventory consolidation, across alternative stocking and picking policies with user-specified confidence levels. MultiVeStA orchestrates multiple independent simulations in a black-box manner, enabling automated verification. PM ingests the resulting event logs to uncover the behavioural patterns and bottlenecks that drive those indicators, closing the interpretability gap typical of simulation studies. We instantiate the framework on a new open-source AVS/RS simulator configured according to recent industrial guidelines and evaluate multiple control strategies and different scenarios. Results show that the coordinated use of SMC and PM supports both predictive what-if analyses and post-hoc diagnostics. To the best of our knowledge, this is the first application of a combined SMC-PM workflow to AVS/RS operations, complemented by a reusable open-source simulation and analysis toolchain.

Comment
66 pages, 11 figures. Author accepted manuscript for Expert Systems with Applications, revised following peer review. Replaces the original pre-review version
DOI
10.1016/j.eswa.2026.135055

Closest papers

Nearest neighbours by meaning across the whole index.

Predicting Process-Level Behavior: A Benchmarking Study

cs.LG cs.SE ·2026-11-18 ·Michael Grohs, Lukas Kirchdorfer, Jana-Rebecca Rehse
published similarity 0.58
Abstract · Accepted as main track paper at International Conference on Process Mining (ICPM) 2027

Predictive process monitoring (PPM) typically forecasts the future of individual process instances, hence operating on trace level. Process managers, however, typically operate on process level, e.g., when assigning staff or calculating KPIs. The question is how well such process-level managerial decisions are supported by existing approaches, given that PPM research has so far not focused on process-level predictions. We answer this question through a comprehensive benchmarking study of two process-level prediction tasks: concurrent trace prediction and average throughput time prediction. Across synthetic and real-life event logs, we compare statistical and machine-learning-based methods, foundation models, business process simulation, and, importantly, established trace-level PPM approaches, aggregating their predictions to the process-level. We assess which modeling paradigms are most suitable for predicting process-level behavior and whether existing trace-level PPM can be effectively repurposed for this task. Our results show substantial variation in performance across approaches. Notably, aggregated trace-level predictions cause errors to compound on process-level, reducing accuracy and highlighting process-level prediction as a distinct predictive task that warrants dedicated research.

0.24

LLM-Guided Heuristic Design from Simulation Traces: A Case Study in Dynamic Production and AGV Scheduling

cs.AI ·2026-08-10 ·Jinbo Li, Chuanhao Li
similarity 0.57
Abstract · 33 pages, 8 figures

Simulation-based optimization (SBO) evaluates executable policies under stochastic dynamics, but most methods treat the simulator as a black box: aggregate scores rank candidates without revealing why they fail or which policy logic should change. We present an LLM-guided heuristic design framework that uses repeated simulation for selection and event-level traces for diagnosis. Each incumbent is assessed through multiple replications, while replaying its lowest-scoring one produces a queryable trace. A manager agent formulates bottleneck hypotheses from this evidence, and editing agents implement parallel code-level revisions. After execution checks and repeated evaluation, best-so-far selection retains only improvements. LLM revision occurs between evaluation batches, while a fixed policy controls each simulation run. We evaluate the framework in a discrete-event simulation of dynamic production and automated guided vehicle (AGV) scheduling. Across five independent optimization runs with Gemini-3.1-Pro, final mean scores averaged 77.51 on the simulator's 0-100 scale. In the highest-scoring run, trace-based diagnoses motivated proactive charging, distance-aware AGV assignment, and rebalanced dispatch priorities, raising the best-so-far mean score from 62.49 to 78.61. On 100 matched seeds, the best final policy outscored representative rolling-MILP, rule-based, and metaheuristic policies on every seed and retained its advantage under random faults without re-optimization. After separate re-optimization for a longer horizon and variable order interarrival times, the resulting policies again outscored all baselines. Ablations with two LLM backbones showed that removing either parallel candidate generation or trace-database access reduced final mean scores. These results show that simulation traces can guide targeted code-level policy improvement in complex simulation-based scheduling.

0.40

From Event Logs to Governed Action: A BlueSky Agenda for Agentic Process Mining

cs.AI cs.CE ·2026-09-07 ·Yiyuan Yang, Zheshun Wu, Yong Chu, Zhenghua Chen, Zenglin Xu +1 more
top venueposition similarity 0.57
Abstract · Accepted by ICDM 2026

Process mining has long turned event logs into process knowledge: discovered models, conformance evidence, bottleneck diagnoses, and runtime predictions. Agentic AI changes the target. Process-aware agents will not only ask what happened. They will ask whether a proposed action should be taken, given the available evidence, privacy budget, organizational authority, and downstream risk. This BlueSky paper proposes event-to-action process mining: a process-mining agenda for transforming heterogeneous operational event data into governed action. The goal is not another dashboard, a generic enterprise simulator, or a language interface over logs. We argue that the community needs four mineable artifacts: event-object representations, action evidence packages, governance contracts, and benchmarks where act, defer, ask, and refuse are all valid outputs. This agenda is timely because agentic business process management (BPM), LLM-assisted process mining, object-centric event standards, causal process monitoring, and privacy-preserving learning are maturing separately. Bringing them together defines a data-mining target inside process mining: mining logged organizational behavior for accountable action, not only retrospective insight.

0.26

Extending the MM-AR Metamodeling Platform with Process Mining Capabilities

cs.SE cs.DBcs.HC ·2026-11-03 ·Geraldine Hürzeler, Hans-Georg Fill, Daniel Borcard
code/data similarity 0.57
Abstract

Process mining derives process models from event data recorded by information systems, but its results are usually presented as two-dimensional visualizations that are separate from the environments in which enterprise models are created and maintained. Metamodeling platforms for extended reality (XR), such as MM-AR, allow users to define modeling languages and to display models in 2D and 3D, but they do not provide access to event data or mining algorithms so far. In this paper we therefore present a first proof-of-concept for showing how an XR-based metamodeling platform can be extended with process discovery capabilities without changes to the platform core through a separate Python service based on the open source PM4Py process mining library. We demonstrate the approach using three common discovery algorithms for obtaining Petri nets and BPMN models based on CSV or XES event logs. A technical evaluation using four public event logs shows that the element counts of the created model instances match those of the PM4Py models in all 16 configurations. The integration adds between about 8 and 53 seconds per run, and this overhead grows with the size of the discovered model rather than the size of the event log. Although the prototype does not yet use the third dimension to encode process information, it established the foundations for studying such approaches.

0.30

Can LLM Agents Efficiently Identify Appliance Faults? Insights From Diagnosing a Simulated Appliance

cs.CL ·2026-10-13 ·Lucas H. McCabe, Sarah Lukens, H. Howie Huang
benchmark similarity 0.55
Abstract

In so-called "Industry 4.0," integrated sensors, analytics tools, and other digital technologies supplement industrial workflows, potentiating enhanced visibility and automation. Prognostics and health management (PHM) and natural language processing (NLP) practitioners alike have explored the application of large language models (LLMs) to industrial asset management, but many prior works' focus on exam-like benchmarks has limited their assessment of LLMs' ability to automate practical operations. Herein, we introduce CoffeeBench, a fault diagnostics task for LLM agents, using a simulated appliance. The LLMs we evaluate struggle to consistently identify faults from the sensor information alone, but the best-performing ones can iteratively refine the fault-option space to eventually obtain a successful diagnosis. Our subsequent analyses, therefore, focus on: differentiating models by diagnostic efficiency (RQ1); examining the lagging performance of the three worst models (RQ2); and identifying viable heuristics for selective prediction (RQ3), including that initial diagnostic uncertainty and LLM-judged soundness of reasoning are high-signal predictors of diagnostic success. In addition to our benchmark results (Section 3.1), we provide practical insights for improving the performance of the open-weight models on CoffeeBench, such as by explicitly tracking episode state on their behalf to reduce timeouts (Section 3.2) or applying a deliberation loop to refine diagnostic hypotheses (Section 3.3).

0.24

Data-Driven Resource Aggregation for Scalable Digital Twin and Simulation Model Generation

cs.LG ·2026-10-16 ·Yucheng Wu, Alp Akcay
similarity 0.55
Abstract

As industrial digitization accelerates, the use of digital twins has become widespread. However, modern manufacturing systems are highly dynamic and frequently reconfigured, making manual model development and updates increasingly difficult. Recent research on automated simulation model generation shows that historical data such as event logs can yield simulation models automatically. However, modeling every resource at full granularity leads to unnecessary complexity and computational cost. We propose a method for automatically selecting and aggregating resources to simplify simulation modeling. Our method uses ideas from inverse reinforcement learning to learn behavioral value representations of resources from production event logs. This process identifies and aggregates resources with similar functional contributions. Experiments on manufacturing systems, using throughput and system time as performance measures, demonstrate that value-based resource aggregation performs well when the goal is to substantially reduce complexity while preserving performance accuracy.

0.24

autowerkstatt4null: An Off-Board-Diagnostics Ecosystem for Car-Workshops

eess.SP ·2026-08-27 ·Stephan Bökelmann, Rene Glitza, Meihui Huang, Odin Holmes, Lukas Jakubczyk +1 more
code/data similarity 0.54
Abstract · 11 pages, 9 figures

This paper presents autowerkstatt4null, a three-year initiative to empower independent automotive workshops with AI-driven, federated diagnostics. The project was funded by the German Federal Ministry for Economic Affairs and Climate Action. The project enhanced the initial diagnostic workflow through newly developed technologies and architectural concepts, incorporating real user feedback. The resulting demonstrator showcases key outcomes: a modular measurement platform enabling flexible hardware integration, a secure data exchange hub for trusted collaboration, asynchronous online diagnostics that decouples analysis from workshop constraints, and a digital academy supporting technician upskilling. Together, these innovations demonstrate how independent workshops can access advanced diagnostic capabilities previously limited to manufacturer tools, strengthening competitiveness and sustainability in the sector. The project repository is available at: https://github.com/nabla-B/paper_aw4null-overview.

0.38

CQTwin: A Digital-Twin Toolkit for Operational Analytics of HPC Schedulers

cs.DC cs.PF ·2026-10-19 ·Kanglin Xu, Yash Kurkure, Yihe Zhang, Michael E. Papka, Zhiling Lan
publishedcode/data similarity 0.53
Abstract · Accepted at the 1st International Workshop on HPC Operational Data Analytics (HPC-ODA 2026), held with SC26. 8 pages, 4 figures, 3 tables

HPC facilities collect years of job scheduler records, yet much of this operational data remains underused because accessible tools for turning it into actionable insight are scarce. We present CQTwin, an open-source digital-twin toolkit for operational analytics of HPC scheduling data. CQTwin addresses this gap through two complementary modes: offline trace replay and online event-driven simulation. Built on the Python-based CQSim discrete-event simulator, CQTwin combines a fidelity-validated, high-performance C++ engine with an interactive browser-based dashboard and a Snapshot Lab, enabling facility staff, operators, and researchers to characterize workloads, compare scheduling policies, and explore what-if scenarios. As an offline twin, CQTwin replays archived workload traces under alternative policies to show how the same workload would have unfolded under different scheduling decisions. As an online twin, it consumes job events as they arrive and projects how alternative policies would process the currently queued jobs, providing guidance for real-time decision-making. The dashboard supports the complete analysis workflow, including workload characterization, experiment configuration and monitoring, and multidimensional comparison of simulation results, allowing users to determine visually which policies best suit a workload and what trade-offs they entail. We validate CQTwin using production traces from the Argonne Leadership Computing Facility spanning 2016-2023.

0.55