CS Paper Radar

Grounding Time-Series Foundation Models in Digital Twin Topology for Predictive Maintenance

Sizhe Ma, Katherine A. Flanigan, Mario Bergés

eess.SP cs.AI ·submitted 2026-09-30 16:24 UTC · v1
benchmarkhot direction

Abstract

Digital twins increasingly support downstream analytical tasks that depend on time-series data, motivating interest in time-series foundation models (TSFMs) as scalable backbones. However, TSFMs are primarily pretrained for temporal continuation and often underperform on unseen tasks such as regression, and systematic empirical comparisons against state-of-the-art dedicated models in digital twin contexts remain limited. This paper makes three contributions. First, we benchmark five well-known TSFMs with frozen backbones on remaining useful life (RUL) prediction using the C-MAPSS dataset, finding that multivariate architectures substantially outperform univariate ones, particularly under varying operating conditions. This raises a deeper question: when cross-channel dependencies can be modeled through pretrained weights, target-task adaptation, and digital twin-derived representations, how much does each contribute, and are they complementary? Second, we propose a topology-informed fusion approach in which topological constraints, derived from the asset structure the digital twin stores among its information models, explicitly shape cross-attention, so that fused representations respect the physical system's local connectivity rather than relying on unconstrained all-to-all interactions. Third, we conduct an ablation study across C-MAPSS subsets of varying operational complexity that isolates the three sources and their interactions. The sources prove complementary rather than redundant, and topology-constrained attention outperforms unconstrained fusion, though by a small margin, enabling a frozen TSFM informed by digital twin representations to remain competitive or in some cases exceed state-of-the-art performance on this regression task.

Comment
Submitted to Reliability Engineering \& System Safety (RESS)

Closest papers

Nearest neighbours by meaning across the whole index.

Digital Twin Enhanced Channel Twin for AI-Native CSI Inference: Generalizability and Scalability

eess.SP ·2026-09-22 ·Majumder Haider, Imtiaz Ahmed, Zoheb Hassan, Danda B. Rawat, Huaiyu Dai
similarity 0.62
Abstract

Accurate channel state information (CSI) is critical for advanced multi-antenna wireless networks. While high-fidelity and site-specific ray-tracing (RT) equipped wireless digital twins can overcome overhead for CSI acquisition. However, computing deterministic, calibrated RT based CSI from a wireless digital twin for every orthogonal frequency-division multiplexing (OFDM) symbol violates the strict microsecond latency budgets of the 5G NR numerology. To overcome this computational bottleneck, this paper investigates three approaches within a calibrated 3D digital twin framework, namely (i) the generalization of the channel twin, (ii) the performance enhancement using a neural receiver, and (iii) a data-driven interpolation framework for scalability. We compute high-precision CSI for a sparse subset of temporal anchors and employ an attention-based Transformer to predict the remaining symbols. Unlike polynomial splines or sequential long short-term memory (LSTM) networks, the Transformer exploits a global receptive field to capture the non-linear multipath dynamics while enabling parallelizable, real-time inference. To achieve spatial scalability, we introduce channel twin generalization. By fine-tuning the 3D RT models alongside the Transformer, the framework leverages the CSI dataset of one location to infer the channel behavior of an unseen environment. Transfer learning further adapts the model to a new environment using only a small fraction of locally collected data. Simulation results demonstrate that the proposed architecture substantially outperforms the baseline interpolators, achieves robust spatial transferability, and lowers the bit error rate through the unified neural receiver. These results establish a scalable, environment-agnostic foundation of distributed channel twins for high-quality, low-overhead CSI acquisition in next-generation cellular networks.

0.25

A Human-Centric Adaptive Multi-Fidelity Digital Twin Framework for Cyber-Physical Systems

cs.HC eess.SY ·2026-11-18 ·Clarisa Grijalva-Lugo, Yu-Zheng Lin, Shalaka Satam, Sicong Shao, Jesus Pacheco +2 more
similarity 0.61
Abstract · 20 pages, 3 figures, 11 tables; submitted to Advanced Engineering Informatics

Digital twins of cyber-physical systems must operate with scarce data, on assets that change after deployment, and for humans whose needs differ, yet existing implementations fix fidelity at design time and do not match the representation to the human or the task. This paper proposes a human-centric adaptive multi-fidelity digital twin framework that models the evolving human, the physical twin, and the digital twin core, and adds a human inference and adaptation function that estimates the human state, predicts the response, and adapts the representation. The framework defines low-, medium-, and high-fidelity tiers distinguished by adaptivity and by coupling, quantified as the ratio of the digital twin latency to the duration of the process step it follows. Three proof-of-concept instantiations are evaluated: a virtual reality tutor, a computer numerical control milling model, and an industrial training station. The low tier estimated learner sentiment with an accuracy of 0.86. The forecasters of the milling model and the training station, both medium-tier, showed a normalized error decline of 0.39 to 0.89 and a human adaptation gain of 1.16 to 1.51, but their latency exceeded the physical process step by 25 to 87 times. Only the station's vision model met the physical step. The tiers are separated by which functions adapt and where the latency constraint lies, not by a monotone increase in gain or coupling.

0.29

Does Joint-Embedding Predictive Architecture Pretraining Help Time Series Forecasting?

cs.LG cs.AIstat.ML ·2026-09-16 ·Yutong Feng, Bowen Liao, See Kiong Ng, Yuxuan Liang
similarity 0.60
Abstract

Joint-embedding predictive architectures (JEPA) have emerged as a promising self-supervised pretraining paradigm for time series, learning representations by predicting target embeddings in latent space rather than reconstructing raw signals. Yet evidence on their benefits remains mixed, and most studies test only a single backbone or a narrow set of architectures, leaving unclear whether JEPA pretraining is a reliable improvement or one that depends heavily on the downstream model. We address this gap through a large scale evaluation of one JEPA instantiation across nine backbones and eleven benchmarks spanning temporal and spatio-temporal forecasting, the most extensive cross architecture assessment of JEPA for time series to date. We find that the benefit of this instantiation varies sharply across backbones, producing consistent gains for some architectures and consistent degradation for others, even on the same dataset. This pattern holds across both task families, indicating the variability is a general property of this instantiation rather than a dataset specific artifact worth accounting for when choosing a backbone in practice.

0.21

Integrating Machine Learning and Uncertainty Quantification for Real-Time Decision-Making in Digital Twins: A System-Centric Review and Perspective

cs.LG stat.AP ·2026-11-03 ·Yi-Ping Chen, Ying-Kuan Tsai, Seul Lee, Vispi Karkaria, Dex Doksoo Lee +1 more
similarity 0.60
Abstract

Digital Twins are evolving from passive virtual representations into closed-loop systems that continuously synchronize with physical assets and drive real-time decisions. Yet predictive modeling, machine learning (ML), uncertainty quantification (UQ), and decision-making have been studied as separate capabilities, leaving limited understanding of their integration and maintenance during online operation. This narrative review, scoped by the functional requirements of real-time decision-making rather than by Digital Twin terminology alone, examines how such decisions are generated and sustained in engineering Digital Twins. We first examine foundational decision-making architectures and representative engineering applications, followed by methods that address their limitations across the decision loop. We identify optimization-based, policy-based, and knowledge-based approaches as the major pathways from virtual representation to action. Across them, ML plays three roles in decision-making: enabling efficient surrogate modeling, transforming heterogeneous physical feedback into decision-relevant information, and accelerating or directly generating decisions. UQ supports uncertainty-aware decisions and model adaptation, while continual validation, drift detection, and adaptation help maintain reliable operation as the physical system evolves. Together, these findings underscore the need for a shift from a model-centric to a system-centric perspective on Digital Twins, where its performance depends on the interactions with sensing, state estimation, computation, decision-making, and adaptation rather than on their standalone performance. Therefore, future research should shift from isolated algorithm development toward system-level co-design, scalable decision-making, and approaches to design, and data-efficient continual adaptation and validation for AI-enabled autonomous systems.

0.15

Bridging the Data Gap: Digital Twin as a New Paradigm for AI-based Radio Sensing

cs.LG eess.SP ·2026-08-11 ·Éloi Sainte-Beuve, Guillaume Larue, Louis-Adrien Dufrène, Quentin Lampin, Ali Al Khansa
published similarity 0.60
Abstract · Accepted at EUSIPCO 2026

We present a methodology that places a 3D digital twin (DT) of the environment as the main enabler behind the development of radio sensing at scale. The DT acts as a world model, providing geometry, materials, and transmitter/receiver placements to a ray-tracing engine that generates time-indexed channel impulse responses (CIRs) for large numbers of plausible scenes (moving people and objects, layout variants, seasonal/weather conditions, etc). From these synthetic sequences, we train a sequential neural network that maps CIR time series to spatial occupancy estimates, enabling device-free localization (DFL) without instrumented targets. We posit that sensing is best approached as an environment-conditioned learning problem: rather than seeking a single global model, we advocate training or fine-tuning local models specialized to a site-specific DT. As a first experiment, we introduce a novel State Space Model architecture, trained and evaluated across multiple room geometries. The localization performances obtained demonstrate the potential of the approach.

0.19

Balanced Twin Weight Factorization for Efficient MLLMs

cs.CV cs.CL ·2026-11-16 ·Bryan A. Plummer, Shan Lu, Keval Doshi, Noranart Vesdapunt, Wei Wang +2 more
similarity 0.60
Abstract

Weight Factorization (WF) methods aim to reduce a model's latency, memory, or both. These typically decompose a pretrained model into two or more factors that approximate the original model weights with fewer parameters and floating point operations (FLOPs). However, translating fewer FLOPs into reduced latency is challenging for WF methods in practice due to overhead introduced by replacing a single large weight matrix with multiple smaller ones. To address this, we propose Balanced Twin Weight Factorization (BTWF), which uses the unique structure of factorized models to simultaneously lower latency and increase learning capacity. Specifically, BTWF operates in the shared basis WF setting, where two or more layers are decomposed into a shared basis matrix and a layer-specific mixing matrix. If these shared layers have the same input (i.e., are twins), then we need only perform this shared forward pass once, reducing inference time. However, twin layers are often of varying sizes, and methods from prior work tend to favor the larger layer. In contrast, our approach boosts performance by combining Factor Component Balancing (FCB), which ensures every shared member is well represented in the selected factors, with Block Contribution Balancing (BCB), which considers downstream model effects. Further, we also show that an overparameterized BTWF, where some layer's factors result in higher FLOPs than the original during training, can boost task performance without additional resources at test time. Experiments on six models over nine benchmarks show BTWF obtains a 2-6% gain over the state-of-the-art without expensive finetuning (1-3.5% gain with it) at comparable computational costs.

0.25

Foundations without Fundamentals: Zero-Shot Blind Spots in Time Series FMs

cs.LG ·2026-10-01 ·Nafiseh Ghoroghchian, Haipeng Zhang, Shuyi Han, Alex Labach, George Stein
similarity 0.59
Abstract

Despite the success of Time Series Foundation Models (TSFMs) on broad benchmarks, their ability to internalize basic temporal logic, especially in settings supported by exogenous covariates, remains under-examined. We introduce SimpleTimeBench, a diagnostic univariate and multivariate "unit test" suite for primitives such as monotonic trends, periodic signals and leading indicator covariates, scenarios where near-perfect forecasts should be trivial. Surprisingly, prominent multivariate TSFMs (Chronos-2, Moirai and Toto) frequently produce suboptimal zero-shot forecasts for these inputs. While fine-tuning Chronos-2 improves its behaviour on specific tasks, we show that this adaptation degrades performance on other fundamental patterns rather than enhancing its generalizable foundational capabilities. This reveals a gap between pre-training scale and basic temporal reasoning, suggesting that current TSFMs could potentially lack the inductive biases needed to capture simple predictable functions. We further demonstrate that these failures are not merely synthetic curiosities: they persist in real-world sensor forecasting, where TSFMs consistently underutilize leading indicators available in observed covariates. This inability to capture simple relationships limits the practical utility and reliability of current multivariate models.

0.50

Intervention-Conditioned Counterfactual Human Digital Twin Generator

cs.LG q-bio.QM ·2026-10-09 ·Saeed Farzi, Sofia Michopoulou, Christopher Kipps, Rahman Attar
similarity 0.59
Abstract

Chronic diseases evolve through long, heterogeneous trajectories shaped by interacting mediators, confounders, and treatment histories. Estimating long-term patient trajectories under alternative interventions is essential for in silico clinical trial design. However, most existing models overlook irregular visit intervals and cross-mediator dependencies, both of which are crucial for reliable long-term longitudinal prediction. Moreover, these models typically focus on outcome prediction rather than generating complete patient-state trajectories. To address these challenges, we propose CHDT, an intervention-conditioned Human Digital Twin generator under standard identification assumptions for multimodal longitudinal trajectory estimation. Its main empirical advantage arises from explicit modeling of irregular visit intervals, while cross-mediator refinement provides additional gains in selected intervention-conditioned settings. Across real-world ADNI and simulator-generated ALPACA cohorts, CHDT shows improved long-horizon patient-state fidelity relative to competing baselines. Ablation results indicate that irregular-time conditioning provides the primary empirical gain, and cross-mediator refinement provides additional improvements.

0.11