CS Paper Radar

A Trans-Domain Digital Twin for Bio-Aware Control of Climate and Energy in Cattle Fattening Barns Using Single-Episode Optimizer Learning

Mansoorali Amiri

cs.SE ·submitted 2026-08-27 14:30 UTC · v1

Abstract

In closed cattle-fattening barns, the indoor climate and herd growth are mutually interdependent. Temperature, relative humidity, airflow, and ventilation affect thermal comfort, feed intake, metabolic heat production, daily growth, feed efficiency, and energy consumption, while body-weight gain alters the future heat and moisture loads of the barn and, consequently, its ventilation, heating, and energy requirements. This article proposes a trans-domain digital twin framework with single-episode learning capability, customized for bio-aware climate and energy control in a closed cattle-fattening barn. The framework integrates a mechanistic climate simulator, a livestock growth simulator, model predictive control, lightweight reinforcement learning, and structured knowledge memory within a multi-rate temporal-loop architecture. The fast temporal loop operates every five minutes to evaluate actuator decisions and maintain short-term thermal comfort, safety, and energy efficiency, whereas the slow temporal loop provides biological guidance based on daily climatic conditions, feed efficiency, heat production, and growth-limiting factors. The results show that climate, growth, energy, feed, biological guidance, and memory can be linked within a single executable control cycle. Remaining limitations include the need for field validation, improved management of feed pressure, and reduction of abrupt actuator-command variations.

Comment
26 pages, 13 figures

Closest papers

Nearest neighbours by meaning across the whole index.

Deep Reinforcement Learning for Heat Pump and Underfloor Heating Control: An End-to-End Case Study

cs.AI eess.SY ·2026-11-17 ·Antonio Manjavacas, David Suárez-Caro, Alejandro Campoy-Nieves, Guillermo Rey, Gonzalo Satrústegui +1 more
similarity 0.58
Abstract · Preprint submited to journal

Efficient control of underfloor heating (UFH) systems coupled with heat pumps (HPs) is challenging due to the high thermal inertia of buildings and the slow dynamic response of UFH systems. Deep Reinforcement Learning (DRL) offers a data-driven control approach capable of simultaneously optimizing energy consumption and thermal comfort. However, the application of DRL-based controllers in occupied buildings under real operating conditions remains limited. This work presents and end-to-end case study (development, evaluation, and real-world deployment) of a DRL-based controller for an integrated UFH-HP system. First, a simulation-based pilot study was conducted to assess different DRL algorithms, control strategies, and configurations. Subsequently, a digital twin of a real residential building was developed and used to train DRL agents under simulated operating conditions. The best-performing agent was then deployed in the physical building without additional online fine-tuning. The results show that the controller successfully maintained indoor temperatures within the prescribed comfort limits while dynamically adjusting the HP supply temperature and UFH valve positions. These findings demonstrate the feasibility of deploying DRL controllers in occupied buildings and highlight their robustness and the practical challenges associated with transferring control policies from digital environments to real heating systems.

0.32

From Thermal Preference Prediction to Adaptive Thermal Intervention: A Reinforcement Learning Approach Using Physiological and Environmental Sensing

cs.LG cs.AI ·2026-08-19 ·Isibor Kennedy Ihianle, Emmanuel Manu, Ehsan Asnaashari, Mojgan Jadidi, Pedro Machado +2 more
similarity 0.57
Abstract

Personalised thermal comfort is essential for occupant wellbeing and for the development of more responsive building-control strategies, yet conventional Heating, Ventilation, and Air Conditioning (HVAC) systems rely on static setpoints and population-level comfort models that fail to capture individual physiological variability. This paper presents a two-stage personalised thermal comfort approach integrating multimodal physiological and environmental sensing with reinforcement learning-based decision-making.

0.26

A Human-Centric Adaptive Multi-Fidelity Digital Twin Framework for Cyber-Physical Systems

cs.HC eess.SY ·2026-11-18 ·Clarisa Grijalva-Lugo, Yu-Zheng Lin, Shalaka Satam, Sicong Shao, Jesus Pacheco +2 more
similarity 0.57
Abstract · 20 pages, 3 figures, 11 tables; submitted to Advanced Engineering Informatics

Digital twins of cyber-physical systems must operate with scarce data, on assets that change after deployment, and for humans whose needs differ, yet existing implementations fix fidelity at design time and do not match the representation to the human or the task. This paper proposes a human-centric adaptive multi-fidelity digital twin framework that models the evolving human, the physical twin, and the digital twin core, and adds a human inference and adaptation function that estimates the human state, predicts the response, and adapts the representation. The framework defines low-, medium-, and high-fidelity tiers distinguished by adaptivity and by coupling, quantified as the ratio of the digital twin latency to the duration of the process step it follows. Three proof-of-concept instantiations are evaluated: a virtual reality tutor, a computer numerical control milling model, and an industrial training station. The low tier estimated learner sentiment with an accuracy of 0.86. The forecasters of the milling model and the training station, both medium-tier, showed a normalized error decline of 0.39 to 0.89 and a human adaptation gain of 1.16 to 1.51, but their latency exceeded the physical process step by 25 to 87 times. Only the station's vision model met the physical step. The tiers are separated by which functions adapt and where the latency constraint lies, not by a monotone increase in gain or coupling.

0.22

Integrating Machine Learning and Uncertainty Quantification for Real-Time Decision-Making in Digital Twins: A System-Centric Review and Perspective

cs.LG stat.AP ·2026-11-03 ·Yi-Ping Chen, Ying-Kuan Tsai, Seul Lee, Vispi Karkaria, Dex Doksoo Lee +1 more
similarity 0.54
Abstract

Digital Twins are evolving from passive virtual representations into closed-loop systems that continuously synchronize with physical assets and drive real-time decisions. Yet predictive modeling, machine learning (ML), uncertainty quantification (UQ), and decision-making have been studied as separate capabilities, leaving limited understanding of their integration and maintenance during online operation. This narrative review, scoped by the functional requirements of real-time decision-making rather than by Digital Twin terminology alone, examines how such decisions are generated and sustained in engineering Digital Twins. We first examine foundational decision-making architectures and representative engineering applications, followed by methods that address their limitations across the decision loop. We identify optimization-based, policy-based, and knowledge-based approaches as the major pathways from virtual representation to action. Across them, ML plays three roles in decision-making: enabling efficient surrogate modeling, transforming heterogeneous physical feedback into decision-relevant information, and accelerating or directly generating decisions. UQ supports uncertainty-aware decisions and model adaptation, while continual validation, drift detection, and adaptation help maintain reliable operation as the physical system evolves. Together, these findings underscore the need for a shift from a model-centric to a system-centric perspective on Digital Twins, where its performance depends on the interactions with sensing, state estimation, computation, decision-making, and adaptation rather than on their standalone performance. Therefore, future research should shift from isolated algorithm development toward system-level co-design, scalable decision-making, and approaches to design, and data-efficient continual adaptation and validation for AI-enabled autonomous systems.

0.15

Generalizing HVAC Control With Domain Randomized Reinforcement Learning

cs.LG ·2026-09-05 ·Pablo Boitel, Kun Zhang
published similarity 0.54
Abstract · 4 pages, 5 figures. Short paper published in ACM Sustainability Week Companion '26

Deploying advanced HVAC (Heating, Ventilation and Air Conditioning) controllers at scale remains difficult because performance often depends on accurate building models or per-site retuning. We propose NOMAD-RL (Neural Online Meta-Adaptation for Dynamics), a general-purpose Reinforcement Learning (RL) controller designed to transfer across heterogeneous thermal zones through a universal, non-invasive thermostat interface. The controller acts on temperature setpoints from zone measurements and forecasts, while a recurrent policy supports online adaptation under partial observability. Our main contribution is an adaptive domain randomization scheme based on physics-informed normalizing flows, which models correlated and multimodal distributions of thermal-zone parameters while maintaining physical plausibility and controllability. This produces a realistic and progressively adaptive training curriculum that improves transfer across buildings. We evaluate NOMAD-RL against a constant-setpoint PID controller, RL without domain randomization, and MPC in single- and multi-zone settings. NOMAD-RL consistently outperforms the PID and non-randomized RL baselines, and approaches the performance of a well-tuned MPC, especially in the more challenging multi-zone case. These results highlight the potential of adaptive, physics-informed domain randomization for robust and transferable HVAC control.

0.29

Metabolic heat and moisture reuse with climate-adaptive control for energy-efficient black soldier fly bioconversion in modular container farms

eess.SY ·2026-11-01 ·Sriram Saravanan, Philipp Sauerteig, Moritz Gold, Stefan Streif
unusual similarity 0.53
Abstract · Submitted to Journal of Insects as Food and Feed. Submitted PDF consists of 6 figures

Black soldier fly larvae (BSFL, Hermetia illucens) convert organic residues into feed ingredients and fertiliser. Climate control is a major contributor to the energy demand of container-based bioconversion. We developed a control-oriented dynamic model linking larval growth, substrate dynamics and container climate to heating, ventilation and air conditioning (HVAC). A two-level Model Predictive Control (MPC) strategy planned climate trajectories and tracked them through HVAC actuation. Four simulation studies examined controller selection, HVAC configuration, larval age pairing and inter-container coupling, using subsets of eight climate scenarios. Across the four scenarios tested for controller selection, dynamic MPC reduced specific energy consumption (SEC) by 31 to 61% and increased predicted dry biomass at harvest by up to 27.5% relative to single fixed setpoints. Under the tested controller settings, active cooling was required in the two hot scenarios, whereas dehumidification provided no additional operational benefit. Pairing larval ages four days apart within one container reduced SEC by up to 33% in the tested non-hot scenarios. In the Cooldry scenario, two age-separated containers connected by an actuated air duct produced 9.0% more biomass and achieved 3.9% lower SEC than two independent containers with mixed ages, despite using 4.6% more total HVAC energy. The simulations suggest that dynamic climate control and metabolic heat and moisture reuse can improve the energy intensity of BSFL bioconversion. The quantitative estimates and hardware recommendations require experimental validation before application to industrial facilities.

0.31

A sensor-driven physics-informed neural network for real-time occupant-centric space heating control

cs.LG eess.SY ·2026-11-01 ·Yunfei Bai, Chenghao Li, Sunku Prasad Jenne, Hao Wang, Sizhe Zhang +1 more
similarity 0.53
Abstract

Conventional space heating systems typically rely on single or sparse fixed-point temperature measurements, overlooking non-uniform indoor temperature distributions, transient thermal dynamics, and occupant-specific comfort requirements. This study explores an occupant-centric control strategy that aims to maintain the desired temperature around the occupant location. Spatially and temporally varying temperature fields, together with occupant mobility, make real-time local temperature estimation challenging. To address this challenge, we propose a control-oriented Physics-Informed Neural Network (PINN) model for indoor temperature-field prediction. Conventional PINNs rely on explicit time inputs and assume consistent temporal patterns across samples, which limits adaptability under variable initial conditions and heating sequences. The proposed model infers temporal dynamics implicitly from spatial coordinates and limited sensor measurements, improving robustness to changes in initial conditions and external disturbances. The method was validated across nine horizontal sensing planes in three controlled room-scale configurations. Against a validated COMSOL Multiphysics simulation, the PINN predicted the evaluated temperature fields with a maximum relative error below 1.85% across validation cases. These predictions supported an occupant-centric space heating control scheme. Compared with COMSOL-based offline control, the PINN-based system achieved an average prediction error of around 0.67%, and its rapid inference supports real-time occupant-centric control implementation. This work represents a move away from reliance on fixed-point temperature measurements in space heating control to an occupant-centric control strategy informed by real-time environmental feedback.

0.24

Ruleless Digital Twins: Toward Declarative Decision-Making Through Standardized Frameworks and Technologies

cs.SE ·2026-10-07 ·Ivan Spajić, Volker Stolz
similarity 0.52
Abstract · 47 pages (bibliography included), expanded version of the Spajić and Stolz (2026) DataMod paper

Digital twins (DTs) can be thought of as digital counterparts of physical objects, or more generally, twinning targets (TTs). To enact changes on and optimize for properties of their TTs, DTs use an element of decision-making. Traditionally, many domains, such as home automation, utilize rule-based decision-making models to imperatively define DT actions based on desired TT conditions. With evolving user specifications, rule-based models have become increasingly complex to develop and maintain, particularly in scenarios involving optimizations under dynamically changing systems, such as those affected by weather or dynamic energy pricing. We present an alternative in the form of ruleless digital twins (RDTs) that automatically produce optimal decisions with respect to purely declarative user specifications, similarly to the well-established ruleless approach of model predictive control. They do so through a combination of a semantic knowledge base, logical inference, simulation models, and an autonomic computing architecture, each exclusively based on a widely-used standard or technology. We evaluate our proof of concept through an incubator case study and experiments against a rule-based bang-bang controller in the context of a virtual office room environment. Results show core that RDT functionality performs better than the control in terms of maintaining desired room temperatures and minimizing energy costs under dynamically changing spot pricing. Additionally, due to combinatorial decision tree construction, RDTs require considerable computational power for longer prediction horizons, although their applicability to specific problem domains (and use of shorter horizons) ultimately falls on their users.

0.31