CS Paper Radar

Online Optimization for Controlling HVAC Systems

Tong Wu, Dominik Baumann, Angela Fontan, Nicola Bastianello

eess.SY math.OC ·submitted 2026-11-05 10:15 UTC · v1

Abstract

Heating, ventilation, and air-conditioning (HVAC) systems account for a significant portion of buildings' energy consumption, motivating the design of energy- and cost-efficient control strategies. However, conventional strategies employ simple, reactive control, without incorporating a model. Therefore, in this paper we adopt an economic model predictive control framework and focus on designing online algorithms to solve the control input design problems with a limited computational budget. In particular, we propose two tailored online algorithms based on projected gradient descent, with a custom projection routine, and the projected primal-dual method. We discuss the pros and cons of both algorithm designs, focusing in particular on computational efficiency. We further compare them through numerical experiments simulating the control of an HVAC system over the course of a day. The results show that computationally efficient online solvers for HVAC systems control are indeed possible. Moreover, the performance closely matches that of a baseline algorithm with unlimited computational budget, in terms of reference temperature tracking and comfort temperature range enforcement.

Closest papers

Nearest neighbours by meaning across the whole index.

Model-Free Control for Residential Heating: Deployment and Simulation of Nonlinear Data-Enabled Predictive Control

eess.SY math.OC ·2026-09-18 ·Sebastian Zieglmeier, Chris Verhoek, Jaap Eising, Mathias Hudoba de Badyn
similarity 0.66
Abstract · 19 pages, 8 figures, 7 tables

Residential heating accounts for a large share of building energy use, and predictive control strategies can reduce it by anticipating rather than reacting to the room temperature alone. The usual manner of implementing predictive control, model predictive control (MPC), requires an accurate model of each individual residential unit for heating control. Obtaining this model is time-consuming to obtain manually or even impossible, and such models do not transfer across a heterogeneous building stock. Data-enabled predictive control (DeePC) removes this modeling step by designing the controller directly using measured trajectories of the system. The foundations of DeePC, however, are built on the class of deterministic linear time-invariant systems, which is an unrealistic assumption for residential heating. This work applies three recently proposed nonlinear extensions of DeePC, collectively referred to as data-driven predictive control (DPC): Select-DPC, gain-scheduling DPC, and linear parameter-varying DPC. These are compared against standard DeePC and the hysteresis controller, the industry standard in residential heating. The comparison runs over a full heating season on a calibrated digital twin of an occupied research unit, the NEST research building in Switzerland, assessed by heating energy and comfort-band violation. Moreover, gain-scheduling DPC was deployed on the real residential apartment and validated the conclusions from the simulations. Each of the DPC controllers consumes significantly less energy than the hysteresis controller, amounting to roughly $11\%$ over the season, validating the use of DPC. The nonlinear methods further outperform linear DeePC in all assessed scenarios, and we analyze the relative costs and benefits of each nonlinear method.

0.40

User-specified Kelvin-hour budgets within model predictive control for energy-efficient buildings: Simulation and field demonstration

eess.SY ·2026-09-06 ·Jicheng Shi, Colin N. Jones
similarity 0.65
Abstract

For energy-efficient building control, model predictive control (MPC) has been widely proposed to reduce energy use while maintaining prescribed indoor temperature bounds. In practice, MPC implementations may still produce temperature-bound violations because of model mismatch, weather-forecast errors, and softened constraints introduced to preserve feasibility. Existing soft- constrained MPC usually handles this trade-off through slack-weight tuning, so users cannot prescribe a violation-severity budget before operation. This paper develops a Kelvin-hour (Kh)-budget MPC that allows users to specify a running-average budget for temperature-bound violation severity. During operation, the controller uses the realized Kh budget surplus or overspend to update the temperature bounds, providing step-by-step budget feedback. We evaluate the method in two high-fidelity BOPTEST simulation cases and in an occupied residential deployment. In the first one-zone case, prescribed budgets produce clear running-average Kh violation responses across predictors and disturbance settings. At a prescribed budget of 0.005 Kh/step, the controller reduces energy use by 31.9% and Kh violation by 36.2% relative to the built-in default controller. In the second coupled two-zone case, separate zone budgets produce zone-level responses, with 18.9%-20.5% energy reduction and 9.4%-64.3% zone-level Kh violation reduction. In the occupied residential deployment, the running-average Kh violations remain close to or below their prescribed budgets under real sensing, actuation, weather, and occupancy conditions.

0.46

The Smart Buildings Challenge: Learning Foundation Models for Real-World Optimization at Scale

cs.AI ·2026-10-13 ·Judah Goldfeder, Ayush Rai, Philippe M. Wyder, Na Li, Victoria Dean +9 more
similarity 0.62
Abstract · This is for a Neurips 2026 competition

Buildings cause nearly 40\% of carbon emissions in the US. Of total building emissions, HVAC systems are responsible for approximately 40-60\% and account for 15\% of global energy consumption. Despite advances in artificial intelligence, most buildings still operate as inefficiently as they did decades ago. Building optimization, perhaps more so than any other optimization problem, has enormous potential for Machine Learning (ML) driven impact on climate change, in both the short and long term. One of the biggest obstacles for building optimization is the lack of policy transfer. Most building control systems, whether simulation or learning based, don't generalize: they only work well for the building they were developed for, but not for other buildings. To solve this problem, we propose a challenge for the development of building foundation models that easily adapt to new buildings with minimal configuration and thereby enable building optimization to scale across the globe. Participants will build control policies on a set of simulated buildings, and have their policies evaluated on an unseen set of buildings. The buildings vary in size, layout, weather, material properties, and HVAC system. Successful outcomes from this initiative promise a massive leap forward in global sustainability efforts and demonstrate the great potential of ML to combat climate change.

0.33

Model Predictive Control of Heating Systems via Koopman-Operator Bilinearization

eess.SY ·2026-11-02 ·Paula Chanfreut, Erfan Shakhesi, Mircea Lazar, Maurice Heemels
similarity 0.62
Abstract

Hydronic heat emitters are widely used in buildings, but their control is challenging due to nonlinear dynamics, arising from both the heat transfer in each emitter and the hydraulic coupling among those that share a circulating pump. These nonlinearities are often simplified or neglected in the literature. In this paper, we use Koopman theory to make the resulting model more tractable for control. In particular, we propose an input reparameterization and construct an infinite-dimensional set of observables that yields an exact bilinear representation of the system in the chosen lifted space. We then show that truncating the infinite-dimensional representation leads to bounded approximation errors that decrease as the truncation order increases, as well as bounded trajectory deviations over a finite horizon. The resulting bilinear model is incorporated into a model predictive control (MPC) framework to provide thermal comfort in multi-zone buildings while reducing energy use. Using a numerical case study of a five-story building with 20 zones, we show that the proposed Koopman-based MPC achieves a realized performance cost close to that of nonlinear MPC with faster solve times, and outperforms MPC formulations based on time-invariant and time-varying linearizations.

0.27

ADAPT: Physics-Aware Diffusion-based World Models for Adaptive Predictive Transferable HVAC Control

cs.AI ·2026-08-20 ·Xu Yang, Kailai Sun, Dianyu Zhong, Qianchuan Zhao
similarity 0.60
Abstract

Buildings account for roughly one-third of global energy consumption and CO$_2$ emissions. Optimizing indoor climate systems plays a critical role for urban climate mitigation aligned with UN Sustainable Development Goals 11 and 13. However, indoor delayed thermodynamic responses and partial observability severely hinder existing methods, which are primarily limited by implicit thermal inertia, occupancy dynamic prediction, and cumulative prediction errors, especially for out-of-distribution environments. In practice, these challenges are further exacerbated by the high cost and privacy burden of dense indoor sensing, forcing operators to collect only limited data in a single operating regime while expecting controllers to generalize reliably across unseen seasons and climate regions. To address this problem, we propose ADAPT, a physics-aware conditional diffusion indoor environmental world model for HVAC control. The model predicts a short-horizon held-action thermal baseline to capture the latent thermal inertia of the buildings. The diffusion backbone utilizes the robustness of generative models, while a learnable multi-zone heat-balance regularizer constrains generated trajectories to satisfy transferable building thermodynamics without requiring known building geometry or manually calibrated thermal parameters. A credit assignment is then design for the downstream reinforcement learning. Extensive experiments on SemibuildingSim and Sinergym demonstrate that ADAPT reduces HVAC energy consumption by 7.3\% and occupant discomfort by 30.2\% compared with state-of-the-art baselines under IID control. Under OOD control scenarios spanning unseen seasons and climate regions, ADAPT maintains robust performance with only marginal degradation relative to its IID performance, substantially outperforming existing methods in transfer robustness.

0.23

Safe Deep Reinforcement Learning for Energy-Efficient HVAC Control in Multi-Zone Residential Buildings

eess.SY ·2026-08-18 ·Oussama Ziadi, Abdelilah Rochd, Samir Idrissi Kaitouni, Mohamed Oualid Mghazli, Adnane Saoud
published similarity 0.59
Abstract · 6 pages, 5 figures. Accepted to IEEE Conference on Control Technology and Applications (CCTA) 2026

HVAC systems represent a major share of building energy consumption. Traditional control strategies are limited in coordinating energy-comfort tradeoffs across multiple zones simultaneously. Reinforcement learning (RL) offers adaptive, data-driven control that optimizes performance over time. However, deploying learned neural network controllers in safety-critical building systems remains challenging due to lack of formal safety guarantees. We propose a safety-certified deep RL framework for multi-zone residential HVAC control. Proximal Policy Optimization (PPO) and Soft Actor-Critic (SAC) agents are trained in an EnergyPlus/Sinergym simulation to minimize energy consumption while maintaining thermal comfort. Post-training safety certification is performed on the PPO policy using Lipschitz-based forward invariance analysis, building on existing tools for the computation of Lipschitz constants for neural networks, to guarantee constraint satisfaction. Both agents are evaluated over an annual simulation cycle in an eight-zone variable refrigerant flow (VRF) testbed. The PPO agent achieves 67\% comfort violation reduction compared to rule-based control, while the SAC agent achieves 27.6\% energy savings. The PPO policy satisfies formal safety certification with a margin of $2.003^\circ$C. These results demonstrate the feasibility of combining reinforcement learning with post-training safety verification for multi-zone building control.

0.20

Model Predictive Control for Dynamic Hydraulic Balancing in Building Radiator Heating Systems: Modeling, Design, and Experimental Validation

eess.SY math.OC ·2026-09-08 ·Erfan Shakhesi, Maurice Heemels, Paula Chanfreut
similarity 0.59
Abstract

Hydronic radiator systems are among the most widely used heating systems in buildings. In the literature, radiator heat outputs are often assumed to be independent of one another and arbitrarily adjustable in time when designing controllers. However, in practice, radiators are supplied by one or multiple common heat sources and are hydraulically coupled through the water circulation system. Maintaining occupant comfort in multi-zone buildings therefore requires not only an appropriate supply temperature but also proper hydraulic balancing to distribute the available water flow according to the heating demand of each zone. To this end, we develop a grey-box thermal model that captures the hydraulic interactions among radiators and the effects of radiator valves, circulation pumps, and heat sources. In a real building, we show that accounting for hydraulic interactions reduces the root mean square error (RMSE) between the measured and modeled zone temperatures by approximately 11% compared with a model that neglects these interactions. Additionally, we integrate the developed model into a model predictive control (MPC) framework for dynamic hydraulic balancing that jointly optimizes valve openings and the supply temperature to maintain thermal comfort in each zone while reducing energy consumption. Through both real-world experiments and numerical case studies, we demonstrate that, compared with existing MPC formulations that neglect hydraulic interactions or do not control radiator valves, the proposed MPC reduces comfort-range violations by at least 27% while requiring a similar or even lower cumulative supply temperature.

0.39

From PID to Reinforcement Learning in Building HVAC Control: A Control-Architecture Review of Tuning Strategies, Formulations, and Deployment Trade-offs

cs.LG ·2026-11-02 ·Erfan Haghighat Damavandi, Davide Papurello, Mahdi Alibeigi, Armin Keshavarz
similarity 0.57
Abstract · 52 pages, 6 Figs

This paper reviews control architectures for building heating, ventilation and air-conditioning (HVAC) systems, addressing the tension among energy demand, occupant comfort and equipment operability, and situating proportional-integral-derivative (PID) regulation within a layered control stack that also includes rule-based and model-based supervisory control and data-driven reinforcement learning (RL). It examines the thermostat-PID layer from two-position and scheduled setpoint control through proportional, PI and PID regulation and their tuning, then formulates RL for building control as a Markov decision process. Its central contribution is a taxonomy of where RL meets PID: RL as a gain tuner for an existing loop, as a direct replacement for the regulatory controller, as a hybrid with model predictive control, and as supervisory setpoint and schedule generation. Across these classes, the review establishes that the physical loop remains invariant while the intervention point changes, and that the classes differ in their requirements for actuation authority, state information, modelling, commissioning and constraint handling. It further establishes that PID is inexpensive and well codified but limited by nonlinearity, time variation, discrete mode switching, loop interaction and slow plant dynamics, while RL's admissible position must be argued rather than assumed. The paper concludes that these architectures are not competing philosophies of control but nested points of attachment on one HVAC plant, with hybrid implementations possible, and that deployment trade-offs must be assessed according to the specific control interface and scaffolding required.

0.25