Zhiyu An
ABSTRACT
Model-based Reinforcement Learning (MBRL) has been widely studied for energy-efficient control of the Heating, Ventilation, and Air Conditioning (HVAC) systems. One of the fundamental issues of the current approaches is the large amount of data required to train an accurate building system dynamics model. In this work, we developed a data-efficient system capable of excellent HVAC control performance with only days of training data. We use a Gaussian Process (GP) as the dynamics model which provides uncertainty for each prediction. To improve the data efficiency, we designed a meta kernel learning technique for GP kernel selection. To incorporate uncertainty in the control decisions, we designed a model predictive control method that considers the uncertainty of every prediction. Simulation experiments show that our method achieves excellent data efficiency, yielding similar energy savings and 12.07% less human comfort violation compared with the state-of-the-art MBRL method, while only trained on a seven-day training dataset.
- Zhiyu An, Xianzhong Ding, Arya Rathee, and Wan Du. 2023. Clue: safe modelbased rl hvac control using epistemic uncertainty estimation. In ACM BuildSys.Google Scholar
- Xianzhong Ding, Wan Du, and Alberto Cerpa. 2019. Octopus: deep reinforcement learning for holistic smart building control. In ACM BuildSys, 326--335.Google Scholar
- Xianzhong Ding, Wan Du, and Alberto E Cerpa. 2020. Mb2c: model-based deep reinforcement learning for multi-zone building control. In ACM BuildSys, 50--59.Google Scholar
- DoE. 2010. Energyplus input output reference. US Department of Energy.Google Scholar
- Miaomiao Liu, Sikai Yang, Wyssanie Chomsin, and Wan Du. 2022. Real-time tracking of smartwatch orientation and location by multitask learning. In SenSys, 120--133.Google Scholar
- ASHRAE STANDARD. 2020. Ansi/ashrae addendum a to ansi/ashrae standard 169-2020. ASHRAE Standing Standard Project Committee.Google Scholar
Recommendations
CLUE: Safe Model-Based RL HVAC Control Using Epistemic Uncertainty Estimation
BuildSys '23: Proceedings of the 10th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and TransportationModel-Based Reinforcement Learning (MBRL) has been widely studied for Heating, Ventilation, and Air Conditioning (HVAC) control in buildings. One of the fundamental problems is the large amount of data required to train a neural network for building ...
Building HVAC Scheduling Using Reinforcement Learning via Neural Network Based Model Approximation
BuildSys '19: Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and TransportationBuildings sector is one of the major consumers of energy in the United States. The buildings HVAC (Heating, Ventilation, and Air Conditioning) systems, whose functionality is to maintain thermal comfort and indoor air quality (IAQ), account for almost ...
Autonomous HVAC control, a reinforcement learning approach
ECMLPKDD'15: Proceedings of the 2015th European Conference on Machine Learning and Knowledge Discovery in Databases - Volume Part IIIRecent high profile developments of autonomous learning thermostats by companies such as Nest Labs and Honeywell have brought to the fore the possibility of ever greater numbers of intelligent devices permeating our homes and working environments into ...
Comments