What is it about?

Controlling large building HVAC systems is challenging because the environment is constantly changing (non-stationary), which confuses conventional AI. Traditional fixed-rule systems react too slowly, leading to energy waste. Our research solves this by integrating TimeGPT, a powerful, pre-trained AI foundation model, to generate highly accurate zero-shot forecasts of critical factors like weather and occupancy instantly. By feeding these future forecasts directly into our Deep Reinforcement Learning (DRL) controller, the AI learns to anticipate changes, not just react. This predictive integration accelerates DRL convergence and stabilizes control, resulting in significant energy savings and reduced temperature fluctuations.

Featured Image

Why is it important?

Modern buildings are responsible for a significant portion of global energy consumption. Improving HVAC efficiency is therefore a huge opportunity for decarbonization and cost reduction. Current AI-based HVAC control methods struggle with real-world complexity, often requiring extensive, time-consuming training for every new building or environment. Our work is important because it introduces a highly scalable and computationally efficient solution to this non-stationarity problem. By using TimeGPT's "zero-shot" forecasting ability, we eliminate the need for time-consuming, task-specific training for the forecasting module. This radically simplifies the deployment of advanced DRL controllers in new or diverse buildings. The proposed pipeline makes AI control more robust and practical for commercial use, enabling building managers to implement cutting-edge, energy-saving DRL policies with greater stability and faster setup, leading to more comfortable environments and substantial energy savings globally.

Perspectives

Writing this paper was an incredibly exciting process, which I view as an exploratory experiment successfully bridging cutting-edge Foundation Models like TimeGPT with a critical industrial control challenge in HVAC systems. I firmly believe that these powerful pre-trained models will change traditional industrial control paradigms, leading the entire field into a new era of intelligence and efficiency. I hope this research effectively highlights the immense potential of integrating zero-shot time-series forecasting into other non-stationary control problems—whether it’s managing power grids, optimizing traffic flow, or controlling complex industrial processes. My greatest wish is that this work powerfully accelerates the global transition to smarter, more energy-efficient building operations.

Jiatong Li
Xidian University

Read the Original

This page is a summary of: Tackling Non-Stationarity in HVAC Control with TimeGPT-Enhanced Deep Reinforcement Learning, November 2025, ACM (Association for Computing Machinery),
DOI: 10.1145/3736425.3772354.
You can read the full text:

Read

Contributors

The following have contributed to this page