The building sector is one of the largest contributors to global energy consumption. Improving its energy efficiency is essential for reducing operational costs and greenhouse gas emissions. Energy management systems (EMS) play a key role in monitoring and controlling building appliances efficiently and reliably. With the increasing integration of renewable energy, intelligent EMS solutions have received growing attention. Reinforcement learning (RL) has recently been explored for this purpose and shows strong potential. However, most RL-based EMS methods require a large number of training steps to learn effective control policies, especially when adapting to unseen buildings, which limits their practical deployment. This paper introduces MetaEMS, a meta-reinforcement learning framework for EMS. MetaEMS improves learning efficiency by transferring knowledge from previously solved tasks to new ones through group-level and building-level adaptation, enabling fast adaptation and effective control across diverse building environments. Experimental results demonstrate that MetaEMS adapts more rapidly to unseen buildings and consistently outperforms baseline methods across various scenarios.
翻译:建筑领域是全球能源消耗的主要贡献者之一。提升其能源效率对于降低运营成本和减少温室气体排放至关重要。能源管理系统在高效可靠地监控与调控建筑设备方面发挥着关键作用。随着可再生能源的日益普及,智能能源管理解决方案受到越来越多的关注。近年来,强化学习技术在此领域得到探索并展现出巨大潜力。然而,大多数基于强化学习的能源管理方法需要大量训练步骤以学习有效的控制策略,特别是在适应未知建筑环境时,这限制了其实际部署。本文提出了MetaEMS,一种面向能源管理系统的元强化学习框架。MetaEMS通过群体层面与建筑层面的自适应,将已解决任务中的知识迁移至新任务,从而提升学习效率,实现在多样化建筑环境中的快速适应与有效控制。实验结果表明,MetaEMS能够更快地适应未知建筑,并在多种场景下持续优于基准方法。