TY - GEN
T1 - Microgrid Energy Management Based on Sample-Efficient Reinforcement Learning
AU - Zhang, Wenjing
AU - Chen, Zhuo
AU - Zuo, Yuanjun
AU - Long, Yanbo
AU - Qiao, Hong
AU - Xu, Xianyong
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Microgrid is a small power system composed of distributed energy resources, and its energy management strategy (EMS) is of great significance for improving energy utilization efficiency and reducing energy waste. However, due to the complexity and uncertainty of microgrid, the traditional reinforcement learning algorithm has the problem of low sample efficiency when applied to this system. In order to solve this problem, a sample-efficient reinforcement learning algorithm is proposed in this paper. The algorithm trains and optimizes the model by establishing state-action-reward model and interacting with the simulation environment. In addition, the algorithm avoids the overfitting problem by resetting network parameters periodically. Through continuous iterative training, the system can gradually learn the optimal control strategy. The experimental results show that out proposed EMS can achieve efficient energy utilization and stable power supply. Compared with the traditional reinforcement learning algorithm, the proposed algorithm has significantly improved sample efficiency and performance. Therefore, this algorithm has important application value and popularization potential in microgrid energy management.
AB - Microgrid is a small power system composed of distributed energy resources, and its energy management strategy (EMS) is of great significance for improving energy utilization efficiency and reducing energy waste. However, due to the complexity and uncertainty of microgrid, the traditional reinforcement learning algorithm has the problem of low sample efficiency when applied to this system. In order to solve this problem, a sample-efficient reinforcement learning algorithm is proposed in this paper. The algorithm trains and optimizes the model by establishing state-action-reward model and interacting with the simulation environment. In addition, the algorithm avoids the overfitting problem by resetting network parameters periodically. Through continuous iterative training, the system can gradually learn the optimal control strategy. The experimental results show that out proposed EMS can achieve efficient energy utilization and stable power supply. Compared with the traditional reinforcement learning algorithm, the proposed algorithm has significantly improved sample efficiency and performance. Therefore, this algorithm has important application value and popularization potential in microgrid energy management.
KW - energy management
KW - microgrid
KW - reinforcement learning
KW - sample efficiency
UR - https://www.scopus.com/pages/publications/85184996472
U2 - 10.1109/ICPES59999.2023.10400136
DO - 10.1109/ICPES59999.2023.10400136
M3 - 会议稿件
AN - SCOPUS:85184996472
T3 - 2023 13th International Conference on Power and Energy Systems, ICPES 2023
SP - 379
EP - 384
BT - 2023 13th International Conference on Power and Energy Systems, ICPES 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 13th International Conference on Power and Energy Systems, ICPES 2023
Y2 - 8 December 2023 through 10 December 2023
ER -