TY - GEN
T1 - Few-Shot Transfer Learning with Attention Mechanism for High-Voltage Circuit Breaker fault diagnosis
AU - Wang, Yanxin
AU - Yan, Jing
AU - Ye, Xinyu
AU - Jing, Qianzhen
AU - Wang, Jianhau
AU - Geng, Yingsan
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Data-driven artificial intelligence methods, especially convolutional neural networks (CNNs), have achieved excellent performance in high-voltage circuit breaker (HVCB) fault diagnosis. However, CNN relies heavily on massive data. When the amount of data decreases, the fault diagnosis performance drops severely. To settle these problems, a few-shot transfer learning (FSTL) with attention mechanism to realize the mechanical fault diagnosis of HVCBs is proposed. First, a one-dimensional CNN (1DCNN) with attention mechanism (AM) is used to extract the fault features of HVCBs. The introduction of the AM makes CNN pay more attention to the interesting part of the fault signal to extract effective key features. Then, domain adaptive transfer learning (DATL) is used to realize the deployment and application of 1DCNN constructed under a large amount of low-voltage level data to small samples of ultra-high voltage (UHV), so as to realize reliable diagnosis of UHV circuit breakers in small samples. The proposed DATL can consider the marginal and conditional distributions of the two data simultaneously to achieve better feature matching. Experimental results show that the FSTL proposed can achieve highly accurate and robust fault diagnosis of HVCBs with few-shot on site. Compared with the traditional methods, the FSTL is obvious and provides a reliable reference for the diagnosis of HVCBs.
AB - Data-driven artificial intelligence methods, especially convolutional neural networks (CNNs), have achieved excellent performance in high-voltage circuit breaker (HVCB) fault diagnosis. However, CNN relies heavily on massive data. When the amount of data decreases, the fault diagnosis performance drops severely. To settle these problems, a few-shot transfer learning (FSTL) with attention mechanism to realize the mechanical fault diagnosis of HVCBs is proposed. First, a one-dimensional CNN (1DCNN) with attention mechanism (AM) is used to extract the fault features of HVCBs. The introduction of the AM makes CNN pay more attention to the interesting part of the fault signal to extract effective key features. Then, domain adaptive transfer learning (DATL) is used to realize the deployment and application of 1DCNN constructed under a large amount of low-voltage level data to small samples of ultra-high voltage (UHV), so as to realize reliable diagnosis of UHV circuit breakers in small samples. The proposed DATL can consider the marginal and conditional distributions of the two data simultaneously to achieve better feature matching. Experimental results show that the FSTL proposed can achieve highly accurate and robust fault diagnosis of HVCBs with few-shot on site. Compared with the traditional methods, the FSTL is obvious and provides a reliable reference for the diagnosis of HVCBs.
KW - domain adaptive transfer learning
KW - fault diagnosis
KW - few-shot
KW - high-voltage circuit breakers
KW - one-dimensional convolutional neural network
UR - https://www.scopus.com/pages/publications/85125092319
U2 - 10.1109/CIYCEE53554.2021.9676790
DO - 10.1109/CIYCEE53554.2021.9676790
M3 - 会议稿件
AN - SCOPUS:85125092319
T3 - 2021 IEEE 2nd China International Youth Conference on Electrical Engineering, CIYCEE 2021
BT - 2021 IEEE 2nd China International Youth Conference on Electrical Engineering, CIYCEE 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2nd IEEE China International Youth Conference on Electrical Engineering, CIYCEE 2021
Y2 - 15 December 2021 through 17 December 2021
ER -