TY - JOUR
T1 - Bearing Remaining Useful Life Prediction Using Federated Learning With Taylor-Expansion Network Pruning
AU - Chen, Xi
AU - Wang, Hui
AU - Lu, Siliang
AU - Yan, Ruqiang
N1 - Publisher Copyright:
© 1963-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - Accurate prediction of bearing remaining useful life (RUL) is essential for machine health management. In existing data-driven prognostic methods, centralized data resources and deep neural networks (DNNs) are two requisites. However, conventional data aggregation may result in the privacy disclosure of equipment. Meanwhile, most DNN-based RUL predictors are overparameterized, making them hard to be deployed on edge devices. To deal with these shortcomings, a new bearing RUL prediction method based on the federated learning (FL) and Taylor-expansion network pruning, namely, RUL-FLTNP, is proposed in this article. In this method, a central server and multiple clients work together to train an RUL predictor. First, a multiscale convolutional neural network with a longish full connection in the first layer (LFMCNN) is designed as the RUL predictor. Specifically, LFMCNN contains three units, multiscale feature augmentation module (MFAM), deep feature extraction module (DFEM), and prediction module (PM), where the MFAM is used to extend shallow features from the data stored in each client. Next, the text Taylor-expansion pruning criterion is applied to the DFEM to delete unimportant network nodes, after which each client utilizes its local data to recover the pruned model. The server aggregates all rebirth models to a new global model using the federated averaging (FedAvg) algorithm. Network pruning and rebirth occur alternately in the model training process to produce a compact structure. Experimental results indicate that the proposed method provides a promising solution to prognostic problems in data privacy-preserving scenarios.
AB - Accurate prediction of bearing remaining useful life (RUL) is essential for machine health management. In existing data-driven prognostic methods, centralized data resources and deep neural networks (DNNs) are two requisites. However, conventional data aggregation may result in the privacy disclosure of equipment. Meanwhile, most DNN-based RUL predictors are overparameterized, making them hard to be deployed on edge devices. To deal with these shortcomings, a new bearing RUL prediction method based on the federated learning (FL) and Taylor-expansion network pruning, namely, RUL-FLTNP, is proposed in this article. In this method, a central server and multiple clients work together to train an RUL predictor. First, a multiscale convolutional neural network with a longish full connection in the first layer (LFMCNN) is designed as the RUL predictor. Specifically, LFMCNN contains three units, multiscale feature augmentation module (MFAM), deep feature extraction module (DFEM), and prediction module (PM), where the MFAM is used to extend shallow features from the data stored in each client. Next, the text Taylor-expansion pruning criterion is applied to the DFEM to delete unimportant network nodes, after which each client utilizes its local data to recover the pruned model. The server aggregates all rebirth models to a new global model using the federated averaging (FedAvg) algorithm. Network pruning and rebirth occur alternately in the model training process to produce a compact structure. Experimental results indicate that the proposed method provides a promising solution to prognostic problems in data privacy-preserving scenarios.
KW - Bearings
KW - convolutional neural networks (CNNs)
KW - federated learning (FL)
KW - network pruning
KW - remaining life assessment
UR - https://www.scopus.com/pages/publications/85153348668
U2 - 10.1109/TIM.2023.3264027
DO - 10.1109/TIM.2023.3264027
M3 - 文章
AN - SCOPUS:85153348668
SN - 0018-9456
VL - 72
JO - IEEE Transactions on Instrumentation and Measurement
JF - IEEE Transactions on Instrumentation and Measurement
M1 - 3512610
ER -