TY - JOUR
T1 - Adaptive cost-sensitive learning
T2 - Improving the convergence of intelligent diagnosis models under imbalanced data
AU - Ren, Zhijun
AU - Zhu, Yongsheng
AU - Kang, Wei
AU - Fu, Hong
AU - Niu, Qingbo
AU - Gao, Dawei
AU - Yan, Ke
AU - Hong, Jun
N1 - Publisher Copyright:
© 2022 Elsevier B.V.
PY - 2022/4/6
Y1 - 2022/4/6
N2 - The natural distribution of industrial data is imbalanced, which deteriorates the performance of intelligent fault diagnostic models. Although cost-sensitive learning is an effective method for solving the data imbalance problem, it suffers from the difficulty of setting optimal costs. Therefore, this paper proposes a strategy that considers the number distribution of samples, the convergence trend of classes, and the convergence trend of samples to calculate sample costs adaptively. Using costs to weigh the sample losses and applying them to different models and different loss functions, the diagnostic results under different sample sets show that the weighted losses can significantly improve the model's performance when using imbalanced data. By further analysing the training loss of the modified model, the angles between deep features, and the angles between deep features and classification weight vectors, it can be found that the dominance of majority classes in imbalanced data is suppressed in training, which is attributed to the loss of each class being coordinated by the proposed strategy. The comparison with various imbalanced learning methods demonstrates the advantages of the proposed method under conditions of large imbalance ratios and complex tasks.
AB - The natural distribution of industrial data is imbalanced, which deteriorates the performance of intelligent fault diagnostic models. Although cost-sensitive learning is an effective method for solving the data imbalance problem, it suffers from the difficulty of setting optimal costs. Therefore, this paper proposes a strategy that considers the number distribution of samples, the convergence trend of classes, and the convergence trend of samples to calculate sample costs adaptively. Using costs to weigh the sample losses and applying them to different models and different loss functions, the diagnostic results under different sample sets show that the weighted losses can significantly improve the model's performance when using imbalanced data. By further analysing the training loss of the modified model, the angles between deep features, and the angles between deep features and classification weight vectors, it can be found that the dominance of majority classes in imbalanced data is suppressed in training, which is attributed to the loss of each class being coordinated by the proposed strategy. The comparison with various imbalanced learning methods demonstrates the advantages of the proposed method under conditions of large imbalance ratios and complex tasks.
KW - Adaptive cost
KW - Cost-sensitive learning
KW - Imbalanced data
KW - Imbalanced learning
KW - Intelligent fault diagnosis
UR - https://www.scopus.com/pages/publications/85124456817
U2 - 10.1016/j.knosys.2022.108296
DO - 10.1016/j.knosys.2022.108296
M3 - 文章
AN - SCOPUS:85124456817
SN - 0950-7051
VL - 241
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 108296
ER -