TY - JOUR
T1 - Interinstance and Intratemporal Self-Supervised Learning With Few Labeled Data for Fault Diagnosis
AU - Hu, Chenye
AU - Wu, Jingyao
AU - Sun, Chuang
AU - Yan, Ruqiang
AU - Chen, Xuefeng
N1 - Publisher Copyright:
© 2005-2012 IEEE.
PY - 2023/5/1
Y1 - 2023/5/1
N2 - Recent researches on intelligent fault diagnosis algorithms can achieve great progress. However, considering the practical scenarios, the amount of labeled data is insufficient in face of the difficulty of data annotation, which would raise the risk of overfitting and hinder the model from its industrial applications. To address this problem, in this article, we propose an interinstance and intratemporal self-supervised learning framework, where self-supervised learning on massive unlabeled data is integrated with supervised learning on few labeled data to enrich the capacity of learnable data. Specifically, we design a time-amplitude signal augmentation technique and conduct interinstance transform-consistency learning to obtain domain-invariant features. Meanwhile, an intratemporal relation matching task is promoted to improve the temporal discriminability of the model. Moreover, to overcome the single task domination problem in this multitask framework, an uncertainty-based dynamic weighting mechanism is utilized to automatically distribute weight for each task according to its uncertainty, which ensures the stability of multitask optimization. Experiments on open-source and self-designed datasets demonstrate the superiority of the proposed framework over other supervised and semisupervised methods.
AB - Recent researches on intelligent fault diagnosis algorithms can achieve great progress. However, considering the practical scenarios, the amount of labeled data is insufficient in face of the difficulty of data annotation, which would raise the risk of overfitting and hinder the model from its industrial applications. To address this problem, in this article, we propose an interinstance and intratemporal self-supervised learning framework, where self-supervised learning on massive unlabeled data is integrated with supervised learning on few labeled data to enrich the capacity of learnable data. Specifically, we design a time-amplitude signal augmentation technique and conduct interinstance transform-consistency learning to obtain domain-invariant features. Meanwhile, an intratemporal relation matching task is promoted to improve the temporal discriminability of the model. Moreover, to overcome the single task domination problem in this multitask framework, an uncertainty-based dynamic weighting mechanism is utilized to automatically distribute weight for each task according to its uncertainty, which ensures the stability of multitask optimization. Experiments on open-source and self-designed datasets demonstrate the superiority of the proposed framework over other supervised and semisupervised methods.
KW - Fault diagnosis
KW - few labeled data
KW - multitask
KW - self-supervised learning
KW - semisupervised learning
UR - https://www.scopus.com/pages/publications/85132646765
U2 - 10.1109/TII.2022.3183601
DO - 10.1109/TII.2022.3183601
M3 - 文章
AN - SCOPUS:85132646765
SN - 1551-3203
VL - 19
SP - 6502
EP - 6512
JO - IEEE Transactions on Industrial Informatics
JF - IEEE Transactions on Industrial Informatics
IS - 5
ER -