TY - JOUR
T1 - Bayesian contrastive Learning
T2 - An augmentation-free fault diagnosis method with limited labels and uncertainty quantification
AU - Ahmad, Hassaan
AU - Cheng, Wei
AU - Wang, Wentao
AU - Liu, Haoyu
AU - Wei, Zhibin
AU - Zhang, Shuo
AU - Nie, Zelin
AU - Yang, Jiangkun
AU - Chen, Xuefeng
N1 - Publisher Copyright:
© 2025 Elsevier Ltd.
PY - 2026/3
Y1 - 2026/3
N2 - Fault diagnosis under limited labeled data remains a significant challenge for deep learning-based methods, especially when uncertainty is not estimated, compromising model trustworthiness. While contrastive learning (CL) has been used for self-supervised learning in label-scarce scenarios, most methods rely on augmentations, which may limit robustness in industrial applications. This paper proposes an augmentation-free CL framework for fault diagnosis. A Bayesian Multiscale Convolutional Neural Network (BMCNN) encoder, a linear projector, and a Bayesian classifier are jointly pre-trained using contrastive, cross-entropy losses, and Kullback-Leibler divergence, with the encoder updated via a momentum encoder. Subsequently, pseudo-labeling-based semi-supervised learning is employed for effective fine-tuning, which uses uncertainty weighting to achieve the pseudo-labeling-based classification objective. The Bayesian nature of encoder and classifier results in well-calibrated uncertainty, thereby improving performance of semi-supervised learning using pseudo-labels. Furthermore, Monte Carlo sampling is employed for final uncertainty estimation. Experimental results demonstrate that the proposed method achieves superior diagnostic accuracy under extreme label scarcity, outperforming state-of-the-art contrastive learning, Bayesian variants, and pseudo-labeling approaches. Moreover, the predicted uncertainty exhibits a strong correlation with prediction accuracy, significantly improving model reliability and decision-making confidence in intelligent fault diagnosis systems.
AB - Fault diagnosis under limited labeled data remains a significant challenge for deep learning-based methods, especially when uncertainty is not estimated, compromising model trustworthiness. While contrastive learning (CL) has been used for self-supervised learning in label-scarce scenarios, most methods rely on augmentations, which may limit robustness in industrial applications. This paper proposes an augmentation-free CL framework for fault diagnosis. A Bayesian Multiscale Convolutional Neural Network (BMCNN) encoder, a linear projector, and a Bayesian classifier are jointly pre-trained using contrastive, cross-entropy losses, and Kullback-Leibler divergence, with the encoder updated via a momentum encoder. Subsequently, pseudo-labeling-based semi-supervised learning is employed for effective fine-tuning, which uses uncertainty weighting to achieve the pseudo-labeling-based classification objective. The Bayesian nature of encoder and classifier results in well-calibrated uncertainty, thereby improving performance of semi-supervised learning using pseudo-labels. Furthermore, Monte Carlo sampling is employed for final uncertainty estimation. Experimental results demonstrate that the proposed method achieves superior diagnostic accuracy under extreme label scarcity, outperforming state-of-the-art contrastive learning, Bayesian variants, and pseudo-labeling approaches. Moreover, the predicted uncertainty exhibits a strong correlation with prediction accuracy, significantly improving model reliability and decision-making confidence in intelligent fault diagnosis systems.
KW - Bayesian neural network
KW - Contrastive learning
KW - Fault diagnosis
KW - Limited labeled data
KW - Pseudo-labeling
KW - Uncertainty estimation
UR - https://www.scopus.com/pages/publications/105024325924
U2 - 10.1016/j.aei.2025.104207
DO - 10.1016/j.aei.2025.104207
M3 - 文章
AN - SCOPUS:105024325924
SN - 1474-0346
VL - 70
JO - Advanced Engineering Informatics
JF - Advanced Engineering Informatics
M1 - 104207
ER -