TY - GEN
T1 - Generative Contrastive Learning for Multi-Label Image Classification
AU - Fu, Sheng Wu
AU - Gu, Zheng Shen
AU - Wang, Dong
AU - Xu, Songhua
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - The multi-label image classification task aims to predict the labels of multiple objects in an image. Existing research has shown that modeling the frequent co-occurrence relationships between objects can improve model classification performance. However, most current models overemphasize these co-occurrence relationships while neglecting the intrinsic information within the image, resulting in a reduced ability to distinguish between different objects. In this paper, we propose a multi-label image classification method based on contrastive learning to maintain the model's sensitivity to different objects. Traditional contrastive learning methods for multi-label tasks often perform poorly due to the lack of sufficient contrastive samples. To address this, we introduce a generative contrastive learning method, which generates a large number of reliable contrastive samples to enhance the effectiveness of contrastive learning. Our experiments on the MSCOCO2014 dataset show that the proposed method achieves state-of-the-art classification performance.
AB - The multi-label image classification task aims to predict the labels of multiple objects in an image. Existing research has shown that modeling the frequent co-occurrence relationships between objects can improve model classification performance. However, most current models overemphasize these co-occurrence relationships while neglecting the intrinsic information within the image, resulting in a reduced ability to distinguish between different objects. In this paper, we propose a multi-label image classification method based on contrastive learning to maintain the model's sensitivity to different objects. Traditional contrastive learning methods for multi-label tasks often perform poorly due to the lack of sufficient contrastive samples. To address this, we introduce a generative contrastive learning method, which generates a large number of reliable contrastive samples to enhance the effectiveness of contrastive learning. Our experiments on the MSCOCO2014 dataset show that the proposed method achieves state-of-the-art classification performance.
KW - contrastive learning
KW - gaussian mixture model
KW - graph neural network
KW - multi-label image classification
UR - https://www.scopus.com/pages/publications/105000676429
U2 - 10.1109/ISDH64927.2024.00019
DO - 10.1109/ISDH64927.2024.00019
M3 - 会议稿件
AN - SCOPUS:105000676429
T3 - Proceedings - 2024 International Symposium on Digital Home, ISDH 2024
SP - 73
EP - 78
BT - Proceedings - 2024 International Symposium on Digital Home, ISDH 2024
A2 - Luo, Xiaonan
A2 - Luo, Zhongxuan
A2 - Tan, Jieqing
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2024 International Symposium on Digital Home, ISDH 2024
Y2 - 1 November 2024 through 3 November 2024
ER -