Skip to main navigation Skip to search Skip to main content

Generative Contrastive Learning for Multi-Label Image Classification

  • South China Agricultural University
  • Ltd

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The multi-label image classification task aims to predict the labels of multiple objects in an image. Existing research has shown that modeling the frequent co-occurrence relationships between objects can improve model classification performance. However, most current models overemphasize these co-occurrence relationships while neglecting the intrinsic information within the image, resulting in a reduced ability to distinguish between different objects. In this paper, we propose a multi-label image classification method based on contrastive learning to maintain the model's sensitivity to different objects. Traditional contrastive learning methods for multi-label tasks often perform poorly due to the lack of sufficient contrastive samples. To address this, we introduce a generative contrastive learning method, which generates a large number of reliable contrastive samples to enhance the effectiveness of contrastive learning. Our experiments on the MSCOCO2014 dataset show that the proposed method achieves state-of-the-art classification performance.

Original languageEnglish
Title of host publicationProceedings - 2024 International Symposium on Digital Home, ISDH 2024
EditorsXiaonan Luo, Zhongxuan Luo, Jieqing Tan
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages73-78
Number of pages6
ISBN (Electronic)9798331509873
DOIs
StatePublished - 2024
Externally publishedYes
Event2024 International Symposium on Digital Home, ISDH 2024 - Guilin, China
Duration: 1 Nov 20243 Nov 2024

Publication series

NameProceedings - 2024 International Symposium on Digital Home, ISDH 2024

Conference

Conference2024 International Symposium on Digital Home, ISDH 2024
Country/TerritoryChina
CityGuilin
Period1/11/243/11/24

Keywords

  • contrastive learning
  • gaussian mixture model
  • graph neural network
  • multi-label image classification

Fingerprint

Dive into the research topics of 'Generative Contrastive Learning for Multi-Label Image Classification'. Together they form a unique fingerprint.

Cite this