TY - JOUR
T1 - Semi-Active Convolutional Neural Networks for Hyperspectral Image Classification
AU - Yao, Jing
AU - Cao, Xiangyong
AU - Hong, Danfeng
AU - Wu, Xin
AU - Meng, Deyu
AU - Chanussot, Jocelyn
AU - Xu, Zongben
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2022
Y1 - 2022
N2 - Owing to the powerful data representation ability of deep learning (DL) techniques, tremendous progress has been recently made in hyperspectral image (HSI) classification. Convolutional neural network (CNN), as a main part of the DL family, has been proven to be considerably effective to extract spatial-spectral features for HSIs. Nevertheless, its classification performance, to a great extent, depends on the quality and quantity of samples in the network training process. To select those samples, either labeled or unlabeled, which can be used to enhance the generalization ability of CNNs and further improve the classification accuracy, we propose an iterative semi-supervised CNNs framework by means of active learning and superpixel segmentation techniques, dubbed as semi-active CNNs (SA-CNNs), for HSI classification. More specifically, we start to pretrain a CNN-based model on a small-scale unbiased labeled set and infer unlabeled data using the trained model, i.e., generating pseudolabels. Then, the reliable samples, which consist of two parts: high label homogeneity and most informativeness, are actively selected from superpixel segments. These selected labeled and unlabeled samples with their labels and pseudolabels are refed into the next-round network training. Moreover, three different schedules, i.e., log-, exp-, and linear-schedules, are progressively adopted to fully explore their potentials in sample selection, until a labeling budget is finally reached. Extensive experiments are conducted on three benchmark HSI datasets, demonstrating substantial performance improvements of the proposed SA-CNNs over other similar competitors.
AB - Owing to the powerful data representation ability of deep learning (DL) techniques, tremendous progress has been recently made in hyperspectral image (HSI) classification. Convolutional neural network (CNN), as a main part of the DL family, has been proven to be considerably effective to extract spatial-spectral features for HSIs. Nevertheless, its classification performance, to a great extent, depends on the quality and quantity of samples in the network training process. To select those samples, either labeled or unlabeled, which can be used to enhance the generalization ability of CNNs and further improve the classification accuracy, we propose an iterative semi-supervised CNNs framework by means of active learning and superpixel segmentation techniques, dubbed as semi-active CNNs (SA-CNNs), for HSI classification. More specifically, we start to pretrain a CNN-based model on a small-scale unbiased labeled set and infer unlabeled data using the trained model, i.e., generating pseudolabels. Then, the reliable samples, which consist of two parts: high label homogeneity and most informativeness, are actively selected from superpixel segments. These selected labeled and unlabeled samples with their labels and pseudolabels are refed into the next-round network training. Moreover, three different schedules, i.e., log-, exp-, and linear-schedules, are progressively adopted to fully explore their potentials in sample selection, until a labeling budget is finally reached. Extensive experiments are conducted on three benchmark HSI datasets, demonstrating substantial performance improvements of the proposed SA-CNNs over other similar competitors.
KW - Active learning
KW - classification
KW - convolutional neural network (CNN)
KW - deep learning (DL)
KW - hyperspectral
KW - pseudolabel
KW - remote sensing
KW - semi-supervised learning
KW - superpixel segmentation
UR - https://www.scopus.com/pages/publications/85139402885
U2 - 10.1109/TGRS.2022.3206208
DO - 10.1109/TGRS.2022.3206208
M3 - 文章
AN - SCOPUS:85139402885
SN - 0196-2892
VL - 60
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5537915
ER -