TY - JOUR
T1 - Knowledge Distillation Based on Adaptive Learning and Channel Amplification Features for PolSAR Image Classification
AU - Shang, Ronghua
AU - Hu, Mingwei
AU - Li, Wenzheng
AU - Liu, Lei
AU - Zhang, Weitong
AU - Feng, Jie
AU - Xu, Songhua
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - The models currently used for polarimetric synthetic aperture radar (PolSAR) image classification tasks have problems, such as complex network structures, poor distinction of detailed features, and fixed loss weights during the training process. In response to these problems, this article proposes a PolSAR image classification method based on knowledge distillation using adaptive learning and channel amplification features. First, this article builds a knowledge distillation framework for PolSAR. Using a teacher network trained in advance that can acquire global knowledge to guide the student. This framework reduces the computational complexity and improves the classification accuracy of the student. Then, an adaptive loss weight learning mechanism is designed, which sets the weight of the Kullback–Leibler (KL) divergence loss during training into a learnable mode. The weight can be automatically adjusted according to the actual training situation of the student. Finally, a scheme for channel amplification to enhance features is proposed. This scheme obtains channel weights based on the student’s feature map information. These weights are amplified, strengthening the network’s ability to obtain feature information. Compared with the five PolSAR image classification algorithms, the method proposed in this article uses lower computational complexity to obtain higher classification accuracy on the Flevoland, San Francisco, and Xi’an datasets.
AB - The models currently used for polarimetric synthetic aperture radar (PolSAR) image classification tasks have problems, such as complex network structures, poor distinction of detailed features, and fixed loss weights during the training process. In response to these problems, this article proposes a PolSAR image classification method based on knowledge distillation using adaptive learning and channel amplification features. First, this article builds a knowledge distillation framework for PolSAR. Using a teacher network trained in advance that can acquire global knowledge to guide the student. This framework reduces the computational complexity and improves the classification accuracy of the student. Then, an adaptive loss weight learning mechanism is designed, which sets the weight of the Kullback–Leibler (KL) divergence loss during training into a learnable mode. The weight can be automatically adjusted according to the actual training situation of the student. Finally, a scheme for channel amplification to enhance features is proposed. This scheme obtains channel weights based on the student’s feature map information. These weights are amplified, strengthening the network’s ability to obtain feature information. Compared with the five PolSAR image classification algorithms, the method proposed in this article uses lower computational complexity to obtain higher classification accuracy on the Flevoland, San Francisco, and Xi’an datasets.
KW - Channel amplification
KW - deep learning
KW - knowledge distillation
KW - loss weight adaptation
KW - polarimetric synthetic aperture radar (PolSAR) image classification
UR - https://www.scopus.com/pages/publications/105006640762
U2 - 10.1109/TGRS.2025.3573077
DO - 10.1109/TGRS.2025.3573077
M3 - 文章
AN - SCOPUS:105006640762
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5212716
ER -