TY - JOUR
T1 - Lightweight Industrial Image Classifier Based on Federated Few-Shot Learning
AU - Sun, Xinyue
AU - Yang, Shusen
AU - Zhao, Cong
N1 - Publisher Copyright:
© 2005-2012 IEEE.
PY - 2023/6/1
Y1 - 2023/6/1
N2 - Image classification using convolutional neural networks (CNNs) is critical for broader industrial applications like defect detection. To protect sensitive data during the industrial process, increasing institutions are highly interested in training CNN classifiers collaboratively with federated learning (FL). However, the existing FL solutions cannot address the sample deficiency and heterogeneous learning resource issues at different practical institutions. In this article, we present a federated lightweight relation network (FLRN), a lightweight industrial image classifier based on our federated few-shot learning (FFSL) architecture. Results of extensive experiments considering different real-world FFSL scenarios indicate that, unlike the state-of-the-art few-shot learning method relation network (RN), the FLRN performs well on not only FL participants with mutually isolated classes of samples but also external institutions with limited samples from unseen classes. Compared to the RN with the predominating FedAvg-based FL deployment, the FLRN manages to achieve as low as 29.6× less client-cloud communication, 5.2× less computation, and 22.0× less storage costs of clients.
AB - Image classification using convolutional neural networks (CNNs) is critical for broader industrial applications like defect detection. To protect sensitive data during the industrial process, increasing institutions are highly interested in training CNN classifiers collaboratively with federated learning (FL). However, the existing FL solutions cannot address the sample deficiency and heterogeneous learning resource issues at different practical institutions. In this article, we present a federated lightweight relation network (FLRN), a lightweight industrial image classifier based on our federated few-shot learning (FFSL) architecture. Results of extensive experiments considering different real-world FFSL scenarios indicate that, unlike the state-of-the-art few-shot learning method relation network (RN), the FLRN performs well on not only FL participants with mutually isolated classes of samples but also external institutions with limited samples from unseen classes. Compared to the RN with the predominating FedAvg-based FL deployment, the FLRN manages to achieve as low as 29.6× less client-cloud communication, 5.2× less computation, and 22.0× less storage costs of clients.
KW - Federated learning (FL)
KW - few-shot learning (FSL)
KW - industrial image classification
KW - lightweight learning
UR - https://www.scopus.com/pages/publications/85139497827
U2 - 10.1109/TII.2022.3210600
DO - 10.1109/TII.2022.3210600
M3 - 文章
AN - SCOPUS:85139497827
SN - 1551-3203
VL - 19
SP - 7367
EP - 7376
JO - IEEE Transactions on Industrial Informatics
JF - IEEE Transactions on Industrial Informatics
IS - 6
ER -