A Multiscale Connected UNet for the Segmentation of Lung Cancer Cells in Pathology Sections Stained Using Rapid On-Site Cytopathological Evaluation

Lung cancer is an increasingly serious health problem worldwide, and early detection and diagnosis are crucial for successful treatment. With the development of artificial intelligence and the growth of data volume, machine learning techniques can play a significant role in improving the accuracy of early detection in lung cancer. This study proposes a deep learning-based segmentation algorithm for rapid on-site cytopathological evaluation (ROSE) to enhance the diagnostic efficiency of endobronchial ultrasound-guided transbronchial needle aspiration biopsy (EBUS-TBNA) during surgery. By utilizing the CUNet3+ network model, cell clusters, including cancer cell clusters, can be accurately segmented in ROSE-stained pathological sections. The model demonstrated high accuracy, with an F1-score of 0.9604, recall of 0.9609, precision of 0.9654, and accuracy of 0.9834 on the internal testing data set. It also achieved an area under the receiver-operating characteristic curve of 0.9972 for cancer identification. The proposed algorithm saved time for on-site diagnosis, improved EBUS-TBNA efficiency, and outperformed classical segmentation algorithms in accurately identifying lung cancer cell clusters in ROSE-stained images. It effectively reduced over-segmentation, decreased network parameters, and enhanced computational efficiency, making it suitable for real-time patient evaluation during surgical procedures.