An improved 3-D attention CNN with hybrid loss and feature fusion for pulmonary nodule classification.
- Department of Computer Science and Information Engineering, National Changhua University of Education, Changhua, Taiwan, ROC.
- Department of Medical Imaging, Taipei City Hospital Yangming Branch, Taipei, Taiwan, ROC.
- Graduate Institute of Network and Multimedia, National Taiwan University, Taipei, Taiwan, ROC.
- Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei, Taiwan, ROC.
- Department of Medical Imaging, National Taiwan University Hospital Hsin-Chu Branch, Hsin-Chu, Taiwan, ROC.
- Department of Medical Imaging, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei 10617, Taiwan, ROC. Electronic address: ycc5566@ntu.edu.tw.
- Graduate Institute of Network and Multimedia, National Taiwan University, Taipei, Taiwan, ROC; Graduate Institute of Biomedical Electronics and Bioinformatics, National Taiwan University, Taipei, Taiwan, ROC; Department of Computer Science and Information Engineering, National Taiwan University, Taipei 10617, Taiwan, ROC; MOST Joint Research Center for AI Technology and All Vista Healthcare, Taipei, Taiwan, ROC. Electronic address: rfchang@csie.ntu.edu.tw.
BACKGROUND AND OBJECTIVE: Lung cancer has the highest cancer-related mortality worldwide, and lung nodule usually presents with no symptom. Low-dose computed tomography (LDCT) was an important tool for lung cancer detection and diagnosis. It provided a complete three-dimensional (3-D) chest image with a high resolution.Recently, convolutional neural network (CNN) had flourished and been proven the CNN-based computer-aided diagnosis (CADx) system could extract the features and help radiologists to make a preliminary diagnosis. Therefore, a 3-D ResNeXt-based CADx system was proposed to assist radiologists for diagnosis in this study.
METHODS: The proposed CADx system consists of image preprocessing and a 3-D CNN-based classification model for pulmonary nodule classification. First, the image preprocessing was executed to generate the normalized volumn of interest (VOI) only including nodule information and a few surrounding tissues. Then, the extracted VOI was forwarded to the 3-D nodule classification model. In the classification model, the RestNext was employed as the backbone and the attention scheme was embedded to focus on the important features. Moreover, a multi-level feature fusion network incorporating feature information of different scales was used to enhance the prediction accuracy of small malignant nodules. Finally, a hybrid loss based on channel optimization which make the network learn more detailed information was empolyed to replace a binary cross-entropy (BCE) loss.
RESULTS: In this research, there were a total of 880 low-dose CT images including 440 benign and 440 malignant nodules from the American National Lung Screening Trial (NLST) for system evaluation. The results showed that our system could achieve the accuracy of 85.3%, the sensitivity of 86.8%, the specificity of 83.9%, and the area-under-curve (AUC) value was 0.9042. It was confirmed that the designed system had a good diagnostic ability.
CONCLUSION: In this study, a CADx composed of the image preprocessing and a 3-D nodule classification model with attention scheme, feature fusion, and hybrid loss was proposed for pulmonary nodule classification in LDCT. The results indicated that the proposed CADx system had potential for achieving high performance in classifying lung nodules as benign and malignant.
- NLST-411: Detection of pulmonary nodules and reduction of the false positive rate (Hsin-Ming Chen - 2018)