Skip to Main Content

An official website of the United States government

About this Publication
ConvNet-Based Localization of Anatomical Structures in 3-D Medical Images.
Pubmed ID
28252392 (View this publication on the PubMed website)
Digital Object Identifier
IEEE Trans Med Imaging. 2017 Jul; Volume 36 (Issue 7): Pages 1470-1481
de Vos BD, Wolterink JM, de Jong PA, Leiner T, Viergever MA, Isgum I

Localization of anatomical structures is a prerequisite for many tasks in a medical image analysis. We propose a method for automatic localization of one or more anatomical structures in 3-D medical images through detection of their presence in 2-D image slices using a convolutional neural network (ConvNet). A single ConvNet is trained to detect the presence of the anatomical structure of interest in axial, coronal, and sagittal slices extracted from a 3-D image. To allow the ConvNet to analyze slices of different sizes, spatial pyramid pooling is applied. After detection, 3-D bounding boxes are created by combining the output of the ConvNet in all slices. In the experiments, 200 chest CT, 100 cardiac CT angiography (CTA), and 100 abdomen CT scans were used. The heart, ascending aorta, aortic arch, and descending aorta were localized in chest CT scans, the left cardiac ventricle in cardiac CTA scans, and the liver in abdomen CT scans. Localization was evaluated using the distances between automatically and manually defined reference bounding box centroids and walls. The best results were achieved in the localization of structures with clearly defined boundaries (e.g., aortic arch) and the worst when the structure boundary was not clearly visible (e.g., liver). The method was more robust and accurate in localization multiple structures.

Related CDAS Studies
Related CDAS Projects