Abstract
The ideal midsagittal plane (MSP) approximately bisects the human brain into two cerebral hemispheres, and its projection on the cranial surface serves as an important guideline for surgical navigation, which lays a foundation for its significant role in assisting neurosurgeons in planning surgical incisions during preoperative planning. However, the existing plane detection algorithms are generally based on iteration procedure, which have the disadvantages of low efficiency, poor accuracy, and unable to extract the non-local plane features. In this study, we propose an end-to-end deep Hough plane network (DHPN) for ideal MSP detection, which has four highlights. First, we introduce differentiable deep Hough transform (DHT) and inverse deep Hough transform (IDHT) to achieve the mutual transformation between semantic features and Hough features, which converts and simplifies the plane detection problem in the image space into a keypoint detection problem in the Hough space. Second, we design a sparse DHT strategy to increase the sparsity of features, improving inference speed and greatly reducing calculation cost in the voting process. Third, we propose a Hough pyramid attention network (HPAN) to further extract non-local features by aggregating Hough attention modules (HAM). Fourth, we introduce dual space supervision (DSS) mechanism to integrate training loss from both image and Hough spaces. Through extensive validations on a large in-house dataset, our method outperforms state-of-the-art methods on the ideal MSP detection task.
C. Qin and W. Zhou–Contributed equally to this work
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Neubauer, S., Gunz, P., Scott, N.A., Hublin, J.-J., Mitteroecker, P.: Evolution of brain lateralization: a shared hominid pattern of endocranial asymmetry is much more variable in humans than in great apes. Sci. Adv. 6(7), eaax9935 (2020)
Oertel-Knochel, V., Linden, D.E.J.: Cerebral asymmetry in schizophrenia. Neuroscci. 17(5), 456–467 (2011)
Chen, H., et al.: Standard plane localization in fetal ultrasound via domain transferred deep neural networks. IEEE J. Biomed. Health Inform. 19(5), 1627–1636 (2015)
Zhen, Yu., et al.: A deep convolutional neural network-based framework for automatic fetal facial standard plane recognition. IEEE J. Biomed. Health Inform. 22(3), 874–885 (2017)
Dou, H., et al.: Agent with warm start and active termination for plane localization in 3D ultrasound. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11768, pp. 290–298. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32254-0_33
Schmidt-Richberg, A., et al.: Offset regression networks for view plane estimation in 3D fetal ultrasound. In: Medical Imaging 2019: Image Processing, vol. 10949, pp. 907–912. SPIE (2019)
Wu, H., Wang, D., Shi, L., Wen, Z., Ming, Z.: Midsagittal plane extraction from brain images based on 3D sift. Phys. Med. Biol. 59(6), 1367–1387 (2014)
Zhao, K., Han, Q., Zhang, C.-B., Xu, J., Cheng, M.-M.: Deep hough transform for semantic line detection. IEEE Trans. Patt. Anal. Mach. Intell. (2021)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2117–2125 (2017)
Li, H., Xiong, P., An, J., Wang, L.: Pyramid attention network for semantic segmentation. arXiv preprint arXiv:1805.10180 (2018)
Liu, S., Qi, L., Qin, H., Shi, J., Jia, J.: Path aggregation network for instance segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 8759–8768 (2018)
Yang, X., et al.: Agent with warm start and adaptive dynamic termination for plane localization in 3D ultrasound. IEEE Trans. Med. Imaging 40(7), 1950–1961 (2021)
Xu, J., et al.: Fetal pose estimation in volumetric MRI using a 3D convolution neural network. In: Shen, D., et al. (eds.) MICCAI 2019. LNCS, vol. 11767, pp. 403–410. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32251-9_44
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
1 Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Qin, C. et al. (2022). Ideal Midsagittal Plane Detection Using Deep Hough Plane Network for Brain Surgical Planning. In: Wang, L., Dou, Q., Fletcher, P.T., Speidel, S., Li, S. (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13437. Springer, Cham. https://doi.org/10.1007/978-3-031-16449-1_56
Download citation
DOI: https://doi.org/10.1007/978-3-031-16449-1_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-16448-4
Online ISBN: 978-3-031-16449-1
eBook Packages: Computer ScienceComputer Science (R0)
