Abstract
Bone age assessment is a common clinical procedure to diagnose endocrine and metabolic disorders in children. Recently, a variety of convolutional neural network based approaches have been developed to automatically estimate bone age from hand radiographs and achieved accuracy comparable to human experts. However, most of these networks were trained end-to-end, i.e., deriving the bone age directly from the whole input hand image without knowing which regions of the image are most relevant to the task. In this work, we proposed a multi-task convolutional neural network to simultaneously estimate bone age and localize ossification centers of different phalangeal, metacarpal and carpal bones. We showed that, similar to providing attention maps, the localization of ossification centers helps the network to extract features from more meaningful regions where local appearances are closely related to the skeletal maturity. In particular, to address the problem that some ossification centers do not always appear on the hand radiographs of certain bone ages, we introduced an image-level landmark presence classification loss, in addition to the conventional pixel-level landmark localization loss, in our multi-task network framework. Experiments on public RSNA data demonstrated the effectiveness of our proposed method in the reduction of gross errors of ossification center detection, as well as the improvement of bone age assessment accuracy with the aid of ossification center detection especially when the training data size is relatively small.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aja-Fernández, S., de Luis-Garcıa, R., Martın-Fernandez, M.A., Alberola-López, C.: A computational TW3 classifier for skeletal maturity assessment a computing with words approach. J. Biomed. Inform. 37(2), 99–107 (2004)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Iglovikov, V.I., Rakhlin, A., Kalinin, A.A., Shvets, A.A.: Paediatric bone age assessment using deep convolutional neural networks. In: Stoyanov, D., et al. (eds.) DLMIA/ML-CDS -2018. LNCS, vol. 11045, pp. 300–308. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00889-5_34
Mahmoodi, S., Sharif, B.S., Chester, E.G., Owen, J.P., Lee, R.: Skeletal growth estimation using radiographic image processing and analysis. IEEE Trans. Inf. Technol. Biomed. 4(4), 292–297 (2000)
Ren, X., et al.: Regression convolutional neural network for automated pediatric bone age assessment from hand radiograph. IEEE J. Biomed. Health Inform. 23(5), 2030–2038 (2018)
Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
RSNA Pediatric Bone Age Challenge (2017). http://rsnachallenges.cloudapp.net/competitions/4
Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)
Spampinato, C., Palazzo, S., Giordano, D., Aldinucci, M., Leonardi, R.: Deep learning for automated skeletal bone age assessment in x-ray images. Med. Image Anal. 36, 41–51 (2017)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826 (2016)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Zhang, M., Wu, D., Liu, Q., Li, Q., Zhan, Y., Zhou, X.S. (2019). Multi-Task Convolutional Neural Network for Joint Bone Age Assessment and Ossification Center Detection from Hand Radiograph. In: Suk, HI., Liu, M., Yan, P., Lian, C. (eds) Machine Learning in Medical Imaging. MLMI 2019. Lecture Notes in Computer Science(), vol 11861. Springer, Cham. https://doi.org/10.1007/978-3-030-32692-0_78
Download citation
DOI: https://doi.org/10.1007/978-3-030-32692-0_78
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32691-3
Online ISBN: 978-3-030-32692-0
eBook Packages: Computer ScienceComputer Science (R0)