Skip to main content

Advertisement

SpringerLink
Log in

Convolution neural network based automatic localization of landmarks on lateral x-ray images

  • 1218: Engineering Tools and Applications in Medical Imaging
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Cephalometric analysis is very essential for the patient having dentofacial and craniofacial deformities. The manual localization of the cephalometric landmarks is also important and critical for the observer that is required to be performed by the orthodontics only. The manual localization is the time consuming and the tedious task for the observer. Therefore, we proposes a method to automatically detect cephalometric landmarks on lateral cephalometric x-ray image. The proposed method is a deep learning approach where centroid based registration was performed on the same size images then ResNet50 was applied on the different patches which were made based on the geometrical position of the landmarks. Total ten patches were made for the 19 landmarks. The average landmark detection rate during the testing was achieved as 90.39% and 92.37% under 2-mm and 3-mm error respectively for testset1 database. The average landmark detection rate during the testing was achieved as 82.66% and 84.53% under 2-mm and 3-mm error respectively for testset2 database. The average mean error and standard deviation on testset1 was found as 1.23 mm and 0.73 respectively and average mean error and standard deviation on testset2 was found as 1.37 mm, and 0.88 respectively. The proposed method was compared with the state-of-the-art methods and found the improved results in terms of successful landmark detection rate under 2-mm. The results were found very promising and the proposed method may be helpful to use in clinics further.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Arık S, Ibragimov B, Xing L (2017) Fully automated quantitative cephalometry using convolutional neural networks. J Med Imaging (Bellingham) 4:014501

    Article  Google Scholar 

  2. Ashok M, Gupta A (2021) A systematic review of the techniques for the automatic segmentation of organs-at-risk in thoracic computed tomography images. Arch Comput Methods Eng 28:3245–3267

    Article  Google Scholar 

  3. Ashok M, Gupta A (2021) Deep learning-based techniques for the automatic segmentation of organs in thoracic computed tomography images: A Comparative study. In 2021 International conference on artificial intelligence and smart systems (ICAIS), 2021, pp 198–202

  4. Baumrind S, Frantz RC (1971) The reliability of head film measurements. 1. Landmark identification. Am J Orthod 60:111–127

    Article  Google Scholar 

  5. Baumrind S, Miller DM (1980) Computer-aided head film analysis: the University of California San Francisco method. Am J Orthod 78:41–65

    Article  Google Scholar 

  6. Berco M, Rigali PH Jr, Miner RM, DeLuca S, Anderson NK, Will LA (2009) Accuracy and reliability of linear cephalometric measurements from cone-beam computed tomography scans of a dry human skull. Am J Orthod Dentofacial Orthop 136:17–18

    Article  Google Scholar 

  7. Broadbent BH (1931) A new x-ray technique and its application to orthodontia. Angle Orthodontist. 1:45–66

    Google Scholar 

  8. Dula K, Bornstein MM, Buser D, Dagassan-Berndt D, Ettlin DA, Filippi A et al (2014) SADMFR guidelines for the use of cone-beam computed tomography/ digital volume tomography. Swiss Dent J 124:1169–1183

    Google Scholar 

  9. Gupta A (2019) Current research opportunities of image processing and computer vision. Comput Sci. https://doi.org/10.7494/csci.2019.20.4.3163

    Article  Google Scholar 

  10. Gupta A (2020) Challenges for computer aided diagnostics using x-ray and tomographic reconstruction images in craniofacial applications. Int J Comput Vis Robot 10:360–371

    Article  Google Scholar 

  11. Gupta A, Kharbanda O, Sardana V, Balachandran R, Sardana H (2015) A knowledge-based algorithm for automatic detection of cephalometric landmarks on CBCT images. Int J Comput Assisted Radiol Surg 10:1737–1752

    Article  Google Scholar 

  12. Gupta A, Kharbanda OP, Sardana V, Balachandran R, Sardana HK (2016) Accuracy of 3D cephalometric measurements based on an automatic knowledge-based landmark detection algorithm. Int J Comput Assist Radiol Surg 11:1297–1309

    Article  Google Scholar 

  13. Gupta A, Kharbanda OP, Balachandran R, Sardana V, Kalra S, Chaurasia S et al (2017) Precision of manual landmark identification between as-received and oriented volume-rendered cone-beam computed tomography images. Am J Orthod Dentofacial Orthoped 151:118–131

    Article  Google Scholar 

  14. Gupta A, Sardana HK, Kharbanda OP, Sardana V (2019) Method for automatic detection of anatomical landmarks in volumetric data. US Patent US10318839B2, 11-06-2019

  15. Halazonetis DJ (2005) From 2-dimensional cephalograms to 3-dimensional computed tomography scans. Am J Orthod Dentofacial Orthop 127:627–637

    Article  Google Scholar 

  16. Horner K, Islam M, Flygare L, Tsiklakis K, Whaites E (2009) Basic principles for use of dental cone beam computed tomography: consensus guidelines of the European Academy of Dental and Maxillofacial Radiology. Dentomaxillofac Radiol 38:187–195

    Article  Google Scholar 

  17. Huete MI, Ibanez O, Wilkinson C, Kahana T (2015) Past, present, and future of craniofacial superimposition: literature and international surveys. Leg Med (Tokyo) 17:267–278

    Article  Google Scholar 

  18. Hwang J-J, Jung Y-H, Cho B-H, Heo M-S (2019) An overview of deep learning in the field of dentistry. Imaging Sci Dent 49:1–7

    Article  Google Scholar 

  19. Ibragimov B, Likar B, Pernus F, Vrtovec T (2016) Computerized cephalometry by game theory with shape-and appearance-based landmark refinement. Springer, Berlin

    Google Scholar 

  20. Kochhar AS, Nucci L, Sidhu MS, Prabhakar M, Grassia V, Perillo L et al (2021) Reliability and reproducibility of landmark identification in unilateral cleft lip and palate patients: digital lateral vis-a-vis CBCT-derived 3D Cephalograms. J Clin Med 10:535

    Article  Google Scholar 

  21. Lee H, Park M, Kim J (2017) Cephalometric landmark detection in dental x-ray images using convolutional neural networks, vol 10134. SPIE, Bellingham

    Google Scholar 

  22. Lee SM, Kim HP, Jeon K, Lee S-H, Seo JK (2019) Automatic 3D cephalometric annotation system using shadowed 2D image-based machine learning. Phys Med Biol 64:055002

    Article  Google Scholar 

  23. Lee J-H, Yu H-J, Kim M-J, Kim J-W, Choi J (2020) Automated cephalometric landmark detection with confidence regions using Bayesian convolutional neural networks. BMC Oral Health 20:270

    Article  Google Scholar 

  24. Leonardi R, Giordano D, Maiorana F, Spampinato C (2008) Automatic cephalometric analysis. Angle Orthod 78:145–151

    Article  Google Scholar 

  25. Lindner C, Wang C-W, Huang C-T, Li C-H, Chang S-W, Cootes TF (2016) Fully automatic system for accurate localisation and analysis of cephalometric landmarks in lateral cephalograms. Sci Rep 6:33581

    Article  Google Scholar 

  26. Makdissi J (2013) Cone beam CT in orthodontics: the current picture. Int Orthod 11:1–20

    Google Scholar 

  27. Moshiri M, Scarfe WC, Hilgers ML, Scheetz JP, Silveira AM, Farman AG (2007) Accuracy of linear measurements from imaging plate and lateral cephalometric images derived from cone-beam computed tomography. Am J Orthod Dentofacial Orthop 132:550–560

    Article  Google Scholar 

  28. Neelapu BC, Kharbanda OP, Sardana HK, Gupta A, Vasamsetti S, Balachandran R et al (2017) The reliability of different methods of manual volumetric segmentation of pharyngeal and sinonasal subregions. Oral Surg Oral Med Oral Pathol Oral Radiol 124:577–587

    Article  Google Scholar 

  29. Neelapu BC, Kharbanda OP, Sardana V, Gupta A, Vasamsetti S, Balachandran R et al (2017) A pilot study for segmentation of pharyngeal and sino-nasal airway subregions by automatic contour initialization. Int J Comput Assist Radiol Surg 12:1877–1893

    Article  Google Scholar 

  30. Neelapu BC, Kharbanda OP, Sardana HK, Balachandran R, Sardana V, Kapoor P et al (2017) Craniofacial and upper airway morphology in adult obstructive sleep apnea patients: a systematic review and meta-analysis of cephalometric studies. Sleep Med Rev 31:79–90

    Article  Google Scholar 

  31. Neelapu BC, Kharbanda OP, Sardana V, Gupta A, Vasamsetti S, Balachandran R et al (2018) Automatic localization of three-dimensional cephalometric landmarks on CBCT images by extracting symmetry features of the skull. Dentomaxillofacial Radiol 47:20170054

    Article  Google Scholar 

  32. Neelapu BC, Sardana HK, Kharbanda OP, Sardana V, Gupta A, Vasamsetti S (2018) Method and system for automatic volumetric-segmentation of human upper respiratory tract. US Patent US10699415B2

  33. Paula LKD, Solon-de-Mello PDA, Mattos CT, Ruellas ACDO, Sant’Anna AF (2015) Influence of magnification and superimposition of structures on cephalometric diagnosis. Dental Press J Orthod 20:29–34

    Article  Google Scholar 

  34. Petrick N, Sahiner B, Armato SG 3rd, Bert A, Correale L, Delsanto S et al (2013) Evaluation of computer-aided detection and diagnosis systems. Med Phys 40:087001

    Article  Google Scholar 

  35. Qian J, Cheng M, Tao Y, Lin J, Lin H (2019) CephaNet: an improved faster R-CNN for cephalometric landmark detection. In: 2019 IEEE 16th international symposium on biomedical imaging (ISBI 2019), pp 868–871

  36. Rossini G, Cavallini C, Cassetta M, Barbato E (2011) 3D cephalometric analysis obtained from computed tomography. Review of the literature. Ann Stomatol 2:31–39

    Google Scholar 

  37. Song Y, Qiao X, Iwamoto Y, Chen Y-W (2020) Automatic cephalometric landmark detection on x-ray images using a deep-learning method. Appl Sci 10:2547

    Article  Google Scholar 

  38. Wang CW, Huang CT, Lee JH, Li CH, Chang SW, Siao MJ et al (2016) A benchmark for comparison of dental radiography analysis algorithms. Med Image Anal 31:63–76

    Article  Google Scholar 

  39. Wang S, Li H, Li J, Zhang Y, Zou B (2018) Automatic analysis of lateral cephalograms based on multiresolution decision tree regression voting. J Healthcare Eng 2018:1797502

    Article  Google Scholar 

  40. Yue W, Yin D, Li C, Wang G, Xu T (2006) Automated 2-D cephalometric analysis on X-ray images by a model-based approach. IEEE Trans Biomed Eng 53:1615–1623

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Computer Science and Engineering, University of Ha’il, Ha’il, 81481, Saudi Arabia

    Rabie A. Ramadan, Ahmed Y. Khedr, Kusum Yadav, Eissa Jaber Alreshidi & Md Haidar Sharif

  2. Faculty of Computers and Artificial Intelligence, Benha University, Benha, Egypt

    Ahmad Taher Azar

  3. Department of Computer Engineering, International Balkan University, Makedonsko-Kosovska Brigada BB, Skopje, Macedonia

    Hiqmet Kamberaj

Authors
  1. Rabie A. Ramadan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ahmed Y. Khedr
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kusum Yadav
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Eissa Jaber Alreshidi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Md Haidar Sharif
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ahmad Taher Azar
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Hiqmet Kamberaj
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kusum Yadav.

Ethics declarations

Conflict of interest

All authors declares that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ramadan, R.A., Khedr, A.Y., Yadav, K. et al. Convolution neural network based automatic localization of landmarks on lateral x-ray images. Multimed Tools Appl 81, 37403–37415 (2022). https://doi.org/10.1007/s11042-021-11596-3

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11596-3

Keywords

Search

Navigation