Skip to main content

Advertisement

SpringerLink
Log in

Cephalometry analysis of facial soft tissue based on two orthogonal views applicable for facial plastic surgeries

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Cephalometry analysis of facial soft tissue plays an important role for anthropologists in facial plastic surgeries. There are two important problems in the field of medical for facial anthropometry analysis. (1) Image calibration and its management during facial surgery operation by surgeons are difficult and time-consuming. (2) The manual analysis of facial cephalometry using mechanical tools such as a ruler and the caliper is highly error-inclined. A major disadvantage of manual measurement is that this method requires training and skill. To overcome the mentioned problems, this paper presents an automatic method for facial anthropometry analysis applicable for facial plastic surgeries based on orthogonal images. The proposed algorithm includes three main steps: (1) eye and mouth region detection from the frontal view, (2) facial contour extraction from the profile view, and (3) facial landmark detection. In this study, an optimized version of Fuzzy C-Means (FCM) clustering is presented using the Grey Wolf Optimization (GWO) for lip and facial skin segmentation. For facial landmark localization from the profile view, first, facial skin segmentation is done from frontal and profile views. Then, eye and mouth regions are detected from the frontal view. In facial orthogonal images, the Y coordinates of the feature points are the same, approximately. Finally, nine landmarks from the profile view are detected using the orthogonality feature. Experiment results show that the proposed algorithm is effective in the analysis of facial plastic surgeries.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Algorithm 1
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Aibinu AM, Shafie AA, Salami MJE (2012) Performance analysis of ANN based YCbCr skin detection algorithm. Procedia Engin 41:1183–1189. https://doi.org/10.1016/j.proeng.2012.07.299

    Article  Google Scholar 

  2. Ajami S, Hooman ZN, Sareh M (2015) Angular photogrammetric analysis of the soft tissue facial profile of Iranian young adults. Iran. J. Orthod, 10. https://doi.org/10.17795/ijo.4981

  3. Al-Mohair HK, Saleh JM, Suandi SA (2015) Hybrid human skin detection using neural network and K-means clustering technique. Appl Soft Comput 33:337–347. https://doi.org/10.1016/j.asoc.2015.04.046

    Article  Google Scholar 

  4. Asghari A, Rajaeih Sh, Hassannia F, Tavakolifard N, Fattahi H, Kamrava SK, Jalessi M, Omidian P (2014) Photographic facial soft tissue analysis of healthy Iranian young adults: anthropometric and angular measurements. Med J Islam Repub Iran, 28, 49. http://mjiri.iums.ac.ir/article-1-2322-en.html.

  5. Askarzadeh A (2016) A novel metaheuristic method for solving constrained engineering optimization problems: crow search algorithm. Comput Struct 169:1–12. https://doi.org/10.1016/j.compstruc.2016.03.001

    Article  Google Scholar 

  6. Bakhshali MA, Shamsi M (2014) Segmentation of color lip images by optimal thresholding using bacterial foraging optimization (BFO). J Comput Sci 5(2):251–257. https://doi.org/10.1016/j.jocs.2013.07.001

    Article  Google Scholar 

  7. Bakhshali MA, Shamsi M (2015) Estimating facial angles using radon transform. Turk J Electr Eng Comput Sci 23(3):804–812. https://doi.org/10.3906/elk-1302-87

    Article  Google Scholar 

  8. Bakhshali M, Shamsi M, Sadeghi M (2015) Evaluation of facial soft tissue parameters for northwestern students in Iran. J Craniomaxillofac Res 2(1–2):78–82

    Google Scholar 

  9. Beugre JB, Diomande M, Assi AR, Koueita MK, Vaysse F (2017) Angular photogrammetric analysis and evaluation of facial esthetics of young Ivorians with normal dental occlusion. Int Orthod 15(1):25–39. https://doi.org/10.1016/j.ortho.2016.12.015

    Article  Google Scholar 

  10. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 6:679–698. https://doi.org/10.1109/TPAMI.1986.4767851

    Article  Google Scholar 

  11. Chaves-González JM, Vega-Rodríguez MA, Gómez-Pulido JA, Sánchez-Pérez JM (2010) Detecting skin in face recognition systems: a colour spaces study. Digital Signal Proc 20(3):806–823. https://doi.org/10.1016/j.dsp.2009.10.008

    Article  Google Scholar 

  12. Chen F, Zhang D (2016) Combining a causal effect criterion for evaluation of facial attractiveness models. Neurocomputing 177:98–109. https://doi.org/10.1016/j.neucom.2015.11.010

    Article  Google Scholar 

  13. Csurka G, Larlus D, Perronnin F, Meylan F (2013) What is a good evaluation measure for semantic segmentation? In BMVC 27:10–5244. https://doi.org/10.5244/C.27.32

    Article  Google Scholar 

  14. Elazab A, Wang C, Jia F, Wu J, Li G, Hu Q (2015) Segmentation of brain tissues from magnetic resonance images using adaptively regularized kernel-based fuzzy-means clustering. Computational and mathematical methods in medicine https://doi.org/10.1155/2015/485495,

  15. Fagundes MSC, Moreira AT, Tambara EM, Tenório SB, Fraga RD, Hamerschmidt R (2016) Objective assessment of surgical technique in rotation and nasal projection variation. Brazilian J Otorhinolaryngol 82(1):47–55. https://doi.org/10.1016/j.bjorl.2015.11.003

    Article  Google Scholar 

  16. Fariaby J, Hossini A, Saffari E (2006) Photographic analysis of faces of 20-year-old students in Iran. Br J Oral Maxillofac Surg 44(5):393–396. https://doi.org/10.1016/j.bjoms.2005.07.029

    Article  Google Scholar 

  17. Ford A, Roberts A (1998) Colour space conversions. Westminster University, London, pp 1–31

    Google Scholar 

  18. Fortes HNDR, Guimarães TC, Belo IML, Matta ENRD (2014) Photometric analysis of esthetically pleasant and unpleasant facial profile. Dental Press J Orthodo 19(2):66–75. https://doi.org/10.1590/2176-9451.19.2.066-075.oar

    Article  Google Scholar 

  19. Fred AL, Kumar SN, Padmanaban P, Gulyas B, Kumar HA (2020) Fuzzy-crow search optimization for medical image segmentation. Appl Hybrid Metaheu Algo Image Proc:413–439. https://doi.org/10.1007/978-3-030-40977-7_18

  20. Gerós A, Horta R, Aguiar P (2016) Facegram–objective quantitative analysis in facial reconstructive surgery. J Biomed Inform 61:1–9. https://doi.org/10.1016/j.jbi.2016.03.011

    Article  Google Scholar 

  21. Gode S, Tiris FS, Akyildiz S, Apaydin F (2011) Photogrammetric analysis of soft tissue facial profile in Turkish rhinoplasty population. Aesthet Plast Surg 35(6):1016–1021. https://doi.org/10.1007/s00266-011-9726-8

    Article  Google Scholar 

  22. Gunes H, Piccardi M (2006) Assessing facial beauty through proportion analysis by image processing and supervised learning. Int J Human-Comput Stud 64(12):1184–1199. https://doi.org/10.1016/j.ijhcs.2006.07.004

    Article  Google Scholar 

  23. Hong YJ, Nam GP, Choi H, Cho J, Kim IJ (2017) A novel framework for assessing facial attractiveness based on facial proportions. Symmetry 9(12):294. https://doi.org/10.3390/sym9120294

    Article  Google Scholar 

  24. Hossain MF, Shamsi M, Alsharif MR, Zoroofi RA, Yamashita K (2012) Automatic facial skin detection using Gaussian mixture model under varying illumination. Int J Innovative Comput Inf Contr 8(2):1135–1144

    Google Scholar 

  25. Ji Y, Wang S, Lu Y, Wei J, Zhao Y (2018) Eye and mouth state detection algorithm based on contour feature extraction. J Electro Imag 27(5):051205. https://doi.org/10.1117/1.JEI.27.5.051205

    Article  Google Scholar 

  26. Kahu SY, Raut RB, Bhurchandi KM (2019) Review and evaluation of color spaces for image/video compression. Color Res Appl 44(1):8–33. https://doi.org/10.1002/col.22291

    Article  Google Scholar 

  27. Kennedy J, Eberhart R (1995) Particle swarm optimization. In: proceedings of ICNN'95-international conference on neural networks, 4: 1942-1948. https://doi.org/10.1109/ICNN.1995.488968

  28. Khan R, Hanbury A, Stöttinger J, Bais A (2012) Color based skin classification. Pattern Recogn Lett 33(2):157–163. https://doi.org/10.1016/j.patrec.2011.09.032

    Article  Google Scholar 

  29. Liu J, Yang XB, Xi TT, Gu LX, Yu ZY (2009) A novel method for computer aided plastic surgery prediction. In: 2009 2nd international conference on biomedical engineering and informatics: 1-5. https://doi.org/10.1109/BMEI.2009.5305021

  30. Liu Y, Huang ML, Huang W, Liang J (2017) A physiognomy based method for facial feature extraction and recognition. J Vis Lang Comput 43:103–109. https://doi.org/10.1016/j.jvlc.2017.09.006

    Article  Google Scholar 

  31. Majdi A, Beiki M (2019) Applying evolutionary optimization algorithms for improving fuzzy C-mean clustering performance to predict the deformation modulus of rock mass. Int J Rock Mech Min Sci 113:172–182. https://doi.org/10.1016/j.ijrmms.2018.10.030

    Article  Google Scholar 

  32. Malá PZ, Krajíček V, Velemínská J (2018) How tight is the relationship between the skeletal and soft-tissue facial profile: a geometric morphometric analysis of the facial outline. Forensic Sci Int 292:212–223. https://doi.org/10.1016/j.forsciint.2018.09.014

    Article  Google Scholar 

  33. Malkoç S, Demir A, Uysal T, Canbuldu N (2009) Angular photogrammetric analysis of the soft tissue facial profile of Turkish adults. Eur J Orthodon 31(2):174–179. https://doi.org/10.1093/ejo/cjn082

    Article  Google Scholar 

  34. Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67. https://doi.org/10.1016/j.advengsoft.2016.01.008

    Article  Google Scholar 

  35. Mirjalili S, Mirjalili SM, Lewis A (2014) Grey wolf optimizer. Adv Eng Softw 69:46–61. https://doi.org/10.1016/j.advengsoft.2013.12.007

    Article  Google Scholar 

  36. Mohanty R, Raghunadh MV (2016) A new approach to face detection based on YCgCr color model and improved AdaBoost algorithm. In: 2016 international conference on communication and signal processing (ICCSP): 1392-1396. https://doi.org/10.1109/ICCSP.2016.7754383.

  37. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst, man, Cybernet 9(1):62–66. https://doi.org/10.1109/TSMC.1979.4310076

    Article  MathSciNet  Google Scholar 

  38. Özkan AÇ (2017) Rhinoplasty setsquare device: a novel instrument to verify columellar and nasal dorsal position at the midsagittal line. Plastic and Reconstructive Surgery Global Open, 5(7). https://doi.org/10.1097/GOX.0000000000001399

  39. Park BH, Oh SY, Kim IJ (2017) Face alignment using a deep neural network with local feature learning and recurrent regression. Expert Syst Appl 89:66–80. https://doi.org/10.1016/j.eswa.2017.07.018

    Article  Google Scholar 

  40. Pham AM, Tollefson TT (2010) Objective facial photograph analysis using imaging software. Facial Plas Surg Clin 18(2):341–349. https://doi.org/10.1016/j.fsc.2010.01.010

    Article  Google Scholar 

  41. Salazar A, Daza GS, Sánchez L, Prieto F, Castellanos G, Quintero C (2006) Feature extraction & lips posture detection oriented to the treatment of CLP children. In: 2006 International Conference of the IEEE Engineering in Medicine and Biology Society: 5747-5750. https://doi.org/10.1109/IEMBS.2006.260478

  42. Sameer FO, Bakar MA, Zaidan AA, Zaidan BB (2019) A new algorithm of modified binary particle swarm optimization based on the Gustafson-Kessel for credit risk assessment. Neural Comput Applic 31(2):337–346. https://doi.org/10.1007/s00521-017-3018-4

    Article  Google Scholar 

  43. Saremi S, Mirjalili S, Lewis A (2017) Grasshopper optimisation algorithm: theory and application. Adv Eng Softw 105:30–47. https://doi.org/10.1016/j.advengsoft.2017.01.004

    Article  Google Scholar 

  44. Shamsi M, Zoroofi RA, Lucas C, Hasanabadi MS, Alsharif MR (2008) Automatic facial skin segmentation based on em algorithm under varying illumination. IEICE Trans Inf Syst 91(5):1543–1551. https://doi.org/10.1093/ietisy/e91-d.5.1543

    Article  Google Scholar 

  45. Singh J, Arora AS (2018) An automated approach to enhance the thermographic evaluation on orofacial regions in lateral facial thermograms. J Therm Biol 71:91–98. https://doi.org/10.1016/j.jtherbio.2017.11.001

    Article  Google Scholar 

  46. Singh R, Vatsa M, Bhatt HS, Bharadwaj S, Noore A, Nooreyezdan SS (2010) Plastic surgery: a new dimension to face recognition. IEEE Transac Inform ForenSec 5(3):441–448. https://doi.org/10.1109/TIFS.2010.2054083

    Article  Google Scholar 

  47. Song Y, Qiao X, Iwamoto Y, Chen YW (2020) Automatic cephalometric landmark detection on X-ray images using a deep-learning method. Appl Sci 10(7):2547. https://doi.org/10.3390/app10072547

    Article  Google Scholar 

  48. Tang X, Guo F, Shen J, Du T (2018) Facial landmark detection by semi-supervised deep learning. Neurocomputing 297:22–32. https://doi.org/10.1016/j.neucom.2018.01.080

    Article  Google Scholar 

  49. Tongbram S, Shimray BA, Singh LS, Dhanachandra N (2021) A novel image segmentation approach using fcm and whale optimization algorithm. Journal of ambient intelligence and humanized computing: 1-15. https://doi.org/10.1007/s12652-020-02762-w

  50. Tuncel U, Turan A, Kostakoğlu N (2013) Digital anthropometric shape analysis of 110 rhinoplasty patients in the Black Sea region in Turkey. J Cranio-Maxillofac Surg 41(2):98–102. https://doi.org/10.1016/j.jcms.2012.05.014

    Article  Google Scholar 

  51. Uzun A, Ozdemir F (2014) Morphometric analysis of nasal shapes and angles in young adults. BrazilianJ Otorhinolaryngol 80(5):397–402. https://doi.org/10.1016/j.bjorl.2014.07.010

    Article  Google Scholar 

  52. Verma H, Verma D, & Tiwari PK (2020) A population based hybrid FCM-PSO algorithm for clustering analysis and segmentation of brain image. Expert systems with applications, 167: 114121. https://doi.org/10.1016/j.eswa.2020.114121

  53. Wang S, Li H, Li J, Zhang Y, Zou B (2018) Automatic analysis of lateral cephalograms based on multiresolution decision tree regression voting. Journal of Healthcare Engineering https://doi.org/10.1155/2018/1797502

  54. Wu Y, Hassner T, Kim K, Medioni G, Natarajan P (2017) Facial landmark detection with tweaked convolutional neural networks. IEEE Trans Pattern Anal Mach Intell 40(12):3067–3074. https://doi.org/10.1109/TPAMI.2017.2787130

    Article  Google Scholar 

  55. Zali-Vargahan B, Kalbkhani H, Shayesteh MG (2013) An efficient algorithm for lip detection in color face images. In: 2013 21st Iranian conference on electrical engineering (ICEE): 1-4. https://doi.org/10.1109/IranianCEE.2013.6599705

  56. Zhang D, Zhao Q, Chen F (2011) Quantitative analysis of human facial beauty using geometric features. Pattern Recogn 44(4):940–950. https://doi.org/10.1016/j.patcog.2010.10.013

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Biomedical Engineering, Sahand University of Technology, Tabriz, Iran

    Ali Fahmi Jafargholkhanloo & Mousa Shamsi

Authors
  1. Ali Fahmi Jafargholkhanloo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mousa Shamsi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mousa Shamsi.

Ethics declarations

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jafargholkhanloo, A.F., Shamsi, M. Cephalometry analysis of facial soft tissue based on two orthogonal views applicable for facial plastic surgeries. Multimed Tools Appl 82, 30643–30668 (2023). https://doi.org/10.1007/s11042-023-14531-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14531-w

Keywords

Search

Navigation