Abstract
Utilizing individual annotation of panoramic radiographs, a comprehensive deep learning multi-scale spatial pooling (ms-SP)-based panoptic segmentation technique is tested for its effectiveness in segmenting teeth autonomously. On a panoramic radiograph, each tooth was meticulously tagged by an oral radiologist to accurately depict its real structure. From the initial data points, we used the augmentation strategy to create training samples to reduce over-fitting. With the proposed multi-scale spatial pooling (ms-SP), a completely deep learning approach was used to locate and identify the dental traits. Performance was evaluated using the F1 score, and visual analysis. The suggested method resulted in a mean IoU of 87% and an F1 score of 98.9%, accuracy of 98.5%, recall of 93%, precision of 94.5%, dice score of 94.5% and PFOM is 80.5%. The segmentation technique was evaluated visually, and the results were very similar to the actual data. The technique produced effective results for automating the segmentation of teeth on panoramic dental photos. The suggested technique may be advantageous for the first stages of forensic identification and diagnostic automation, which both involve similar segmentation tasks.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
Enquiries about data availability should be directed to the authors.
References
Ali RB, Ejbali R (2015) Gpu-based segmentation of dental X-ray images using active contours without edges. In: 2015 15th International Conference on intelligent systems design and applications. IEEE, pp 505–510
Al-Janabi S, Alkaim AF (2020) A nifty collaborative analysis to predicting a novel tool (DRFLLS) for missing values estimation. Soft Comput 24(1):555–569
Alsmadi MK (2018a) A hybrid Fuzzy C-Means and Neutrosophic for jaw lesions segmentation. Ain Shams Engineering Journal 9:697–706
Alsmadi MK (2018b) A hybrid fuzzy c-means and neutrosophic for jaw lesions segmentation. Ain Shams Eng J 9(4):697–706
Chen L, Zhang H, Xiao J (2017). SCA-CNN: Spatial and Channel-wise attention in convolutional networks for image captioning. In: IEEE Conference on computer vision and pattern recognition, CVPR
Couteaux V, Si-Mohamed S, Nempont O, Lefevre T, Popoff A, Pizaine G et al (2019) Automatic knee meniscus tear detection and orientation classification with Mask-RCNN. DiagnInterv Imaging 100:235–242
Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM et al (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542:115
Fu X, Liu T, Xiong Z, Smaill BH, Stiles MK, Zhao J (2018) Segmentation of histological images and fibrosis identification with a convolutional neural network. ComputBiol Med 98:147–158
Koch TL, Perslev M (2019) Accurate segmentation of dental panoramic radiographs with U-NETS. In: 2019 IEEE 16th International symposium on biomedical imaging. IEEE, pp 15–19
Kudo K, Okada Y (2020) Development of training system for dental treatment using webar and leap motion controller. In: Conference on complex, intelligent, and software intensive systems. Springer, Berlin, pp 579–587
Li Y, Baciu G, Han Y, Li C (2017) Indoor localization with occlusion removal. In: International Conference on cognitive informatics & cognitive computing, ICCI*CC, pp 191–198
Lin N-H, Lin T-L, Wang X, Kao W-T, Tseng H-W, Chen SL et al (2018) Teeth detection algorithm and teeth condition classification based on convolutional neural networks for dental panoramic radiographs. J Med Imaging Health Inform 8:507–515
Liu L, Zhou R (2020) Simulation training for ceramic crown preparation in the dental setting using a virtual educational system. Eur J Dent Educ 24(2):199–202
Liu G, Reda FA, Shih KJ, Wang T, Tao A, Catanzaro B (2018) Image inpainting for irregular holes using partial convolutions. In: European Conference on computer vision, ECCV, pp. 85–100
Mao J, Wang K (2018) Grabcut algorithm for dental x-ray images based on full threshold segmentation. IET Image Process 12(12):2330–2335
Marroquin TY, Karkhanis S (2020) Overcoming population differences for dental age estimation in adults through pulp/tooth volume calculations: a pilot study. Aust J Forensic Sci 52(5):500–507
Milletari F, Ahmadi S-A, Kroll C, Plate A, Rozanski V, Maiostre J et al (2017) Hough-CNN: deep learning for segmentation of deep brain regions in MRI and ultrasound. Comput vis Image Underst 164:92–102
Pathak D, Krahenbuhl P, Donahue J (2016) Context Encoders: Feature learning by inpainting. In: IEEE Conference on computer vision and pattern recognition, CVPR, pp 2536–2544.
Rad AE, Rahim MSM (2013) Digital dental X-ray image segmentation and feature extraction. Indones J Electr Eng 11(6):3109–3114
Rakhshanfar M, Amer MA (2018) Low-frequency image noise removal using white noise filter. In: IEEE International Conference on image processing, ICIP, pp 3948–3952
Senthilkumaran N (2012) Genetic algorithm approach to edge detection for dental X-ray image segmentation. International Journal of Advanced Research in Computer Science and Electronics Engineering 1:5236–5238
Sherubha (2019) An efficient network threat detection and classification method using ANP-MVPS algorithm in wireless sensor networks. Int J Innov Technol Explor Eng (IJITEE) 8(11):1597–1606 (ISSN: 2278-3075)
Sherubha (2020) Graph based event measurement for analyzing distributed anomalies in sensor networks. Sådhanå (springer) 45:212. https://doi.org/10.1007/s12046-020-01451-w
Speiser JL, Miller ME (2019) A comparison of random forest variable selection methods for classification prediction modeling. Expert SystAppl 134:93–101
Terlemez A, Tassoker M, Kizilcakaya M, Gulec M (2019) Comparison of cone-beam computed tomography and panoramic radiography in the evaluation of maxillary sinus pathology related to maxillary posterior teeth: do apical lesions increase the risk of maxillary sinus pathology? Imaging Sci Dent 49:115–122
Wirtz A, Mirashi SG (2018) Automatic teeth segmentation in panoramic X-ray images using a coupled shape model in combination with a neural network. International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 712–719
Yang C, Lu X, Lin Z, Shechtman E, Wang O, Li H (2017) High-Resolution image inpainting using multi-scale neural patch synthesis. In: IEEE Conference on computer vision and pattern recognition, CVPR, pp 6721–6729
Yeh RA, Chen C, Lim TY (2017) Semantic image inpainting with deep generative models. In: IEEE Conference on computer vision and pattern recognition, CVPR, pp 5485–5493
Yu J, Lin Z, Yang J, Shen X, Lu X, Huang TS (2018) Generative image inpainting with contextual attention. In: IEEE Conference on computer vision and pattern recognition, CVPR, pp 5505–5514
Funding
The authors have not disclosed any funding.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
The article does not contain any studies with human participants or animal performed by any of the authors.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Nagaraju, P., Sudha, S.V. Design of a novel panoptic segmentation using multi-scale pooling model for tooth segmentation. Soft Comput 28, 4185–4196 (2024). https://doi.org/10.1007/s00500-024-09669-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-024-09669-0