Skip to main content

Dropout Regularization for Automatic Segmented Dental Images

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1371))

Abstract

Deep neural networks are those networks that have a large number of parameters, thus the core of deep learning systems. There is a challenge that arises, from these systems as to how they perform against training data, and/or validation datasets. Due to the number of parameters involved the networks tend to consume a lot of time and this brings about a condition referred as over-fitting. This approach proposes the introduction of a dropout layer between the input and the first hidden layer in a model. This is quite specific and different from the traditional dropout used in other fields which introduce the dropout in each and every hidden layer of the network model to deal with over-fitting. Our approach involves a pre-processing step that deals with data augmentation to take care of the limited number of dental images and erosion morphology to remove noise from the images. Additionally, segmentation is done to extract edge-based features using the canny edge detection method. Further, the neural network used employs the sequential model from Keras, and this is for combining iterations from the edge segmentation step into one model. Parallel evaluations to the model are carried out, first without dropout, and the other with a dropout input layer of size 0.3. The introduction of dropout in the model as a weight regularization technique, improved the accuracy of evaluation results, 89.0% for the model without dropout, to 91.3% for model with dropout, for both precision and recall values.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Andersen, C.A.R.: Melanoma classification in low resolution dermoscopy images using deep learning, Master’s thesis, The University of Bergen (2019)

    Google Scholar 

  2. Miloš, E., Kolesau, A., Šešok, D.: Traffic sign recognition using convolutional neural networks/Science-Future of Lithuania, p. 10 (2018)

    Google Scholar 

  3. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)

    MathSciNet  MATH  Google Scholar 

  4. https://machinelearningmastery.com/dropout-regularization-deep-learning-models-keras/. Accessed 19 June 2020 (Friday) at 10.46 am

  5. Kang, G., Li, J., Tao, D.: Shakeout: a new approach to regularized deep neural network training. IEEE Trans. Pattern Anal. Mach. Intell. 40(5), 1245–1258 (2017)

    Article  Google Scholar 

  6. Dahl, G.E., Sainath, T.N., Hinton, G.E.: Improving deep neural networks for LVCSR using rectified linear units and dropout. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 8609–8613. IEEE (2013)

    Google Scholar 

  7. Pham, V., Bluche, T., Kermorvant, C., Louradour, J.: Dropout improves recurrent neural networks for handwriting recognition. In: 2014 14th International Conference on Frontiers in Handwriting Recognition, pp. 285–290. IEEE (2014)

    Google Scholar 

  8. Hussain, S., Anwar, S.M., Majid, M.: Brain tumor segmentation using cascaded deep convolutional neural network. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 1998–2001. IEEE (2017)

    Google Scholar 

  9. Kingma, D.P., Salimans, T., Welling, M.: Variational dropout and the local reparameterization trick. In: Advances in Neural Information Processing Systems, pp. 2575–2583 (2015)

    Google Scholar 

  10. Rashmi, K.V., Gilad-Bachrach, R.: DART: dropouts meet multiple additive regression trees. In: AISTATS, pp. 489–497 (2015)

    Google Scholar 

  11. Wu, F., Hu, P., Kong, D.: Flip-rotate-pooling convolution and split dropout on convolution neural networks for image classification. arXiv preprint arXiv:1507.08754 (2015)

  12. He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1904–1916 (2015)

    Article  Google Scholar 

  13. Hussain, Z., Gimenez, F., Yi, D., Rubin, D.: Differential data augmentation techniques for medical imaging classification tasks. In: AMIA Annual Symposium Proceedings, vol. 2017, p. 979. American Medical Informatics Association (2017)

    Google Scholar 

  14. Nyíri, T., Kiss, A.: Style transfer for dermatological data augmentation. In: Bi, Y., Bhatia, R., Kapoor, S. (eds.) IntelliSys 2019. AISC, vol. 1038, pp. 915–923. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-29513-4_67

    Chapter  Google Scholar 

  15. Nyíri, T., Kiss, A.: Novel ensembling methods for dermatological image classification. In: Fagan, D., Martín-Vide, C., O’Neill, M., Vega-Rodríguez, M.A. (eds.) TPNC 2018. LNCS, vol. 11324, pp. 438–448. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04070-3_34

    Chapter  Google Scholar 

  16. Aggarwal, L.P.: Data augmentation in dermatology image recognition using machine learning. Skin Res. Technol. 25(6), 815–820 (2019)

    Article  Google Scholar 

  17. Van der Walt, S., et al.: scikit-image: image processing in Python. PeerJ 2, e453 (2014)

    Article  Google Scholar 

  18. Shah, S., Abaza, A., Ross, A., Ammar, H.: Automatic tooth segmentation using active contour without edges. In: 2006 Biometrics Symposium: Special Session on Research at the Biometric Consortium Conference, pp. 1–6. IEEE (2006)

    Google Scholar 

  19. Chen, H., et al.: A deep learning approach to automatic teeth detection and numbering based on object detection in dental periapical films. Sci. Rep. 9(1), 1–11 (2019)

    Google Scholar 

  20. Modi, C.K., Desai, N.P.: A simple and novel algorithm for automatic selection of ROI for dental radiograph segmentation. In: 2011 24th Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 000504–000507. IEEE 2011

    Google Scholar 

  21. Rad, A.E., Rahim, M.S.M., Norouzi, A.: Digital dental X-ray image segmentation and feature extraction. TELKOMNIKA Indones. J. Electr. Eng. 11(6), 3109–3114 (2013)

    Google Scholar 

  22. Osterloh, D., Viriri, S.: Unsupervised caries detection in non-standardized bitewing dental x-rays. In: Bebis, G., et al. (eds.) ISVC 2016. LNCS, vol. 10072, pp. 649–658. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-50835-1_58

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Serestina Viriri .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Majanga, V., Viriri, S. (2021). Dropout Regularization for Automatic Segmented Dental Images. In: Hong, TP., Wojtkiewicz, K., Chawuthai, R., Sitek, P. (eds) Recent Challenges in Intelligent Information and Database Systems. ACIIDS 2021. Communications in Computer and Information Science, vol 1371. Springer, Singapore. https://doi.org/10.1007/978-981-16-1685-3_21

Download citation

  • DOI: https://doi.org/10.1007/978-981-16-1685-3_21

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-16-1684-6

  • Online ISBN: 978-981-16-1685-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics