Abstract
Deep neural networks are those networks that have a large number of parameters, thus the core of deep learning systems. There is a challenge that arises, from these systems as to how they perform against training data, and/or validation datasets. Due to the number of parameters involved the networks tend to consume a lot of time and this brings about a condition referred as over-fitting. This approach proposes the introduction of a dropout layer between the input and the first hidden layer in a model. This is quite specific and different from the traditional dropout used in other fields which introduce the dropout in each and every hidden layer of the network model to deal with over-fitting. Our approach involves a pre-processing step that deals with data augmentation to take care of the limited number of dental images and erosion morphology to remove noise from the images. Additionally, segmentation is done to extract edge-based features using the canny edge detection method. Further, the neural network used employs the sequential model from Keras, and this is for combining iterations from the edge segmentation step into one model. Parallel evaluations to the model are carried out, first without dropout, and the other with a dropout input layer of size 0.3. The introduction of dropout in the model as a weight regularization technique, improved the accuracy of evaluation results, 89.0% for the model without dropout, to 91.3% for model with dropout, for both precision and recall values.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Andersen, C.A.R.: Melanoma classification in low resolution dermoscopy images using deep learning, Master’s thesis, The University of Bergen (2019)
Miloš, E., Kolesau, A., Šešok, D.: Traffic sign recognition using convolutional neural networks/Science-Future of Lithuania, p. 10 (2018)
Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15(1), 1929–1958 (2014)
https://machinelearningmastery.com/dropout-regularization-deep-learning-models-keras/. Accessed 19 June 2020 (Friday) at 10.46 am
Kang, G., Li, J., Tao, D.: Shakeout: a new approach to regularized deep neural network training. IEEE Trans. Pattern Anal. Mach. Intell. 40(5), 1245–1258 (2017)
Dahl, G.E., Sainath, T.N., Hinton, G.E.: Improving deep neural networks for LVCSR using rectified linear units and dropout. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 8609–8613. IEEE (2013)
Pham, V., Bluche, T., Kermorvant, C., Louradour, J.: Dropout improves recurrent neural networks for handwriting recognition. In: 2014 14th International Conference on Frontiers in Handwriting Recognition, pp. 285–290. IEEE (2014)
Hussain, S., Anwar, S.M., Majid, M.: Brain tumor segmentation using cascaded deep convolutional neural network. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 1998–2001. IEEE (2017)
Kingma, D.P., Salimans, T., Welling, M.: Variational dropout and the local reparameterization trick. In: Advances in Neural Information Processing Systems, pp. 2575–2583 (2015)
Rashmi, K.V., Gilad-Bachrach, R.: DART: dropouts meet multiple additive regression trees. In: AISTATS, pp. 489–497 (2015)
Wu, F., Hu, P., Kong, D.: Flip-rotate-pooling convolution and split dropout on convolution neural networks for image classification. arXiv preprint arXiv:1507.08754 (2015)
He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans. Pattern Anal. Mach. Intell. 37(9), 1904–1916 (2015)
Hussain, Z., Gimenez, F., Yi, D., Rubin, D.: Differential data augmentation techniques for medical imaging classification tasks. In: AMIA Annual Symposium Proceedings, vol. 2017, p. 979. American Medical Informatics Association (2017)
Nyíri, T., Kiss, A.: Style transfer for dermatological data augmentation. In: Bi, Y., Bhatia, R., Kapoor, S. (eds.) IntelliSys 2019. AISC, vol. 1038, pp. 915–923. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-29513-4_67
Nyíri, T., Kiss, A.: Novel ensembling methods for dermatological image classification. In: Fagan, D., Martín-Vide, C., O’Neill, M., Vega-Rodríguez, M.A. (eds.) TPNC 2018. LNCS, vol. 11324, pp. 438–448. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-04070-3_34
Aggarwal, L.P.: Data augmentation in dermatology image recognition using machine learning. Skin Res. Technol. 25(6), 815–820 (2019)
Van der Walt, S., et al.: scikit-image: image processing in Python. PeerJ 2, e453 (2014)
Shah, S., Abaza, A., Ross, A., Ammar, H.: Automatic tooth segmentation using active contour without edges. In: 2006 Biometrics Symposium: Special Session on Research at the Biometric Consortium Conference, pp. 1–6. IEEE (2006)
Chen, H., et al.: A deep learning approach to automatic teeth detection and numbering based on object detection in dental periapical films. Sci. Rep. 9(1), 1–11 (2019)
Modi, C.K., Desai, N.P.: A simple and novel algorithm for automatic selection of ROI for dental radiograph segmentation. In: 2011 24th Canadian Conference on Electrical and Computer Engineering (CCECE), pp. 000504–000507. IEEE 2011
Rad, A.E., Rahim, M.S.M., Norouzi, A.: Digital dental X-ray image segmentation and feature extraction. TELKOMNIKA Indones. J. Electr. Eng. 11(6), 3109–3114 (2013)
Osterloh, D., Viriri, S.: Unsupervised caries detection in non-standardized bitewing dental x-rays. In: Bebis, G., et al. (eds.) ISVC 2016. LNCS, vol. 10072, pp. 649–658. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-50835-1_58
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Majanga, V., Viriri, S. (2021). Dropout Regularization for Automatic Segmented Dental Images. In: Hong, TP., Wojtkiewicz, K., Chawuthai, R., Sitek, P. (eds) Recent Challenges in Intelligent Information and Database Systems. ACIIDS 2021. Communications in Computer and Information Science, vol 1371. Springer, Singapore. https://doi.org/10.1007/978-981-16-1685-3_21
Download citation
DOI: https://doi.org/10.1007/978-981-16-1685-3_21
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-1684-6
Online ISBN: 978-981-16-1685-3
eBook Packages: Computer ScienceComputer Science (R0)