Abstract
Potholes are the most common cause of accidents on the road surface, and the primary cause is water. Potholes in the pavement can be formed by a number of things, including gasoline or fuel leaks, automobile smearing, and the disposal of rock cuttings. As a result, in order to avoid accidents, it is essential to identify the pothole in advance, either automatically or manually. There are several ways to detect the pothole manually, nonetheless, they consume more time, power, and high setup cost. However, the automatic detection follows an optical imaging system, and the detection of pothole during bad weather conditions and night-time become arduous. Hence we proposed a novel method to detect the pothole by using a thermal imaging system known as convolutional neural network (CNN)-based modified aquilla optimization (AO) algorithm. The proposed method follows Data acquisition, Image preprocessing, and Data augmentation processes prior to the application of classification tasks. The proposed CNN-based Modified AO approach enhances the classification accuracy, precision, recall, and F1-score. However, it minimizes the classification error and detection time. The performances of our proposed work are compared with other approaches such as CNN, CNN-TI, YOLO-NN, and DNN. The experimental analysis also depicts that our proposed work has better performances than the other approaches.







Similar content being viewed by others
Explore related subjects
Discover the latest articles and news from researchers in related subjects, suggested using machine learning.References
Song, H., Baek, K., Byun, Y.: Pothole detection using machine learning. In: Advanced Science and Technology, pp. 151–155 (2018)
Sharma, S.K., Sharma, R.C.: Pothole detection and warning system for indian roads. In: Advances in Interdisciplinary Engineering, pp. 511–519. Springer, Singapore (2019)
Koch, C., Jog, G.M., Brilakis, I.: Automated pothole distress assessment using asphalt pavement video data. J. Comput. Civ. Eng. 27(4), 370–378 (2013)
Lloyd, J.M.: Thermal Imaging Systems. Springer, New York (2013)
Chen, H., Yao, M., Gu, Q.: Pothole detection using location-aware convolutional neural networks. Int. J. Mach. Learn. Cybern. 11(4), 899–911 (2020)
Sathya, R., Saleena, B.: A Survey on Content Based Image Retrieval Using Convolutional Neural Networks. Int. J. Adv. Trends Comput. Sci. Eng. 9(5), 7387–7396 (2020)
Sathya, R., Rugveda Muralidhar, I., Sai Harsha Vardhan, K., Sri Karan, R., Arun Reddy, B.: Data Efficient approaches on Deep Action Recognition in Videos. Int. J. Eng. Adv. Technol. 8(4), 385–391 (2019)
Sathya, R., Rawat, D., Mondal, A., Choudhary, S., Jain A.: Economically Efficient Data Feature Selection using Big Data Analysis. Int. J. Eng. Innov. Technol. 8(7), 983–987 (2019)
Elliott, R.C., Day, D., Wilson, D.J.: An integrating detector for serial scan thermal imaging. Infrared Phys. 22(1), 31–42 (1982)
Holst, G.C.: Common Sense Approach to Thermal Imaging, vol. 1. SPIE Optical Engineering Press, Washington (2000)
Ouma, Y.O., Hahn, M.: Pothole detection on asphalt pavements from 2D-colour pothole images using fuzzy c-means clustering and morphological reconstruction. Autom. Constr. 83, 196–211 (2017)
Dhiman, A., Klette, R.: Pothole detection using computer vision and learning. IEEE Trans. Intell. Transp. Syst. 21(8), 3536–3550 (2019)
Fan, R., Ozgunalp, U., Hosking, B., Liu, M., Pita, I.: Pothole detection based on disparity transformation and road surface modeling. IEEE Trans. Image Process. 29, 897–908 (2019)
Forrest, M.M., Chen, Z., Hassan, S., Raymond, I.O., Alinani, K.: Cost effective surface disruption detection system for paved and unpaved roads. IEEE Access 6, 48634–48644 (2018)
Pereira, V.,Tamura, S., Hayamizu, S., Fukai, H.: A deep learning-based approach for road pothole detection in timorleste. In: 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), pp. 279–284. IEEE (2018)
Bhatia, Y., Rai, R., Gupta, V., Aggarwal, N., Akula, A.: Convolutional neural networks based potholes detection using thermal imaging. J. King Saud Univ. Comput. Inf. Sci. (2019)
Ukhwah, E.N., Yuniarno, E.M., Suprapto, Y.K.: Asphalt pavement pothole detection using deep learning method based on yolo neural network. In: 2019 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp. 35–40. IEEE (2019)
Anand, S., Gupta, S., Darbari, V., Kohli, S.: Crack-pot: autonomous road crack and pothole detection. In: 2018 Digital Image Computing: Techniques and Applications (DICTA), pp. 1–6. IEEE (2018)
Li, Y., Xiao, J., Chen, Y., Jiao, L.: Evolving deep convolutional neural networks by quantum behaved particle swarm optimization with binary encoding for image classification. Neurocomputing 362, 156–165 (2019)
Abualigah, L., Yousri, D., Abd Elaziz, M., Ewees, A.A., Al-qaness, M.A., Gandomi, A.H.: Aquila optimizer: a novel meta-heuristic optimization algorithm. Comput. Ind. Eng. (2021)
Kanagasabai, L.: Solving optimal reactive power problem by Alaskan Moose Hunting, Larus Livens and Green Lourie Swarm Optimization Algorithms. Ain Shams Eng. J. 11(4), 1227–1235 (2020)
Zhang, L., Zhang, Y., Tang, J., Lu, K., Tian, Q.: Binary code ranking with weighted hamming distance. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1586–1593 (2013)
Tanaka, T., Kawai, N., Nakashima, Y., Sato, T., Yokoya, N.: Iterative applications of image completion with CNN-based failure detection. J. Vis. Commun. Image Represent. 55, 56–66 (2018)
Chua, L.O.: CNN: a vision of complexity. Int. J. Bifurc. Chaos 7(10), 2219–2425 (1997)
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Sathya, R., Saleena, B. CNN-MAO: Convolutional Neural Network-based Modified Aquilla Optimization Algorithm for Pothole Identification from Thermal Images. SIViP 16, 2239–2247 (2022). https://doi.org/10.1007/s11760-022-02189-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-022-02189-0