Skip to main content

Advertisement

Log in

CNN-MAO: Convolutional Neural Network-based Modified Aquilla Optimization Algorithm for Pothole Identification from Thermal Images

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Potholes are the most common cause of accidents on the road surface, and the primary cause is water. Potholes in the pavement can be formed by a number of things, including gasoline or fuel leaks, automobile smearing, and the disposal of rock cuttings. As a result, in order to avoid accidents, it is essential to identify the pothole in advance, either automatically or manually. There are several ways to detect the pothole manually, nonetheless, they consume more time, power, and high setup cost. However, the automatic detection follows an optical imaging system, and the detection of pothole during bad weather conditions and night-time become arduous. Hence we proposed a novel method to detect the pothole by using a thermal imaging system known as convolutional neural network (CNN)-based modified aquilla optimization (AO) algorithm. The proposed method follows Data acquisition, Image preprocessing, and Data augmentation processes prior to the application of classification tasks. The proposed CNN-based Modified AO approach enhances the classification accuracy, precision, recall, and F1-score. However, it minimizes the classification error and detection time. The performances of our proposed work are compared with other approaches such as CNN, CNN-TI, YOLO-NN, and DNN. The experimental analysis also depicts that our proposed work has better performances than the other approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Explore related subjects

Discover the latest articles and news from researchers in related subjects, suggested using machine learning.

References

  1. Song, H., Baek, K., Byun, Y.: Pothole detection using machine learning. In: Advanced Science and Technology, pp. 151–155 (2018)

  2. Sharma, S.K., Sharma, R.C.: Pothole detection and warning system for indian roads. In: Advances in Interdisciplinary Engineering, pp. 511–519. Springer, Singapore (2019)

  3. Koch, C., Jog, G.M., Brilakis, I.: Automated pothole distress assessment using asphalt pavement video data. J. Comput. Civ. Eng. 27(4), 370–378 (2013)

    Article  Google Scholar 

  4. Lloyd, J.M.: Thermal Imaging Systems. Springer, New York (2013)

    Google Scholar 

  5. Chen, H., Yao, M., Gu, Q.: Pothole detection using location-aware convolutional neural networks. Int. J. Mach. Learn. Cybern. 11(4), 899–911 (2020)

    Article  Google Scholar 

  6. Sathya, R., Saleena, B.: A Survey on Content Based Image Retrieval Using Convolutional Neural Networks. Int. J. Adv. Trends Comput. Sci. Eng. 9(5), 7387–7396 (2020)

    Article  Google Scholar 

  7. Sathya, R., Rugveda Muralidhar, I., Sai Harsha Vardhan, K., Sri Karan, R., Arun Reddy, B.: Data Efficient approaches on Deep Action Recognition in Videos. Int. J. Eng. Adv. Technol. 8(4), 385–391 (2019)

    Google Scholar 

  8. Sathya, R., Rawat, D., Mondal, A., Choudhary, S., Jain A.: Economically Efficient Data Feature Selection using Big Data Analysis. Int. J. Eng. Innov. Technol. 8(7), 983–987 (2019)

    Google Scholar 

  9. Elliott, R.C., Day, D., Wilson, D.J.: An integrating detector for serial scan thermal imaging. Infrared Phys. 22(1), 31–42 (1982)

    Article  Google Scholar 

  10. Holst, G.C.: Common Sense Approach to Thermal Imaging, vol. 1. SPIE Optical Engineering Press, Washington (2000)

    Book  Google Scholar 

  11. Ouma, Y.O., Hahn, M.: Pothole detection on asphalt pavements from 2D-colour pothole images using fuzzy c-means clustering and morphological reconstruction. Autom. Constr. 83, 196–211 (2017)

    Article  Google Scholar 

  12. Dhiman, A., Klette, R.: Pothole detection using computer vision and learning. IEEE Trans. Intell. Transp. Syst. 21(8), 3536–3550 (2019)

    Article  Google Scholar 

  13. Fan, R., Ozgunalp, U., Hosking, B., Liu, M., Pita, I.: Pothole detection based on disparity transformation and road surface modeling. IEEE Trans. Image Process. 29, 897–908 (2019)

    Article  MathSciNet  Google Scholar 

  14. Forrest, M.M., Chen, Z., Hassan, S., Raymond, I.O., Alinani, K.: Cost effective surface disruption detection system for paved and unpaved roads. IEEE Access 6, 48634–48644 (2018)

    Article  Google Scholar 

  15. Pereira, V.,Tamura, S., Hayamizu, S., Fukai, H.: A deep learning-based approach for road pothole detection in timorleste. In: 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), pp. 279–284. IEEE (2018)

  16. Bhatia, Y., Rai, R., Gupta, V., Aggarwal, N., Akula, A.: Convolutional neural networks based potholes detection using thermal imaging. J. King Saud Univ. Comput. Inf. Sci. (2019)

  17. Ukhwah, E.N., Yuniarno, E.M., Suprapto, Y.K.: Asphalt pavement pothole detection using deep learning method based on yolo neural network. In: 2019 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp. 35–40. IEEE (2019)

  18. Anand, S., Gupta, S., Darbari, V., Kohli, S.: Crack-pot: autonomous road crack and pothole detection. In: 2018 Digital Image Computing: Techniques and Applications (DICTA), pp. 1–6. IEEE (2018)

  19. Li, Y., Xiao, J., Chen, Y., Jiao, L.: Evolving deep convolutional neural networks by quantum behaved particle swarm optimization with binary encoding for image classification. Neurocomputing 362, 156–165 (2019)

    Article  Google Scholar 

  20. Abualigah, L., Yousri, D., Abd Elaziz, M., Ewees, A.A., Al-qaness, M.A., Gandomi, A.H.: Aquila optimizer: a novel meta-heuristic optimization algorithm. Comput. Ind. Eng. (2021)

  21. Kanagasabai, L.: Solving optimal reactive power problem by Alaskan Moose Hunting, Larus Livens and Green Lourie Swarm Optimization Algorithms. Ain Shams Eng. J. 11(4), 1227–1235 (2020)

    Article  Google Scholar 

  22. Zhang, L., Zhang, Y., Tang, J., Lu, K., Tian, Q.: Binary code ranking with weighted hamming distance. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1586–1593 (2013)

  23. Tanaka, T., Kawai, N., Nakashima, Y., Sato, T., Yokoya, N.: Iterative applications of image completion with CNN-based failure detection. J. Vis. Commun. Image Represent. 55, 56–66 (2018)

    Article  Google Scholar 

  24. Chua, L.O.: CNN: a vision of complexity. Int. J. Bifurc. Chaos 7(10), 2219–2425 (1997)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to R. Sathya.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sathya, R., Saleena, B. CNN-MAO: Convolutional Neural Network-based Modified Aquilla Optimization Algorithm for Pothole Identification from Thermal Images. SIViP 16, 2239–2247 (2022). https://doi.org/10.1007/s11760-022-02189-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-022-02189-0

Keywords