Abstract
Road quality significantly influences safety and comfort while driving. Especially for most kinds of two-wheelers, road damage is a real threat, where vehicle components and enjoyment are heavily impacted by road quality. This can be avoided by planning a route considering the surface quality. We propose a new publicly available and manually annotated dataset collected from Google Street View photos. This dataset is devoted to a road quality classification task considering six levels of damage. We evaluated some preprocessing methods such as shadow removal, CLAHE, and data augmentation. We adapted several pre-trained networks to classify road quality. The best performance was reached by MobileNet using augmented dataset (75.55%).
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
- 3.
- 4.
Including output classification layers for the ImageNet dataset.
References
Anaconda software distribution (2020). https://docs.anaconda.com/
Afenika, A., Gunawan, P.H., Tarwidi, D.: Classification of road surface quality based on SVM method. J. Phys. Conf. Ser. 1641, 012064 (2020). https://doi.org/10.1088/1742-6596/1641/1/012064
Arya, D., et al.: Transfer learning-based road damage detection for multiple countries (2020)
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: Smote: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321–357 (6 2002). https://doi.org/10.1613/jair.953, http://dx.doi.org/10.1613/jair.953
Chollet, F.: Xception: deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (July 2017)
Cimpoi, M., Maji, S., Kokkinos, I., Vedaldi, A.: Deep filter banks for texture recognition, description, and segmentation (2015)
Cun, X., Pun, C.M., Shi, C.: Towards ghost-free shadow removal via dual hierarchical aggregation network and shadow matting gan (2019)
Doshi, K., Yilmaz, Y.: Road damage detection using deep ensemble learning (2020)
Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: the kitti dataset. Int. J. Robot. Res. (IJRR) (2013). http://www.cvlibs.net/datasets/kitti/raw_data.php
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT Press, Cambridge (2016)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition (2015)
Hoffmann, M., Mock, M., May, M.: Road-quality classification and bump detection with bicycle-mounted smartphones. In: CEUR Workshop Proceedings, vol. 1088, pp. 39–43 (01 2013)
Howard, A.G., et al.: Mobilenets: Efficient convolutional neural networks for mobile vision applications. CoRR abs/1704.04861 (2017)
Huang, G., Liu, Z., van der Maaten, L., Weinberger, K.Q.: Densely connected convolutional networks (2018)
Lei, X., Liu, C., Li, L., Wang, G.: Automated pavement distress detection and deterioration analysis using street view map. IEEE Access 8, 76163–76172 (2020). https://doi.org/10.1109/ACCESS.2020.2989028
Ma, K., Hoai, M., Samaras, D.: Large-scale continual road inspection: visual infrastructure assessment in the wild. In: Proceedings of British Machine Vision Conference (2017). https://www3.cs.stonybrook.edu/~cvl/pavement.html
Maddern, W., Pascoe, G., Linegar, C., Newman, P.: 1 Year, 1000 km: the oxford robotcar dataset. Int. J. Robot. Res. (IJRR) 36(1), 3–15 (2017)
Nolte, M., Kister, N., Maurer, M.: Assessment of deep convolutional neural networks for road surface classification. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pp. 381–386 (2018). https://doi.org/10.1109/ITSC.2018.8569396
Pei, Z., Zhang, X., Lin, R., Shen, H., Tang, J., Yang, Y.: Submission of dd-vision team in global road damage detection 2020 (2020). password: xzc6, https://pan.baidu.com/s/1VjLuNBVJGS34mMMpDkDRGQ,
Pezzementi, Z., et al.: Comparing apples and oranges: off-road pedestrian detection on the NREC agricultural person-detection dataset (2017)
Rateke, T., Justen, K.A., von Wangenheim, A.: Road surface classification with images captured from low-cost cameras - road traversing knowledge (RTK) dataset. Revista de Informática Teórica e Aplicada (RITA) (2019)
Russakovsky, O., et al.: ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115(3), 211–252 (2015). https://doi.org/10.1007/s11263-015-0816-y
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L.C.: Mobilenetv 2: inverted residuals and linear bottlenecks (2019)
Shinzato, P.Y., et al.: Carina dataset: an emerging-country urban scenario benchmark for road detection systems. In: 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC) (2016). https://doi.org/10.1109/ITSC.2016.7795529, dataset available from: http://www.lrm.icmc.usp.br/web/index.php?n=DataSet.Home
Smith, M., Baldwin, I., Churchill, W., Paul, R., Newman, P.: The new college vision and laser data set. Int. J. Robot. Res. 28, 595–599 (2009). https://doi.org/10.1177/0278364909103911
Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.: Inception-v4, inception-resnet and the impact of residual connections on learning (2016)
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision (June 2016). https://doi.org/10.1109/CVPR.2016.308
Tan, M., Le, Q.V.: Efficientnet: rethinking model scaling for convolutional neural networks (2020)
Tan, M., Le, Q.V.: Efficientnetv2: smaller models and faster training (2021)
Tiwari, S., Bhandari, R., Raman, B.: Roadcare: a deep-learning based approach to quantifying road surface quality. In: Proceedings of the 3rd ACM SIGCAS Conference on Computing and Sustainable Societies, pp. 231–242. COMPASS 2020, Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3378393.3402284
Zanin, M., Messelodi, S., Modena, C.: Diplodoc road stereo sequence (April 2013). https://doi.org/10.13140/RG.2.1.3681.9929, dataset available from: https://tev.fbk.eu/databases/diplodoc-road-stereo-sequence
Zuiderveld, K.: Contrast limited adaptive histogram equalization. Graph. Gems IV, 474–485 (1994)
Acknowledgements
This research has been supported by SGS grant No. SGS20/213/OHK3/3T/18 and by GACR grant No. GA18-18080S.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lank, M., Friedjungová, M. (2022). Road Quality Classification. In: Sclaroff, S., Distante, C., Leo, M., Farinella, G.M., Tombari, F. (eds) Image Analysis and Processing – ICIAP 2022. ICIAP 2022. Lecture Notes in Computer Science, vol 13232. Springer, Cham. https://doi.org/10.1007/978-3-031-06430-2_46
Download citation
DOI: https://doi.org/10.1007/978-3-031-06430-2_46
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-06429-6
Online ISBN: 978-3-031-06430-2
eBook Packages: Computer ScienceComputer Science (R0)