Skip to main content

End-to-End Asbestos Roof Detection on Orthophotos Using Transformer-Based YOLO Deep Neural Network

  • Conference paper
  • First Online:
Image Analysis and Processing – ICIAP 2023 (ICIAP 2023)

Abstract

Asbestos, a hazardous material associated with severe health issues, requires accurate identification for safe management and removal. This study presents a novel end-to-end deep learning approach using a transformer-based YOLOv5 network for detecting asbestos roofs in high-resolution orthophotos, filling a gap in the scientific literature where end-to-end solutions are lacking. The model is trained on a dataset containing orthophotos with various roof types and conditions around Pisa in Italy. The transformer-based YOLO architecture enhances the detection capabilities compared to traditional CNNs. The proposed method demonstrates high accuracy in asbestos roof detection, outperforming traditional remote sensing techniques, and offers an effective, automated solution for targeting removal efforts and mitigating associated health risks. This end-to-end approach fills a gap in the existing literature and presents a promising direction for future research in asbestos roof detection.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. National Toxicology Program. RoC Profile: Asbestos; 15th RoC (2021). https://ntp.niehs.nih.gov/ntp/roc/content/profiles/asbestos.pdf

  2. World Health Organization. Asbestos: elimination of asbestos-related diseases, 15 February 2018. https://www.who.int/news-room/fact-sheets/detail/asbestos-elimination-of-asbestos-related-diseases

  3. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. arXiv preprint arXiv:1506.02640 (2015)

  4. Jocher, G.: ultralytics/yolov5: v3.1 - bug fixes and performance improvements. Zenodo, October 2020. https://doi.org/10.5281/zenodo.4154370

  5. Vaswani, A.: Attention is all you need. arXiv preprint arXiv:1706.03762 (2017)

  6. Liu, Z.: Hierarchical vision transformer using shifted windows. arXiv:2103.14030 (2021)

  7. Abbasi, M., Mostafa, S., Vieira, A.S., Patorniti, N., Stewart, R.A.: Mapping roofing with asbestos-containing material by using remote sensing imagery and machine learning-based image classification: a state-of-the-art review. Sustainability 14, 8068 (2022). https://www.mdpi.com/2071-1050/14/13/8068

  8. Raczko, E., Krówczyńska, M., Wilk, E.: Asbestos roofing recognition by use of convolutional neural networks and high-resolution aerial imagery. Testing different scenarios. Comput. Educ. (2022). https://doi.org/10.1016/j.buildenv.2022.109092

  9. Teng-To, Yu., Lin, Y.-C., Lan, S.-C., Yang, Y.-E., Pei-Yun, W., Lin, J.-C.: Mapping asbestos-cement corrugated roofing tiles with imagery cube via machine learning in Taiwan. Remote Sens. 14(14), 3418 (2022). https://doi.org/10.3390/rs14143418

    Article  Google Scholar 

  10. Seo, D.-M., Woo, H.-J., Kim, M.-S., Hong, W.-H., Kim, I.-H., Baek, S.-C.: Identification of asbestos slates in buildings based on faster region-based convolutional neural network (faster R-CNN) and drone-based aerial imagery. Drones 6, 194 (2022). https://doi.org/10.3390/drones6080194

    Article  Google Scholar 

  11. Hikuwai, M.V., Patorniti, N., Vieira, A.S., Frangioudakis Khatib, G., Stewart, R.A.: Artificial intelligence for the detection of asbestos cement roofing: an investigation of multi-spectral satellite imagery and high-resolution aerial imagery. Sustainability 15, 4276 (2023). https://www.mdpi.com/2071-1050/15/5/4276

  12. Jindal, M., Raj, N., Saranya, P., Sundarabalan, V.: Aircraft detection from remote sensing images using YOLOV5 architecture. In: 2022 6th International Conference on Devices, Circuits and Systems (ICDCS), pp. 332–336 (2022). https://doi.org/10.1109/ICDCS54290.2022.9780777

  13. Zhang, S., Zhang, F., Ding, Y., Li, Y.: Swin-YOLOv5: research and application of fire and smoke detection algorithm based on YOLOv5. Comput. Intell. Neurosci. 2022, 6081680 (2022). https://doi.org/10.1155/2022/6081680

  14. Wang, T., Liu, M., Zhang, H., Jiang, X., Huang, Y., Jiang, X.: Landslide detection based on improved YOLOv5 and satellite images. In: 2021 4th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), pp. 367–371 (2021). https://doi.org/10.1109/PRAI53619.2021.9551067

  15. Wang, C., Bochkovskiy, A., Liao, H.: YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors (2022). https://doi.org/10.48550/arXiv.2207.02696

  16. Jocher, G., Chaurasia, A., Qiu, J.: YOLO by Ultralytics (2023). https://github.com/ultralytics/ultralytics

  17. Everingham, M., Van Gool, L., Williams, C., Winn, J., Zisserman, A.: The PASCAL Visual Object Classes (VOC) challenge. Int. J. Comput. Vis. 88, 303–338 (2010)

    Google Scholar 

  18. Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement. CoRR. abs/1804.02767 (2018). http://arxiv.org/abs/1804.02767

  19. Liu, S., Qi, L., Qin, H., Shi, J., Jia, J.: Path aggregation network for instance segmentation (2018). https://doi.org/10.48550/arXiv.1803.01534

  20. Wang, C., Liao, H., Yeh, I., Wu, Y., Chen, P., Hsieh, J.: CSPNet: a new backbone that can enhance learning capability of CNN (2019). https://arxiv.org/abs/1911.11929

  21. He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 346–361. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10578-9_23

    Chapter  Google Scholar 

  22. Bochkovskiy, A., Wang, C., Liao, H.: YOLOv4: optimal speed and accuracy of object detection. CoRR. abs/2004.10934 (2020). https://arxiv.org/abs/2004.10934

  23. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., Zagoruyko, S.: End-to-end object detection with transformers. arXiv (2020). https://arxiv.org/abs/2005.12872

  24. Woo, S., Park, J., Lee, J., Kweon, I.: CBAM: convolutional block attention Module. CoRR. abs/1807.06521 (2018). http://arxiv.org/abs/1807.06521

  25. Zhu, X., Lyu, S., Wang, X., Zhao, Q.: TPH-YOLOv5: improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios. CoRR. abs/2108.11539 (2021). https://arxiv.org/abs/2108.11539

  26. Betancourt Tarifa, A.S., Marrocco, C., Molinara, M., et al.: Transformer-based mass detection in digital mammograms. J. Ambient Intell. Hum. Comput. 14, 2723–2737 (2023). https://doi.org/10.1007/s12652-023-04517-9

  27. Gong, H., et al.: Swin-transformer-enabled YOLOv5 with attention mechanism for small object detection on satellite images. Remote Sens. 14 (2022). https://www.mdpi.com/2072-4292/14/12/2861

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cesare Davide Pace .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pace, C.D. et al. (2023). End-to-End Asbestos Roof Detection on Orthophotos Using Transformer-Based YOLO Deep Neural Network. In: Foresti, G.L., Fusiello, A., Hancock, E. (eds) Image Analysis and Processing – ICIAP 2023. ICIAP 2023. Lecture Notes in Computer Science, vol 14233. Springer, Cham. https://doi.org/10.1007/978-3-031-43148-7_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43148-7_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43147-0

  • Online ISBN: 978-3-031-43148-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics