Skip to main content

Computer Vision and Hybrid Reality for Construction Safety Risks: A Pilot Study

  • Conference paper
  • First Online:
Fourth International Congress on Information and Communication Technology

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1027))

Abstract

Construction sites are among the most hazardous venues. While most of the previous research has shed light on the human aspect, we propose to utilise the fast R-CNN object detection method to detect the construction hazard on sites and employ mixed reality to enable the artificial intelligence to detect the hazard. Fast region-based convolutional neural network object detection acquires expert knowledge to identify objects in the image. Unlike image classification, the complexity of object detection always implies an increase in complexity which demands solutions with regard to speed, accuracy and simplicity.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Anders, P.: Cynergies: technologies that hybridize physical and cyberspaces. Paper presented at the 2003 ACADIA. Indianapolis, Indiana (2003)

    Google Scholar 

  2. Billinghurst, M., Kato, H.: Collaborative mixed reality. Paper presented at the 1st ISMAR. Yokohama, Japan (1999)

    Google Scholar 

  3. Broll, W., Lindt, I., Ohlenburg, J., Wittkamper, M., Yuan, C., Novotny, T., Mottram, C., Gen Schieck, A.F., Strothman, A.: ARTHUR: a collaborative augmented environment for architectural design and urban planning. J. Virtual Reality Broadcast. 1(1), 1–10 (2004)

    Google Scholar 

  4. Dunston, P.S., Shin, D.H.: Key areas and issues for augmented reality application on construction sites. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordercht, The Netherlands (2009)

    Google Scholar 

  5. Dunston, P.S., Wang, X.: Mixed reality-based visualization interfaces for architecture, engineering, and construction industry. Ind. J. Constr. Eng. Manag. 131(12), 1301–1309 (2005)

    Article  Google Scholar 

  6. Fang, Q., Li, H., Luo, X., Ding, L., Luo, H., Li, C.: Computer vision aided inspection on falling prevention measures for steeplejacks in an aerial environment. Autom. Constr. 93, 148–164 (2018)

    Article  Google Scholar 

  7. Fang, Q., Li, H., Luo, X., Ding, L., Luo, H., Rose, T.M., An, W.: Detecting non-hardhat-use by a deep learning method from far-field surveillance videos. Autom. Constr. 85, 1–9 (2018)

    Article  Google Scholar 

  8. Fang, W., Ding, L., Luo, H., Love, P.E.D.: Falls from heights: a computer vision-based approach for safety harness detection. Autom. Constr. 91, 53–61 (2018)

    Article  Google Scholar 

  9. Hammad, A.: Distributed augmented reality for visualising collaborative construction tasks. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordrecht, The Netherlands (2009)

    Google Scholar 

  10. Li, R.Y.M.: An Economic Analysis on Automated Construction Safety: Internet of Things, Artificial Intelligence and 3D Printing. Springer, Singapore (2018)

    Book  Google Scholar 

  11. Li, R.Y.M., Poon, S.W.: Construction Safety. Springer, Berlin (2013)

    Book  Google Scholar 

  12. Li, J., Zhang, D., Zhang, J., Zhang, J., Li, T., Xia, Y., Yan, Q., Xun, L.: Facial expression recognition with Faster R-CNN. Proc. Comput. Sci. 107, 135–140 (2017)

    Article  Google Scholar 

  13. Li, X., Ye, M., Liu, Y., Zhang, F., Liu, D., Tang, S.: Accurate object detection using memory-based models in surveillance scenes. Pattern Recognit. 67, 73–84 (2017)

    Article  Google Scholar 

  14. Li, S., Lin, J., Li, G., Bai, T., Wang, H., Pang, Y.: Vehicle type detection based on deep learning in traffic scene. Proc. Comput. Sci. 131, 564–572 (2018)

    Article  Google Scholar 

  15. Milgram, P., Colquhoun, H.: A taxonomy of real and virtual world display integration. In: Ohta, Y., Tamura, H. (eds.) Mixed Reality: Merging Real and Virtual Worlds. Springer, Berlin, Heidelberg, Germany (2001)

    Google Scholar 

  16. Rackliffe, N.: An augmented virtuality display for improving UAV usability. MITRE technical papers. MITRE (2005)

    Google Scholar 

  17. Regenbrecht, H., Lum, T., Kohler, P., Ott, C., Wagner, M., Wilke, W., Mueller, E.: Using augmented virtuality for remote collaboration. Presence teleop. Virt. Environ. 13(3), 338–354 (2004)

    Article  Google Scholar 

  18. Schmalstieg, D., Fuhrmann, A., Hesina, G., Szalavari, Z., Encarnacao, M.L., Gervautz, M., Purgathofer, W.: The studierstube augmented reality project. Presence Teleop. Virt. Environ. 11(1), 33–54 (2002)

    Article  Google Scholar 

  19. Schnabel, M.A.: Framing mixed realities. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordrecht, The Netherlands (2009)

    Google Scholar 

  20. Schnabel, M. A., Wang, X., Seichter, H., Kvan, T.: From virtuality to reality and back. Paper presented at the 12th IASDR. Hong Kong (2007)

    Google Scholar 

  21. Seichter, H., Schnabel, M.A.: Digital and tangible sensation: an augmented reality urban design studio. Paper presented at the 10th CAADRIA. New Delhi, India (2005)

    Google Scholar 

  22. Seichter, H.: Sketchand+: a collaborative augmented reality sketching application. Paper presented at the 8th CAADRIA, Bangkok, Thailand (2003)

    Google Scholar 

  23. Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., Lillicrap, T., Simonyan, K., Hassabis, D.: A general reinforcement learning algorithm that masters chess, shogi, and go through self-play. Science 362(6419), 1140–1144 (2018)

    Article  MathSciNet  Google Scholar 

  24. Tonnis, M., Klinker, G.: Augmented 3D arrows reach their limits in automotive environments. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordrecht, The Netherlands (2009)

    Google Scholar 

  25. Xu, Y., Yu, G., Wang, Y., Wu, X., Ma, Y.: Car detection from low-altitude UAV imagery with the Faster R-CNN. J. Adv. Transp. (2017)

    Google Scholar 

  26. Zhao, Z.-Q., Bian, H., Hu, D., Cheng, W., Glotin, H.: Pedestrian detection based on fast R-CNN and batch normalization. Paper presented at the ICIC 2017. Liverpool, UK (2017)

    Google Scholar 

Download references

Acknowledgements

Ocular behaviour, construction hazard awareness and an AI chatbot UGC/FDS15/E01/18.

Willingness to share construction safety knowledge via Web 2.0, mobile apps and IoT, RGC grant, UGC/FDS15/E01/17.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rita Yi Man Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, R.Y.M., Leung, T.H. (2020). Computer Vision and Hybrid Reality for Construction Safety Risks: A Pilot Study. In: Yang, XS., Sherratt, S., Dey, N., Joshi, A. (eds) Fourth International Congress on Information and Communication Technology. Advances in Intelligent Systems and Computing, vol 1027. Springer, Singapore. https://doi.org/10.1007/978-981-32-9343-4_2

Download citation

  • DOI: https://doi.org/10.1007/978-981-32-9343-4_2

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-32-9342-7

  • Online ISBN: 978-981-32-9343-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics