Abstract
Construction sites are among the most hazardous venues. While most of the previous research has shed light on the human aspect, we propose to utilise the fast R-CNN object detection method to detect the construction hazard on sites and employ mixed reality to enable the artificial intelligence to detect the hazard. Fast region-based convolutional neural network object detection acquires expert knowledge to identify objects in the image. Unlike image classification, the complexity of object detection always implies an increase in complexity which demands solutions with regard to speed, accuracy and simplicity.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Anders, P.: Cynergies: technologies that hybridize physical and cyberspaces. Paper presented at the 2003 ACADIA. Indianapolis, Indiana (2003)
Billinghurst, M., Kato, H.: Collaborative mixed reality. Paper presented at the 1st ISMAR. Yokohama, Japan (1999)
Broll, W., Lindt, I., Ohlenburg, J., Wittkamper, M., Yuan, C., Novotny, T., Mottram, C., Gen Schieck, A.F., Strothman, A.: ARTHUR: a collaborative augmented environment for architectural design and urban planning. J. Virtual Reality Broadcast. 1(1), 1–10 (2004)
Dunston, P.S., Shin, D.H.: Key areas and issues for augmented reality application on construction sites. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordercht, The Netherlands (2009)
Dunston, P.S., Wang, X.: Mixed reality-based visualization interfaces for architecture, engineering, and construction industry. Ind. J. Constr. Eng. Manag. 131(12), 1301–1309 (2005)
Fang, Q., Li, H., Luo, X., Ding, L., Luo, H., Li, C.: Computer vision aided inspection on falling prevention measures for steeplejacks in an aerial environment. Autom. Constr. 93, 148–164 (2018)
Fang, Q., Li, H., Luo, X., Ding, L., Luo, H., Rose, T.M., An, W.: Detecting non-hardhat-use by a deep learning method from far-field surveillance videos. Autom. Constr. 85, 1–9 (2018)
Fang, W., Ding, L., Luo, H., Love, P.E.D.: Falls from heights: a computer vision-based approach for safety harness detection. Autom. Constr. 91, 53–61 (2018)
Hammad, A.: Distributed augmented reality for visualising collaborative construction tasks. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordrecht, The Netherlands (2009)
Li, R.Y.M.: An Economic Analysis on Automated Construction Safety: Internet of Things, Artificial Intelligence and 3D Printing. Springer, Singapore (2018)
Li, R.Y.M., Poon, S.W.: Construction Safety. Springer, Berlin (2013)
Li, J., Zhang, D., Zhang, J., Zhang, J., Li, T., Xia, Y., Yan, Q., Xun, L.: Facial expression recognition with Faster R-CNN. Proc. Comput. Sci. 107, 135–140 (2017)
Li, X., Ye, M., Liu, Y., Zhang, F., Liu, D., Tang, S.: Accurate object detection using memory-based models in surveillance scenes. Pattern Recognit. 67, 73–84 (2017)
Li, S., Lin, J., Li, G., Bai, T., Wang, H., Pang, Y.: Vehicle type detection based on deep learning in traffic scene. Proc. Comput. Sci. 131, 564–572 (2018)
Milgram, P., Colquhoun, H.: A taxonomy of real and virtual world display integration. In: Ohta, Y., Tamura, H. (eds.) Mixed Reality: Merging Real and Virtual Worlds. Springer, Berlin, Heidelberg, Germany (2001)
Rackliffe, N.: An augmented virtuality display for improving UAV usability. MITRE technical papers. MITRE (2005)
Regenbrecht, H., Lum, T., Kohler, P., Ott, C., Wagner, M., Wilke, W., Mueller, E.: Using augmented virtuality for remote collaboration. Presence teleop. Virt. Environ. 13(3), 338–354 (2004)
Schmalstieg, D., Fuhrmann, A., Hesina, G., Szalavari, Z., Encarnacao, M.L., Gervautz, M., Purgathofer, W.: The studierstube augmented reality project. Presence Teleop. Virt. Environ. 11(1), 33–54 (2002)
Schnabel, M.A.: Framing mixed realities. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordrecht, The Netherlands (2009)
Schnabel, M. A., Wang, X., Seichter, H., Kvan, T.: From virtuality to reality and back. Paper presented at the 12th IASDR. Hong Kong (2007)
Seichter, H., Schnabel, M.A.: Digital and tangible sensation: an augmented reality urban design studio. Paper presented at the 10th CAADRIA. New Delhi, India (2005)
Seichter, H.: Sketchand+: a collaborative augmented reality sketching application. Paper presented at the 8th CAADRIA, Bangkok, Thailand (2003)
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., Lillicrap, T., Simonyan, K., Hassabis, D.: A general reinforcement learning algorithm that masters chess, shogi, and go through self-play. Science 362(6419), 1140–1144 (2018)
Tonnis, M., Klinker, G.: Augmented 3D arrows reach their limits in automotive environments. In: Wang, X., Schnabel, M.A. (eds.) Mixed Reality in Architecture, Design and Construction. Springer, Dordrecht, The Netherlands (2009)
Xu, Y., Yu, G., Wang, Y., Wu, X., Ma, Y.: Car detection from low-altitude UAV imagery with the Faster R-CNN. J. Adv. Transp. (2017)
Zhao, Z.-Q., Bian, H., Hu, D., Cheng, W., Glotin, H.: Pedestrian detection based on fast R-CNN and batch normalization. Paper presented at the ICIC 2017. Liverpool, UK (2017)
Acknowledgements
Ocular behaviour, construction hazard awareness and an AI chatbot UGC/FDS15/E01/18.
Willingness to share construction safety knowledge via Web 2.0, mobile apps and IoT, RGC grant, UGC/FDS15/E01/17.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Li, R.Y.M., Leung, T.H. (2020). Computer Vision and Hybrid Reality for Construction Safety Risks: A Pilot Study. In: Yang, XS., Sherratt, S., Dey, N., Joshi, A. (eds) Fourth International Congress on Information and Communication Technology. Advances in Intelligent Systems and Computing, vol 1027. Springer, Singapore. https://doi.org/10.1007/978-981-32-9343-4_2
Download citation
DOI: https://doi.org/10.1007/978-981-32-9343-4_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-32-9342-7
Online ISBN: 978-981-32-9343-4
eBook Packages: EngineeringEngineering (R0)