Skip to main content
SpringerLink
Log in

Feasibility of real-time graphical simulation for active monitoring of visibility-constrained construction processes

  • Original Article
  • Published:
Engineering with Computers Aims and scope Submit manuscript

Abstract

The lack of clear visibility and spatial awareness frequently results in construction accidents such as workers being struck by heavy equipment; and collisions between equipment and workers or between two pieces of equipment. In addition, certain processes such as excavation and drilling inherently pose constraints on equipment operators’ abilities to clearly perceive and analyze their working environment. In this paper, the authors investigate the types of spatial interactions on construction sites and the need for graphical real-time monitoring. A computing framework is presented for monitoring interactions between mobile construction equipment and static job-site entities, workers, and other equipment. The framework is based on the use of sensor-based tracking, georeferenced models, and a resulting concurrent, evolving 3D graphical database. The developed framework enables a real-time 3D visualization scheme that provides equipment operators with graphical job-site views that are not possible through conventional on-site cameras. The two key parameters affecting a proximity monitoring framework’s effectiveness are measurement error and latency. Measurement error refers to the error in proximity computation—with respect to ground truth or theoretically expected values. Latency is a difference in the time between when an event occurs in the real world and when a proximity monitoring framework provides output to warning systems that end users depend upon. Results from validation experiments conducted to analyze the achievable measurement error and latency of the monitoring framework using indoor GPS tracking as a ground truth system are also presented and discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. Alagasco (2012) Know what’s below—always call 811 before you dig. http://blog.alagasco.com/know-whats-below-always-call-811-before-you-dig/. Accessed 06 Sep 2012

  2. Arditi D, Ayrancioglu M, Shu J (2005) Worker safety issues in nighttime highway construction. Eng Constr Archit Manag 12(5):487–501

    Article  Google Scholar 

  3. Bajaj C, Wyvill B, Bloomenthal J, Guo B, Hart J, Wyvill G (1996) Implicit surfaces for geometric modeling and computer graphics. SIGGRAPH Lecture 1996. http://www.cs.princeton.edu/courses/archive/fall02/cs526/papers/course11sig96.pdf. Accessed 17 June 2012

  4. Bowman D (2008) Real-time 3D graphics for VEs. http://courses.cs.vt.edu/~cs5754/lectures/rtgraphics.pdf. Accessed 26 Jul 2012

  5. Bryson S (1993) Effects of lag and frame rate on various tracking tasks. In: Proceedings of SPIE stereoscopic displays and applications, vol 1915

  6. Bureau of Labor Statistics (2012) Census of fatal occupational injuries. http://www.bls.gov/iif/oshcfoi1.htm#2009. Accessed 17 Jun 2012

  7. Chen JYC, Haas EC, Barnes MJ (2007) Human performance issues and user interface design for teleoperated robots. IEEE Trans Syst Man Cybern Part C Appl Rev 37:1231–1245

    Article  Google Scholar 

  8. Cheng T, Teizer J (2011) Crane operator visibility of ground operations. In: Proceedings of the 28th ISARC, 2011, Seoul, Korea, pp 699–705

  9. Cheng T, Venugopal M, Teizer J, Vela PA (2011) Performance evaluation of ultra wideband technology for construction resource location tracking in harsh environments. Autom Constr 20(8):1173–1184

    Article  Google Scholar 

  10. Chi S, Caldas C, Gong J (2008) A crash avoidance framework for heavy equipment control systems using 3D imaging sensors. ITCON 13:118–133

    Google Scholar 

  11. Cho Y, Haas C, Liapi K, Sreenivasan SV (2002) A framework for rapid local area modeling for construction automation. Autom Constr 11(6):629–641

    Article  Google Scholar 

  12. Dana PH (2000) Unit 017—global positioning system overview. http://www.ncgia.ucsb.edu/giscc/units/u017/u017.html. Accessed 17 Jun 2012

  13. Dasgupta S, Banerjee A (2006) An augmented-reality-based real-time panoramic vision system for autonomous navigation. IEEE Trans Syst Man Cybern Part A 36(1):154–161

    Article  Google Scholar 

  14. Durikovic R (2012) Lecture 13: representation of solids. http://www.sccg.sk/~durikovic/classes/MRT/3DModeling3%20Representation.pdf. Accessed 17 Jun 2012

  15. Federal Highway Administration (FHWA) (2012) Worker safety. http://www.ops.fhwa.dot.gov/wz/workersafety/index.htm. Accessed 17 Jun 2012

  16. Foley JD, van Dam A, Feiner SK, Hughes J (1992) Computer graphics: principles and practice, 2nd edn. Addison Wesley, Reading, pp 533–562

  17. Geokov (2012) UTM—Universal Transverse Mercator Projection. http://geokov.com/Education/utm.aspx. Accessed 17 Jun 2012

  18. Gottschalk S, Lin MC, Manocha D (1996) Obbtree: a hierarchical structure for rapid interference detection. In: Proceedings of SIGGRAPH’96, 1996

  19. Hearn D, Baker MP (1994) Computer graphics, 2nd edn. Prentice Hall, Englewood Cliffs, pp 355–362

  20. Hine III BP, Stoker C, Sims M, Rasmussen D, Hontalas P, Fong TW, Steele J, Barch D, Andersen D, Miles E, Nygren E (1994) The application of telepresence and virtual reality to subsea exploration. In: The 2nd workshop on mobile robots for subsea environments, Proceedings of ROV’94, May 1994

  21. Hinze JW, Teizer J (2011) Visibility-related fatalities related to construction equipment. Saf Sci 49(2011):709–718

    Article  Google Scholar 

  22. Huang X, Bernold L (1997) CAD integrated excavation and pipe laying. J Constr Eng Manag 123(3):318–323

    Article  Google Scholar 

  23. Huber D, Herman H, Kelly A, Rander P, Warner R (2009) Real-time photorealistic visualization of 3D environments for enhanced teleoperation of vehicles. In: Proceedings of the 2nd international conference on 3D digital imaging and modeling, Kyoto, Japan

  24. Hwang S (2011) Ultra-wideband technology experiments for real-time prevention of tower crane collisions. Autom Constr 22:545–553

    Article  Google Scholar 

  25. Kamat VR, Martinez JC (2005) Dynamic 3D visualization of articulated construction equipment. J Comput Civil Eng 19(4):356–368

    Article  Google Scholar 

  26. Kamat VR, Martinez JC (2007) Interactive collision detection in three-dimensional visualizations of simulated construction operations. Eng Comput 23(2):79–91

    Google Scholar 

  27. Kim CW, Haas CT, Liapi KA, Caldas CH (2006) Human-assisted obstacle avoidance system using 3D workspace modeling for construction equipment operation. J Constr Eng Manag 20(3):177–186

    MATH  Google Scholar 

  28. Kini AP, King K, Kang S (2009) Sensor calibration and real-time tracking of a backhoe loader using the iGPS system. Qual Dig Mag. http://www.qualitydigest.com/inside/cmsc-article/sensor-calibration-and-real-time-tracking-backhoe-loader-using-igps-system.html. Accessed 17 June 2012

  29. Kwon S, Bosche F, Kim C, Haas CT, Liapi K (2004) Fitting range data to primitives for rapid local 3D modeling using sparse range point clouds. J Autom Constr 13(1):67–81

    Article  Google Scholar 

  30. Larsen E, Gottschalk S, Lin MC, Manocha D (1999) Fast proximity queries with sphere swept volumes. Technical report TR99-018, Department of Computer Science, UNC Chapel Hill. http://gamma.cs.unc.edu/SSV/ssv.pdf. Accessed 22 June 2011

  31. Liang X, Lu M (2012) Real-time 3D positioning and visualization of articulated construction equipment: case of backhoe excavators. In: Proceedings of the international workshop on computing in civil engineering. ASCE, Clearwater Beach

  32. Lin MC, Gottschalk S (1998) Collision detection between geometric models: a survey. ftp://cs.unc.edu/pub/users/lin/cms98.pdf. Accessed 19 Nov 2011

  33. Lodha S, Charaniya AP, Faaland NM, Ramalingam S (2002) Visualization of spatiotemporal GPS uncertainty within a GIS environment. In: Proceedings of SPIE conference on radar sense technology and data visualization, pp 216–227, April 2002

  34. MacCollum DV (1995) Construction safety planning. Wiley, New York, pp 53–54

    Google Scholar 

  35. Malhotra P (2002) Issues involved in real-time rendering of virtual environments. Master’s thesis, Faculty of Virginia Polytechnic, 2002

  36. Marks E, Teizer J (2012) Safety first: real-time proactive equipment operator and ground worker warning and alert system in steel manufacturing. Iron Steel Technol AIST 9(10):56–69

    Google Scholar 

  37. McHenry K, Bajcsy P (2008) An overview of 3D data content, file formats and viewers. Technical Report ISDA08-02, 2008

  38. Nagle J (1984) Congestion control in IP/TCP internetworks, RFC-896. Internet Eng Task Force. http://tools.ietf.org/pdf/rfc896.pdf. Accessed 26 Jul 2012

  39. National Fuel (2012) National fuel reminds customers to call before you dig. http://www.natfuel.com/news/04-25-12%20Call%20Before%20You%20Dig%20-%20WEB4252012-123657.pdf. Accessed 06 Oct 2012

  40. New Jersey One Call (2011) A guide to safe excavation practices in New Jersey. http://www.pseg.com/business/local_government/safety/pdf/booklet.pdf. Accessed 06 Sep 2012

  41. Nikon Metrology Inc. (2012) iGPS. http://www.nikonmetrology.com/en_US/Products/Large-Volume-Applications/iGPS/iGPS/(brochure). Accessed 17 Jun 2012

  42. PQP Gamma (1999) PQP—a proximity query package. http://gamma.cs.unc.edu/SSV/. Accessed 22 Jun 2011

  43. Occupational Safety and Health Administration (2010). http://www.osha.gov/pls/oshaweb/owadisp.show_document?p_table=INTERPRETATIONS&p_id=27308. Accessed 17 Jun 2012

  44. Oloufa A, Ikeda M, Hiroshi O (2002) GPS-based wireless collision detection of construction equipment. In: Proceedings of the 19th international symposium on automation and robotics in construction, ISARC. National Institute of Standards and Technology, Gaithersburg, pp 461–466

  45. PHMSA (2012) Significant pipeline incidents through 2010 by cause. http://primis.phmsa.dot.gov/comm/reports/safety/SigPSIDet_2001_2010_US.html?nocache=9140#all. Accessed 11 Jan 2012

  46. Preston R, Doane J, Kiwio D (2005) Using real world data to create OPNET Models DRAFT. The MITRE Corporation. http://www.mitre.org/work/tech_papers/tech_papers_05/05_0850/05_0850.pdf. Accessed 17 Jun 2012

  47. Ruff TM, Hession-Kunz D (2001) Application of radio-frequency identification systems to collision avoidance in metal/nonmetal mines. IEEE Trans on Ind Appl 37(1):112–116

    Google Scholar 

  48. Schiffbauer WH, Mowrey GL (2001) An environmentally robust proximity warning system for hazardous areas. In: Proceedings of the ISA emerging technologies conference, Triangle Park, NC, vol 2091, p 10

  49. Shen C, O’Brien JF, Shewchuck JR (2004) Interpolating and approximating implicit surfaces from polygon soup. ACM Trans Graph 23(3):896–904

    Article  Google Scholar 

  50. Son H, Kim Ch, Kim H, Choi K-N, Jee J-M (2008) Real-time object recognition and modeling for heavy-equipment operation. In: Proceedings of the 25th international symposium on automation and robotics in construction, Vilnius, 2008, pp 232–237

  51. Son H, Kim C, Choi K (2010) Rapid 3D object detection and modeling using range data from 3D range imaging camera for heavy equipment operation. Autom Constr 19(7):898–906

    Article  Google Scholar 

  52. Talmaki S (2012) Real-time visualization for prevention of excavation related utility strikes. Ph.D. Dissertation, Department of Civil and Environmental Engineering, University of Michigan, Ann Arbor, MI

  53. Talmaki S, Kamat V (2012) Real-time hybrid virtuality for prevention of excavation related utility strikes. J Comput Civil Eng. doi:10.1061/(ASCE)CP.1943-5487.0000269

  54. Teizer J, Kim C, Haas CT, Liapi KA, Caldas CH (2005) A framework for real-time 3D modeling of infrastructure. Transp Res Rec J Transp Res Board 1913:177–186

    Article  Google Scholar 

  55. Teizer J, Caldas CH, Haas CT (2007) Real-time three-dimensional occupancy grid modeling for the detection and tracking of construction resources. ASCE J Constr Eng Manag 133(11):880–888

    Article  Google Scholar 

  56. Teizer J, Allread BS, Mantripragada U (2010) Automating the blind spot measurement of construction equipment. Autom Constr 19(4):491–501

    Article  Google Scholar 

  57. Teizer J, Allread BS, Fullerton CE, Hinze J (2010) Autonomous pro-active real-time construction worker and equipment operator proximity safety alert system. Autom Constr 19(5):630–640

    Article  Google Scholar 

  58. Teschner M, Heidelberger B, Manocha D, Govindaraju N, Zachmann G, Kimmerle S, Mezger J, Fuhrmann A (2005) Collision handling in dynamic simulation environments. In: Eurographics Tutorials, 2005, pp 79–185

  59. Virginia State Corporation Commission (2005) Exposing underground utility lines. http://www.scc.virginia.gov/urs/mutility/docs/exp_bp.pdf. Accessed 06 Sep 2012

  60. Wloka MM, Zeleznik RC (1996) Interactive real-time motion blur. Vis Comput 12(6):283–295

    Google Scholar 

  61. Zhang C, Hammad A, AlBahnassi H (2008) Collaborative multi-agent systems for construction equipment based on real-time field data capturing. In: Next generation construction IT: technology foresight, future studies, road mapping, and scenario planning, vol 14, pp 204–228

Download references

Acknowledgments

The presented research was funded by the US National Science Foundation (NSF) via Grants CMMI-927475 and CMMI-1160937. The writers gratefully acknowledge NSF’s support. Any opinions, findings, conclusions, and recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of the NSF, NIST, or the University of Michigan.

Author information

Authors and Affiliations

  1. Department of Civil and Environmental Engineering, University of Michigan, 2340 G.G. Brown, 2350 Hayward, Ann Arbor, MI, 48109, USA

    Sanat Talmaki & Vineet R. Kamat

  2. National Institute of Standards and Technology, Gaithersburg, MD, 20899, USA

    Kamel Saidi

Authors
  1. Sanat Talmaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vineet R. Kamat
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kamel Saidi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vineet R. Kamat.

Additional information

Certain commercial entities, equipment, or materials may be identified in this document in order to describe an experimental procedure or concept adequately. Such identification is not intended to imply recommendation or endorsement by the National Institute of Standards and Technology, nor is it intended to imply that the entities, materials, or equipment are necessarily the best available for the purpose.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Talmaki, S., Kamat, V.R. & Saidi, K. Feasibility of real-time graphical simulation for active monitoring of visibility-constrained construction processes. Engineering with Computers 31, 29–49 (2015). https://doi.org/10.1007/s00366-013-0323-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00366-013-0323-0

Keywords

Search

Navigation