Skip to main content
SpringerLink
Log in

A Conceptual Framework for Maturity Evaluation of BIM-Based AR/VR Systems Based on ISO Standards

  • Conference paper
  • First Online:
Extended Reality (XR Salento 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14218))

Included in the following conference series:

  • 479 Accesses

Abstract

Maturity evaluation of BIM-based Augmented Reality (AR) and Virtual Reality (VR) systems is a challenging issue that requires ensuring their effectiveness and reliability. However, the lack of appropriate evaluation methods, tools, and standards for these systems makes this task even more complex. In this context, this paper proposes a conceptual framework for evaluating the maturity of BIM-based AR/VR systems, by using ISO standards. It represents a first and important step towards developing a standardized maturity model for such systems. The proposed framework enables the identification of fundamental concepts related to the evaluation of BIM-based AR and/or VR systems’ maturity. This ranges from identifying the evaluation goals to interpreting the final findings to identify mechanisms to evaluate outcomes. This framework is based on ISO/IEC TS 33061 standard for determining maturity levels and ISO/IEC 15939 for identifying measurement concepts. Evaluation can be performed either globally or in a customized way. The global evaluation considers all aspects of the system, while customized evaluation allows users to select specific key elements according to their requirements. A feasibility study, conducted by academic experts in the field, has been carried out in order to validate the proposed framework.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lu, W., Chen, K., Zetkulic, A., Liang, C.: Measuring building information modeling maturity: a Hong Kong case study. Int. J. Constr. Manag. 21(3), 299–311 (2021)

    Google Scholar 

  2. Dadashi Haji, M., Taghaddos, H., Sebt, M.H., Chokan, F., Zavari, M.: The effects of bim maturity level on the 4d simulation performance: An empirical study. Int. J. Eng. 34(3), 606–614 (2021)

    Google Scholar 

  3. Giel, B., Issa, R.R.: Synthesis of existing BIM maturity toolsets to evaluate building owners. Comput. Civil Eng. 451–458 (2013)

    Google Scholar 

  4. Siebelink, S., Voordijk, J.T., Adriaanse, A.: Developing and testing a tool to evaluate BIM maturity: sectoral analysis in the Dutch construction industry. J. Constr. Eng. Manag. 144(8), 05018007 (2018)

    Article  Google Scholar 

  5. Ahmed, S., Hossain, M.M., Hoque, M.I.: A brief discussion on augmented reality and virtual reality in construction industry. J. Syst. Manage. Sci. 7(3), 1–33 (2017)

    Google Scholar 

  6. Wang, P., Wu, P., Wang, J., Chi, H.L., Wang, X.: A critical review of the use of virtual reality in construction engineering education and training. Int. J. Environ. Res. Public Health 15(6), 1204 (2018)

    Article  Google Scholar 

  7. Ververidis, D., Nikolopoulos, S., Kompatsiaris, I.: A review of collaborative virtual reality systems for the architecture and engineering (Virtual Tour), Int. J. Eng. Res. Technol. (IJERT) 11(11) (2022)

    Google Scholar 

  8. Kim, J.I., Li, S., Chen, X., Keung, C., Suh, M., Kim, T.W.: Evaluation framework for BIM-based VR applications in design phase. J. Comput. Des. Eng. 8(3), 910–922 (2021)

    Google Scholar 

  9. Assila, A., Beladjine, D., Messaadia, M.: Towards AR/VR maturity model adapted to the building information modeling. Product Lifecycle Management Enabling Smart X: 17th IFIP WG 5.1 International Conference, PLM 2020, Rapperswil, Switzerland, July 5–8 (2020)

    Google Scholar 

  10. ISO/IEC TS 33061:2021 Information technology—Process assessment—Process assessment model for software life cycle processes

    Google Scholar 

  11. ISO/IEC 15939. International Organization for Standardization/ International Electrotechnical Commission. Systems and software engineering—Measurement process (ISO/IEC 15939:2007 (E)).Geneva, Switzerland (2007).

    Google Scholar 

  12. Ververidis, D., Nikolopoulos, S., Kompatsiaris, I.: A review of collaborative virtual reality systems for the architecture, engineering, and construction industry. Architecture 2(3), 476–496 (2022)

    Article  Google Scholar 

  13. Sidani, A., et al.: Recent tools and techniques of BIM-Based Augmented Reality: a systematic review. J. Build. Eng. 42, 102500 (2021)

    Article  Google Scholar 

  14. Li, X., Yi, W., Chi, H.L., Wang, X., Chan, A.P.: A critical review of virtual and augmented reality (VR/AR) applications in construction safety. Autom. Constr. 86, 150–162 (2018)

    Article  Google Scholar 

  15. Ahmed, S.: A review on using opportunities of augmented reality and virtual reality in construction project management. Organ. Technol. Manage. Construct. Int. J. 10(1), 1839–1852 (2018)

    Google Scholar 

  16. Alizadehsalehi, S., Hadavi, A., Huang, J.C.: From BIM to extended reality in AEC industry. Autom. Constr. 116, 103254 (2020)

    Article  Google Scholar 

  17. Lopez, J., Bhandari, S., Hallowell, M.R.: Virtual reality and construction industry: review of current state-of-practice and future applications. Construct. Res. Congress 174–184 (2022)

    Google Scholar 

  18. Meža, S., Turk, Ž, Dolenc, M.: Component based engineering of a mobile BIM-based augmented reality system. Autom. Constr. 42, 1–12 (2014)

    Article  Google Scholar 

  19. Wu, C., Xu, B., Mao, C., Li, X.: Overview of BIM maturity measurement tools. J. Inform. Technol. Construct. (ITcon) 22(3), 34–62 (2017)

    Google Scholar 

  20. Yilmaz, G., Akcamete, A., Demirors, O.: A reference model for BIM capability assessments. Autom. Constr. 101, 245–263 (2019)

    Article  Google Scholar 

  21. Dakhil, A., Alshawi, M., Underwood, J.: BIM client maturity: literature review. In: 12th International Post-Graduate Research Conference (2015)

    Google Scholar 

  22. Hammerschmid, S.: Developing and testing of a virtual and augmented reality maturity model. Systems, Software and Services Process Improvement: 25th European Conference, pp. 279–288. EuroSPI 2018, Bilbao, Spain (2018)

    Google Scholar 

  23. Alarcon, R., et al.: Augmented Reality for the enhancement of space product assurance and safety. Acta Astronaut. 168, 191–199 (2020)

    Article  Google Scholar 

  24. Crawford, J.K.: Project Management Maturity Model. Auerbach Publications (2006)

    Google Scholar 

  25. Constantinescu, R., Iacob, I.M.: Capability maturity model integration. J. Appl. Quant. Methods 2(1), 31–37 (2007)

    Google Scholar 

  26. Kozlenko, T.A., Pridvizhkin, S.V.: BIM and VR: development of a software module for the integration of building information modelling and virtual reality. Russian Autom. Highway Indust. J. 18(4), 440–449 (2021)

    Article  Google Scholar 

  27. Carroll, J., Hopper, L., Farrelly, A.M., Lombard-Vance, R., Bamidis, P.D., Konstantinidis, E.I.: A scoping review of augmented/virtual reality health and wellbeing interventions for older adults: redefining immersive virtual reality. Front. Virtual Real. 2, 655338 (2021)

    Article  Google Scholar 

  28. Lepecq, J.C., Bringoux, L., Pergandi, J.M., Coyle, T., Mestre, D.: Afforded actions as a behavioral assessment of physical presence in virtual environments. Virtual Real. 13(3), 141–151 (2009)

    Article  Google Scholar 

  29. Jeunet, C., Albert, L., Argelaguet, F., Lécuyer, A.: “Do you feel in control?”: towards novel approaches to characterise, manipulate and measure the sense of agency in virtual environments. IEEE Trans. Visual Comput. Graph. 24(4), 1486–1495 (2018)

    Article  Google Scholar 

  30. Dey, A., Chen, H., Zhuang, C., Billinghurst, M., Lindeman, R.W.: Effects of sharing real-time multi-sensory heart rate feedback in different immersive collaborative virtual environments. In: IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 165–173 (2018)

    Google Scholar 

  31. Jacques, P.H., Garger, J., Brown, C.A., Deale, C.S.: Personality and virtual reality team candidates: the roles of personality traits, technology anxiety and trust as predictors of perceptions of virtual reality teams. J. Bus. Manage. 15(2) (2009)

    Google Scholar 

  32. Li, J., et al.: Measuring and understanding photo sharing experiences in social virtual reality. In: Proceedings of the CHI Conference on Human Factors in Computing Systems (2019)

    Google Scholar 

  33. Xiong, J., Hsiang, E.L., He, Z., Zhan, T., Wu, S.T.: Augmented reality and virtual reality displays: emerging technologies and future perspectives. Light: Sci. Appl. 10(1), 216 (2021)

    Google Scholar 

  34. Bekele, M.K., Champion, E.: A comparison of immersive realities and interaction methods: cultural learning in virtual heritage. Front. Robot. AI 6, 91 (2019)

    Article  Google Scholar 

  35. Succar, B.: Building information modelling maturity matrix. Handbook of Research on Building Information Modeling and Construction Informatics: Concepts and Technologies. IGI Global, pp. 65–103 (2010)

    Google Scholar 

  36. Assila, A., Marçal de Oliveira, K., Ezzedine, H.: Integration of subjective and objective usability evaluation based on IEC/IEC 15939: a case study for traffic supervision systems. Int. J. Hum. Comput. Interact. 32(12), 931–955 (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CESI LINEACT Laboratory UR 7527, Lille, France

    Ziad Monla, Ahlem Assila, Djaoued Beladjine & Mourad Zghal

Authors
  1. Ziad Monla
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ahlem Assila
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Djaoued Beladjine
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mourad Zghal
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ziad Monla .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Naples Federico II, Naples, Italy

    Pasquale Arpaia

  3. CNR-STIIMA, Lecco, Italy

    Marco Sacco

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Monla, Z., Assila, A., Beladjine, D., Zghal, M. (2023). A Conceptual Framework for Maturity Evaluation of BIM-Based AR/VR Systems Based on ISO Standards. In: De Paolis, L.T., Arpaia, P., Sacco, M. (eds) Extended Reality. XR Salento 2023. Lecture Notes in Computer Science, vol 14218. Springer, Cham. https://doi.org/10.1007/978-3-031-43401-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43401-3_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43400-6

  • Online ISBN: 978-3-031-43401-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation