research-article

Open access

BIM Driven Retrofitting Design Evaluation of Building Facades

Authors:

John Sermarini,

Robert A. Michlowitz,

Joseph J. LaViola,

Lori C. Walters,

Joseph T. Kider Jr.Authors Info & Claims

SUI '22: Proceedings of the 2022 ACM Symposium on Spatial User Interaction

Article No.: 12, Pages 1 - 10

https://doi.org/10.1145/3565970.3567688

Published: 01 December 2022 Publication History

All formats PDF

Abstract

Building facades are components that shape a structure’s daylighting, energy use, and view factors. This paper presents an approach that enables designers to understand the impact that different facade designs will have over time and space in the built environment through a BIM-enabled augmented reality system. The system permits the examination of a range of facade retrofit scenarios and visualizes the daylighting simulations and aesthetics of a structure while retaining function and comfort. A focus of our study was to measure how participants make decisions within the multi-objective decision space designers often face when buildings undergo retrofitting. This process often requires designers to search for a set of alternatives that represent the optimal solution. We analyze the decision-making process of forty-four subjects to determine how they explore design choices. Our results indicate the feasibility of using BIM-enabled AR to improve how designers make informed decisions.

References

[1]

Sepehr Alizadehsalehi, Ahmad Hadavi, and Joseph Chuenhuei Huang. 2020. From BIM to extended reality in AEC industry. Automation in Construction 116 (2020), 103254.

[2]

ANSI/ASHRAE/IES. 2020. ANSI/ASHRAE/IES Standard 90.1-2019 – Energy Standard for Buildings Except Low-Rise Residential Buildings. https://www.ashrae.org/technical-resources/bookstore/standard-90-1.

[3]

Roger Azevedo. 2005. Computer environments as metacognitive tools for enhancing learning. Educational Psychologist 40, 4 (2005), 193–197.

[4]

Mark Billinghurst and Hirokazu Kato. 2002. Collaborative augmented reality. Commun. ACM 45, 7 (2002), 64–70.

Digital Library

[5]

Mark Billinghurst, Suzanne Weghorst, and T Furness. 1998. Shared space: An augmented reality approach for computer supported collaborative work. Virtual Reality 3, 1 (1998), 25–36.

Digital Library

[6]

Apiparn Borisuit, Friedrich Linhart, Jean-Louis Scartezzini, and Mirjam Münch. 2015. Effects of realistic office daylighting and electric lighting conditions on visual comfort, alertness and mood. Lighting Research & Technology 47, 2 (2015), 192–209.

[7]

Iain Campbell and Koben Calhoun. 2016. Old Buildings Are US Cities’ Biggest Sustainability Challenge. Harvard Business Review. Harvard Business Publishing 21 (2016).

[8]

Yair Censor. 1977. Pareto optimality in multiobjective problems. Applied Mathematics and Optimization 4, 1 (1977), 41–59.

Digital Library

[9]

Keyu Chen, Weiwei Chen, Chun Ting Li, and Jack CP Cheng. 2019. A BIM-based location aware AR collaborative framework for facility maintenance management.J. Inf. Technol. Constr. 24 (2019), 360–380.

[10]

Andy Clark and David Chalmers. 1998. The extended mind. Analysis 58, 1 (1998), 7–19.

[11]

Drury B Crawley, Linda K Lawrie, Frederick C Winkelmann, Walter F Buhl, Y Joe Huang, Curtis O Pedersen, Richard K Strand, Richard J Liesen, Daniel E Fisher, Michael J Witte, 2001. EnergyPlus: creating a new-generation building energy simulation program. Energy and buildings 33, 4 (2001), 319–331.

[12]

Iñigo Fernández del Amo, John Ahmet Erkoyuncu, Rajkumar Roy, Riccardo Palmarini, and Demetrius Onoufriou. 2018. A systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications. Computers in Industry 103 (2018), 47–71.

[13]

Scott Drake. 2007. The third skin: architecture, technology and environment. University of New South Wales Press.

[14]

Marie-Claude Dubois, Fabio Bisegna, Niko Gentile, Martine Knoop, Barbara Matusiak, Werner Osterhaus, and Eino Tetri. 2015. Retrofitting the electric lighting and daylighting systems to reduce energy use in buildings: a literature review. Energy Research Journal 6, 1 (2015), 25–41.

[15]

Phillip S Dunston and Xiangyu Wang. 2005. Mixed reality-based visualization interfaces for architecture, engineering, and construction industry. Construction engineering and management 131, 12 (2005), 1301–1309.

[16]

Malcolm Eames, Tim Dixon, Simon Charles Lannon, Miriam Hunt, Carla De Laurentis, Simon Marvin, Mike Hodson, Peter Guthrie, and Maria Christina Georgiadou. 2014. Retrofit 2050: critical challenges for urban transitions. (2014).

[17]

Charles M Eastman, Chuck Eastman, Paul Teicholz, Rafael Sacks, and Kathleen Liston. 2011. BIM handbook: A guide to building information modeling for owners, managers, designers, engineers and contractors. John Wiley & Sons.

[18]

Ahmad Eltaweel and SU Yuehong. 2017. Parametric design and daylighting: A literature review. Renewable and Sustainable Energy Reviews 73 (2017), 1086–1103.

[19]

Drake Erbe, Leonard Len Sciarra, Jason Glazer, Kelly Seeger, Jeff Boldt, Reid Hart, and Michael I Rosenberg. 2020. A Conversation on Standard 90.1-2019. ASHRAE Journal 62, PNNL-SA-152341 (2020).

[20]

Yuan Fang and Soolyeon Cho. 2019. Design optimization of building geometry and fenestration for daylighting and energy performance. Solar Energy 191(2019), 7–18.

[21]

Steven Feiner, Blair MacIntyre, and Doree Seligmann. 1993. Knowledge-based augmented reality. Commun. ACM 36, 7 (1993), 53–62.

Digital Library

[22]

Tomohiro Fukuda, Kazuki Yokoi, Nobuyoshi Yabuki, and Ali Motamedi. 2019. An indoor thermal environment design system for renovation using augmented reality. Journal of Computational Design and Engineering 6, 2(2019), 179–188.

[23]

James Garbett, Thomas Hartley, and David Heesom. 2021. A multi-user collaborative BIM-AR system to support design and construction. Automation in Construction 122 (2021), 103487.

[24]

Ioannis Giagkiozis and Peter J Fleming. 2015. Methods for multi-objective optimization: An analysis. Information Sciences 293(2015), 338–350.

[25]

James J. Gibson. 1979. The Ecological Approach to Visual Perception. Houghton Mifflin.

[26]

Mani Golparvar-Fard, Feniosky Peña-Mora, and Silvio Savarese. 2009. D4AR–a 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication. Journal of information technology in construction 14, 13(2009), 129–153.

[27]

Nyoman Gunantara. 2018. A review of multi-objective optimization: Methods and its applications. Cogent Engineering 5, 1 (2018), 1502242.

[28]

Steven Henderson and Steven Feiner. 2010. Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE transactions on visualization and computer graphics 17, 10(2010), 1355–1368.

Digital Library

[29]

Dan Hou, Gang Liu, Qi Zhang, Lixiong Wang, and Rui Dang. 2017. Integrated building envelope design process combining parametric modelling and multi-objective optimization. Transactions of Tianjin University 23, 2 (2017), 138–146.

[30]

Paulo Ivson, André Moreira, Francisco Queiroz, Wallas Santos, and Waldemar Celes. 2019. A systematic review of visualization in building information modeling. IEEE transactions on visualization and computer graphics 26, 10(2019), 3109–3127.

[31]

Rehmaashini Jagarajan, Mat Naim Abdullah Mohd Asmoni, Abdul Hakim Mohammed, Mohd Nadzri Jaafar, Janice Lee Yim Mei, and Maizan Baba. 2017. Green retrofitting – A review of current status, implementations and challenges. Renewable and Sustainable Energy Reviews 67 (Jan. 2017), 1360–1368. https://doi.org/10.1016/j.rser.2016.09.091

[32]

Enes Karaaslan, Ulas Bagci, and Fikret Necati Catbas. 2019. Artificial intelligence assisted infrastructure assessment using mixed reality systems. Transportation Research Record 2673, 12 (2019), 413–424.

[33]

Hyoungsub Kim and Mark J Clayton. 2020. A multi-objective optimization approach for climate-adaptive building envelope design using parametric behavior maps. Building and Environment 185 (2020), 107292.

[34]

Ayca Kirimtat, Basak Kundakci Koyunbaba, Ioannis Chatzikonstantinou, Sevil Sariyildiz, and Ponnuthurai Nagaratnam Suganthan. 2016. Multi-objective optimization for shading devices in buildings by using evolutionary algorithms. In 2016 IEEE Congress on Evolutionary Computation (CEC). IEEE, 3917–3924.

Digital Library

[35]

Panayiotis Koutsabasis, Spyros Vosinakis, Katerina Malisova, and Nikos Paparounas. 2012. On the value of virtual worlds for collaborative design. Design Studies 33, 4 (2012).

[36]

Oh-Seong Kwon, Chan-Sik Park, and Chung-Rok Lim. 2014. A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented reality. Automation in construction 46 (2014), 74–81.

[37]

Jiahao Li, Jeeeun Kim, and Xiang’Anthony’ Chen. 2019. Robiot: A Design Tool for Actuating Everyday Objects with Automatically Generated 3D Printable Mechanisms. In ACM Symposium on User Interface Software and Technology. 673–685.

Digital Library

[38]

Xiao Li, Wen Yi, Hung-Lin Chi, Xiangyu Wang, and Albert PC Chan. 2018. A critical review of virtual and augmented reality (VR/AR) applications in construction safety. Automation in Construction 86 (2018), 150–162.

[39]

Zhihao Liu, Fanxing Zhang, and Zhanglin Cheng. 2021. BuildingSketch: Freehand Mid-Air Sketching for Building Modeling. In 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 329–338.

[40]

Zhenjun Ma, Paul Cooper, Daniel Daly, and Laia Ledo. 2012. Existing building retrofits: Methodology and state-of-the-art. Energy and buildings 55(2012), 889–902.

[41]

Harry Francis Mallgrave. 2013. Architecture and embodiment: The implications of the new sciences and humanities for design. Routledge.

[42]

Daniela Mitterberger, Kathrin Dörfler, Timothy Sandy, Foteini Salveridou, Marco Hutter, Fabio Gramazio, and Matthias Kohler. 2020. Augmented bricklaying. Construction Robotics 4, 3 (2020), 151–161.

[43]

Albert Newen, Shaun Gallagher, and Leon De Bruin. 2018. 4E Cognition. In The Oxford Handbook of 4E Cognition. Oxford University Press, 1.

[44]

Riccardo Palmarini, John Ahmet Erkoyuncu, Rajkumar Roy, and Hosein Torabmostaedi. 2018. A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing 49 (2018), 215–228.

[45]

Hetal Parekh. 2018. Policy Interventions to Catalyze Uptake of Energy Efficiency Upgrades in the US. Ph. D. Dissertation. Carnegie Mellon University.

[46]

Huaishu Peng, Jimmy Briggs, Cheng-Yao Wang, Kevin Guo, Joseph Kider, Stefanie Mueller, Patrick Baudisch, and François Guimbretière. 2018. RoMA: Interactive fabrication with augmented reality and a robotic 3D printer. In Proceedings of the 2018 CHI conference on human factors in computing systems. 1–12.

Digital Library

[47]

Juri Platonov, Hauke Heibel, Peter Meier, and Bert Grollmann. 2006. A mobile markerless AR system for maintenance and repair. In 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality. IEEE, 105–108.

Digital Library

[48]

Dirk Reiners, Didier Stricker, Gudrun Klinker, and Stefan Müller. 1999. Augmented reality for construction tasks: Doorlock assembly. Proc. Ieee And Acm Iwar 98, 1 (1999), 31–46.

[49]

Christoph F Reinhart, John Mardaljevic, and Zack Rogers. 2006. Dynamic daylight performance metrics for sustainable building design. Leukos 3, 1 (2006), 7–31.

[50]

Sarah Robinson and Juhani Pallasmaa. 2015. Mind in architecture: Neuroscience, embodiment, and the future of design. MIT Press.

[51]

Mostapha Sadeghipour Roudsari, Michelle Pak, Adrian Smith, 2013. Ladybug: a parametric environmental plugin for grasshopper to help designers create an environmentally-conscious design. In Proceedings of the 13th international IBPSA conference held in Lyon, France Aug. 3128–3135.

[52]

Valentino Sangiorgio, Martiradonna Silvia, and Fabio Fatiguso. 2020. Augmented reality to support multi-criteria decision making in building retrofitting. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC). IEEE, 760–765.

Digital Library

[53]

Luís Sanhudo, Nuno MM Ramos, João Poças Martins, Ricardo MSF Almeida, Eva Barreira, M Lurdes Simões, and Vítor Cardoso. 2018. Building information modeling for energy retrofitting–A review. Renewable and Sustainable Energy Reviews 89 (2018), 249–260.

[54]

John Sermarini, Robert A. Michlowitz, Joseph J. LaViola, Lori C. Walters, Roger Azevedo, and Joseph T. Kider. 2021. Embodied Facade Retrofit Design With Augmented Reality in the Built Environment. In Building Simulation.

[55]

Adeeb Sidani, Fábio Matoseiro Dinis, Joana Duarte, Luís Sanhudo, Diego Calvetti, João Santos Baptista, João Poças Martins, and Alfredo Soeiro. 2021. Recent tools and techniques of BIM-Based Augmented Reality: A systematic review. Journal of Building Engineering 42 (2021), 102500.

[56]

Arthur E Stamps III. 1999. Physical determinants of preferences for residential facades. Environment and Behavior 31, 6 (1999), 723–751.

[57]

Walid Thabet, Mohd Fairuz Shiratuddin, and Doug Bowman. 2002. Virtual reality in construction: a review. Engineering computational technology(2002), 25–52.

[58]

PC Thomas and WM David. 1992. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Hawaii international conference on system sciences, Vol. 2. ACM SIGCHI Bulletin New York, NY, USA.

[59]

Rebekka Volk, Julian Stengel, and Frank Schultmann. 2014. Building Information Modeling (BIM) for existing buildings—Literature review and future needs. Automation in construction 38 (2014), 109–127.

[60]

Gregory J Ward. 1994. The RADIANCE lighting simulation and rendering system. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques. 459–472.

Digital Library

[61]

Anthony Webster, Steven Feiner, Blair MacIntyre, William Massie, and Theodore Krueger. 1996. Augmented reality in architectural construction, inspection and renovation. In Proc. ASCE Third Congress on Computing in Civil Engineering, Vol. 1. 996.

[62]

Jennifer Whyte. 2002. Virtual reality and the built environment. Routledge.

[63]

Martijn E Wokke, Dalila Achoui, and Axel Cleeremans. 2020. Action information contributes to metacognitive decision-making. Scientific reports 10, 1 (2020), 1–15.

[64]

Yun Kyu Yi. 2019. Building facade multi-objective optimization for daylight and aesthetical perception. Building and Environment 156 (2019), 178–190.

Cited By

Chang VGao GPeng H(2024)Social VR for Professional Networking: A Spatial PerspectiveProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682094(1-10)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682094
Sermarini JMichlowitz RLaViola JWalters LAzevedo RKider J(2024)Exploring Augmented Reality’s Role in Enhancing Spatial Perception for Building Facade Retrofit Design for Non-experts2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00046(233-243)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00046
Sermarini JMichlowitz RLaViola JWalters LAzevedo RKider J(2023)Investigating the Impact of Augmented Reality and BIM on Retrofitting Training for Non-ExpertsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332022329:11(4655-4665)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320223

Index Terms

BIM Driven Retrofitting Design Evaluation of Building Facades
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Mixed / augmented reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality

Recommendations

Supporting Construction and Architectural Visualization Through BIM and AR/VR: A Systematic Literature Review
Human-Computer Interaction – INTERACT 2023
Abstract
The Architecture, Engineering, Construction, and Facility Management (AEC/FM) industry deals with the design, construction, and operation of complex buildings. Today, Building Information Modeling (BIM) is used to represent information about a ...
BIM Applications in Design with the Example of Prefabricated Construction in China
IDST '24: Proceedings of the 2024 International Conference on Intelligent Driving and Smart Transportation
BIM (Building information modeling) and prefabricated construction are both hot spots in the development of new international construction technologies. As a major construction country, China is actively using BIM to promote urbanization construction. ...
Building and Employing Cross-Reality

This issue's Works in Progress department lists five projects with a focus on cross reality. The first two involve using Project Wonderland for collaborative projects. The next three use virtual and augmented reality to enhance user capabilities and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '22: Proceedings of the 2022 ACM Symposium on Spatial User Interaction

December 2022

233 pages

ISBN:9781450399487

DOI:10.1145/3565970

Editors:
Misha Sra
UC Santa Barbara, USA
,
Francisco Ortega
Colorado State University, USA
,
Thammathip Piumsomboon
University of Canterbury, New Zealand
,
Benjamin Weyers
University of Trier, Germany
,
Tabitha Peck
Davidson College, USA
,
Mayra Barrera
Dalhousie University, Canada
,
Anil Ufuk Batmaz
Kadir Has University, Turkey
,
Parinya Punpongsanon
Osaka University, Japan

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

SUI '22

Sponsor:

SUI '22: Symposium on Spatial User Interaction

December 1 - 2, 2022

CA, Online, USA

Acceptance Rates

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
584
Total Downloads

Downloads (Last 12 months)266
Downloads (Last 6 weeks)35

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chang VGao GPeng H(2024)Social VR for Professional Networking: A Spatial PerspectiveProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682094(1-10)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682094
Sermarini JMichlowitz RLaViola JWalters LAzevedo RKider J(2024)Exploring Augmented Reality’s Role in Enhancing Spatial Perception for Building Facade Retrofit Design for Non-experts2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00046(233-243)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00046
Sermarini JMichlowitz RLaViola JWalters LAzevedo RKider J(2023)Investigating the Impact of Augmented Reality and BIM on Retrofitting Training for Non-ExpertsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332022329:11(4655-4665)Online publication date: 3-Oct-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320223

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten