Toward automated generation of parametric BIMs based on hybrid video and laser scanning data

https://doi.org/10.1016/j.aei.2010.06.006Get rights and content

Abstract

Only very few constructed facilities today have a complete record of as-built information. Despite the growing use of Building Information Modelling and the improvement in as-built records, several more years will be required before guidelines that require as-built data modelling will be implemented for the majority of constructed facilities, and this will still not address the stock of existing buildings. A technical solution for scanning buildings and compiling Building Information Models is needed. However, this is a multidisciplinary problem, requiring expertise in scanning, computer vision and videogrammetry, machine learning, and parametric object modelling. This paper outlines the technical approach proposed by a consortium of researchers that has gathered to tackle the ambitious goal of automating as-built modelling as far as possible. The top level framework of the proposed solution is presented, and each process, input and output is explained, along with the steps needed to validate them. Preliminary experiments on the earlier stages (i.e. processes) of the framework proposed are conducted and results are shown; the work toward implementation of the remainder is ongoing.

Introduction

The current state-of-the-art approach to collecting, organizing and integrating as-built data of a constructed facility into a single data structure is to model it using building information modelling (BIM) tools [1]. This approach generates parametric building models by producing logical building objects and the parametric relationships among them. The process starts by collecting spatial data on site through state-of-the-art surveying technologies, such as laser scanning (LIDAR) and photogrammetry. The resulting spatial data must then be manually stitched into a 3D surface with some algorithmic help for fine stitching. The points on the 3D surface are then manually replaced by objects, by having an operator observe the data, identify each object type, search for it in a database of standardized objects, and fit it on the surface with some help from fitting algorithms for optimal fitting. Following that, any as-built attributes can be assigned to each object manually.

Although this process is significantly assisted by recent technological advancements, most of it remains manual. Researchers along with professional modellers such as VECO [2] and Reality Measurements [3] have reported that more than two thirds of the efforts needed to model even simple facilities are spent on manual conversion of the surface data to a BIM. This problem results in significant cost and effort that is needed to convert the sensed surface of constructed facilities to the desired model, which undermines any benefits of automated spatial modelling for the majority of facilities. According to studies by Minhindu and Arayici [4] and Young et al. [5], BIM adoption is growing in some countries such as U.S., Denmark, Finland and Norway. However, as McCarthy [6] had predicted, for small construction projects, the net savings can barely justify adoption and utilization of this technology. As a result, the penetration of innovative spatial modelling technologies to smaller projects and companies in the Architecture, Engineering & Construction (AEC) industry is slow and they will wait unless significant savings can occur.

This paper presents a novel framework that holds promise to automate almost entirely the generation of as-built parametric BIMs of constructed facilities, ranging from residential housing to industrial structures. This framework uses spatial and visual data collected in the field to generate images and the 3D surface represented as a point cloud. The next step is to stitch images together in order to integrate them into a single 3D representation. Then, by analyzing geometric surface and surface texture information simultaneously against an established taxonomy of building material samples and shapes and their relationships to one another, it is possible to generate representations that can be used to classify common building objects into corresponding object categories. This is followed by novel fitting algorithms that identify the exact object from the identified category that fits the spatial and visual description. This allows the automated identification of most frequent items and presents them to the modeller for verification. The user/modeller is then responsible only for modelling specialty/infrequent items and checking/correcting the modelling results of the automated process. The major scientific breakthrough of this framework is the automation of several repetitive processes that are unwieldy and but time-consuming to be completed by human operations. These additions are expected to significantly reduce the cost, time and resources that are needed to build a parametric building model compared to current practice.

Section snippets

As-built modelling of constructed facilities

As-built spatial modelling for facilities is the process of capturing the infrastructure spatial data and transforming it into a structured, object-oriented representation. This representation (model) is suitable for generating useful information valuable to architects, engineers, constructors, owners, inspectors and maintainers. A project’s stakeholders can use spatial modelling in order to solve complex problems such as identifying deviations from design, quantity take-off, real-time

Object recognition and fitting

The framework proposed in this paper is partially based upon the object recognition and fitting procedures presented in this section. Object recognition in as-built spatial modelling is the task of identifying the elements that are related to the construction of facilities. According to Brilakis and Soibelman [15], object recognition in construction is influenced by characteristics of construction material images, which have low variability and high similarity (e.g. wood, concrete, steel, and

Proposed framework

The proposed framework aims to automate the generation of parametric BIMs of facilities in terms of their spatial and visual features. It starts by sensing the real world structure and ends with a BIM. The basic mechanics of this framework are shown in Fig. 3. There are six states (inputs/outputs) in the proposed model generation process, which are represented by elliptical shapes in Fig. 3 while processes that are needed to carry one state to the next are shown in boxes. The processes are

Results

Preliminary experiments have been conducted for the first three processes of the framework proposed (i.e. visual and spatial sensing, spatial correlation, and object features recognition) and results are obtained. In an initial investigation, a number of laboratory setups have already been developed for the evaluation of laser scanning capabilities and for comparing the accuracy of photo-generated vs. laser-generated point clouds. Three experiments have been conducted to obtain data from

Conclusion and ongoing research

Having access to an as-built model of an existing facility can enhance project planning, improve data management, support decision makings and increase the productivity, profitability and accuracy of a project in construction industry. However, current building modelling methods for existing buildings rely heavily on human effort to generate the logical building objects and the parametric relationships between them. Data can be collected automatically using laser scanners, but interpretation of

References (59)

  • Reality Measurements Inc. Available from: <http://www.realitymeasurements.com>,...
  • S. Minhindu, Y. Arayici, Digital construction through bim systems will drive the re-engineering of construction...
  • N.W. Young et al.

    SmartMarket Report on Building Information Modeling (BIM): Transforming Design and Construction to Achieve Greater Industry Productivity

    (2008)
  • D.C. McCarthy, Laser Scanner is a Model Helper for Construction Engineers. Available from: <www.photonics.com>,...
  • J. Goedert et al.

    Integrating laser scanning and rapid prototyping to enhance construction modelling

    Journal of Architectural Engineering

    (2005)
  • VRMesh For Point Cloud and Triangle Mesh Processing. Available from:...
  • Kurt3D at ELROB. Available from: <http://kos.informatik.uni-osnabrueck.de/download/elrob2006/>,...
  • E. Jaselskis, Z. Gao, Pilot study on laser scanning technology for transportation projects, in: Proceedings of 2003...
  • Y.M.A. Hashash, J.N. Oliveira Filho, Y.Y. Su, L.Y. Liu, 3D Laser scanning for tracking supported excavation...
  • C. Kim, C.T. Haas, K.A. Liapi, Human-assisted 3D spatial modelling of construction sites using sparse range-point...
  • C.H. Caldas, D.G. Torrent, C.T. Haas, Integration of automated data collection technologies for real-time field...
  • E.M. Mikhail et al.

    Introduction to Modern Photogrammetry

    (2001)
  • I. Brilakis et al.

    Shape-based retrieval of construction site photographs

    Journal of Computing in Civil Engineering, American Society of Civil Engineers

    (2008)
  • I. Brilakis et al.

    Material-based construction site image retrieval

    Journal of Computing in Civil Engineering, American Society of Civil Engineers

    (2005)
  • Z. Zhu, I. Brilakis, G. Parra-Montesinos, Real-time concrete damage visual assessment for first responders, in:...
  • J. Canny

    A computational approach to edge detection

    IEEE Transactions on Pattern Analysis and Machine Intelligence

    (1986)
  • J. Matas, C. Galambos, J. Kittler, in: Proceedings of the Progressive Probabilistic Hough Transform, British Machine...
  • P.J. Besl et al.

    A method for registration of 3-D shapes

    IEEE Transactions on Pattern Analysis and Machine Intelligence

    (1992)
  • K. Mikolajczyk et al.

    A performance evaluation of local descriptors

    IEEE Transactions on Pattern Analysis and Machine Intelligence

    (2005)
  • Cited by (0)

    View full text