Abstract
Computational visual simulations are extremely useful and powerful tools for decision-making. The use of virtual and augmented reality (VR/AR) has become a common phenomenon due to real-time and interactive visual simulation tools in architectural and urban design studies and presentations. In this study, a demonstration is performed to integrate structure from motion (SfM) into VR and AR. A 3D modeling method is explored by SfM under real-time rendering as a solution for the modeling cost in large-scale VR. The study examines the application of camera parameters of SfM to realize an appropriate registration and tracking accuracy in marker-less AR to visualize full-scale design projects on a planned construction site. The proposed approach is applied to plural real architectural and urban design projects, and results indicate the feasibility and effectiveness of the proposed approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Sheppard, S.J.: Visual Simulation: A Users Guide for Architects, Engineers, and Planners. Van Nostrand Reinhold, New York (1989)
Dorta, T., LaLande, P.: The impact of virtual reality on the design process, digital design studios: do computers make a difference? In: Proceedings of the 18th Annual Conference of the Association for Computer Aided Design in Architecture, ACADIA, pp. 138–163 (1998)
Sun, L., Fukuda, T., Resch, B.: A synchronous distributed cloud-based virtual reality meeting system for architectural and urban design. Front. Archit. Res. 3(4), 348–357 (2014)
Fukuda, T., Ban, H., Yagi, K., Nishiie, J.: Development of high-definition virtual reality for historical architectural and urban digital reconstruction: a case study of Azuchi castle and old castle town in 1581, CAAD Futures 2015 Selected Papers. Commun. Comput. Inf. Sci. 527, 75–89 (2015)
Kieferle, J., Woessner, U.: BIM interactive - about combining BIM and virtual reality - a bidirectional interaction method for BIM models in different environments. In: Proceedings of the 33rd eCAADe Conference, vol. 1, pp. 69–75 (2015)
Dokonal, W., Knight, M., Dengg, E.: VR or not VR - no longer a question? In: Proceedings of the 34th eCAADe Conference—vol. 2, pp. 573–579 (2016)
Schall, G., Wagner, D., Reitmayr, G., Taichmann, E., Wieser, M., Schmalstieg, D., Hofmann-Wellenhof, B.: Global pose estimation using multi-sensor fusion for outdoor augmented reality. In: ISMAR 2009 (2009)
Hii, J.C., Zhou, Z., Karlekar, J., Schneider, M., Lu, W.: Outdoor mobile augmented reality for past and future on-site architectural visualizations. In: CAAD Futures 2009, pp. 557–571 (2009)
Fukuda, T., Zhang, T., Yabuki, N.: Improvement of registration accuracy of a handheld augmented reality system for urban landscape simulation. Front. Archit. Res. 3(4), 386–397 (2014)
Yabuki, N., Miyashita, K., Fukuda, T.: An invisible height evaluation system for building height regulation to preserve good landscapes using augmented reality. Autom. Constr. 20(3), 228–235 (2011)
Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: ISMAR 2007 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225–234 (2007)
Ventura, J., Hollerer, T.: Wide-area scene mapping for mobile visual tracking. In: Proceedings of the IEEE International Symposium on Mixed and Augmented Reality, pp. 3–12 (2012)
Schubert, G., Schattel, D., Tonnis, M., Klinker, G., Petzold, F.: Tangible mixed reality on-site: interactive augmented visualisations from architectural working models in urban design, CAAD Futures 2015 Selected Papers. Commun. Comput. Inf. Sci. 527, 55–74 (2015)
Yabuki, N., Hamada, Y., Fukuda, T.: Development of an accurate registration technique for outdoor augmented reality using point cloud data. In: 14th International Conference on Computing in Civil and Building Engineering (2012)
Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vis. 9(2), 137–154 (1992)
Snavely, N., Seitz, M.S., Szeliski, R.: Modeling the world from internet photo collections. Int. J. Comput. Vis. 80(2), 189–210 (2007)
Nagakura, T., Tsai, D., Choi, J.: Capturing history bit by bit—architectural database of photogrammetric model and panoramic video. In: Proceedings of the 33rd eCAADe Conference—vol. 1, pp. 685–694 (2015)
Datta, S., Beynon, D.: A computational approach to the reconstruction of surface geometry from early temple superstructures. Int. J. Archit. Comput. 3(4), 471–486 (2005)
Agarwal, S., Snavely, N., Simon, I., Seitz, S.M., Szeliski, R.: Building Rome in a day. In: IEEE 12th International Conference on Computer Vision (ICCV), pp. 72–79 (2009)
Verniz, D., Mateus, L., Duarte, J.P., Ferreira, V.: 3D Reconstruction survey of complex informal settlements—towards an understanding of the genesis of form. In: Proceedings of the 34th eCAADe Conference—vol. 2, pp. 365–370 (2016)
Sato, Y., Fukuda, T., Yabuki, N., Michikawa, T., Motamedi, A.: A marker-less augmented reality system using image processing techniques for architecture and urban environment. In: Proceedings of the 21st International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2016), pp. 713–722 (2016)
Inoue, K., Fukuda, T., Yabuki, N., Motamedi, A., Michikawa, T.: Post-Demolition landscape assessment using photogrammetry-based diminished reality (DR). In: Proceedings of the 16th International Conference on Construction Applications of Virtual Reality, pp. 689–699 (2016)
Hanzawa, Y., Torii, A., Okutomi, M.: Practical structure from motion system for online image acquisition. IEICE Trans. Inf. Syst. (Japanese edition) J96-D(8), 1753–1763 (2013)
Hidaka, N., Michikawa, T., Motamedi, A., Yabuki, N., Fukuda, T.: Polygonization of point cloud of elongated civil infrastructures using lofting operation. In: Proceedings of the 16th International Conference on Construction Applications of Virtual Reality, pp. 677–688 (2016)
Bay, H., Ess, A., Tuytelaars, T., Cool, L.: Speeded-up robust feature (SURF). Comput. Vis. Image Underst. 110, 346–359 (2008)
Watanabe, S.: Simulating 3D architecture and urban landscapes in real space. In: Proceedings of the 16th International Conference on Computer Aided Architectural Design Research in Asia, pp. 261–270 (2011)
Miyake, M., Fukuda, T., Yabuki, N., Motamedi, A., Michikawa, T.: Outdoor augmented reality using optical see-through HMD system for visualizing building information. In: 16th International Conference on Computing in Civil and Building Engineering, pp. 1644–1651 (2016)
Acknowledgements
The research was partly supported by JSPS KAKENHI Grant Number JP25350010 and JP26-04368, and joint research funding between Sakaiminato city office and Osaka University. We would also like to take the opportunity to thank Kyokuyo Electric Co., Ltd. and atelier DoN to apply our proposed AR system to the building design project. We thank all the participants for their generous assistance in conducting projects and experiments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Fukuda, T. et al. (2017). Integration of a Structure from Motion into Virtual and Augmented Reality for Architectural and Urban Simulation. In: Çağdaş, G., Özkar, M., Gül, L., Gürer, E. (eds) Computer-Aided Architectural Design. Future Trajectories. CAADFutures 2017. Communications in Computer and Information Science, vol 724. Springer, Singapore. https://doi.org/10.1007/978-981-10-5197-5_4
Download citation
DOI: https://doi.org/10.1007/978-981-10-5197-5_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-5196-8
Online ISBN: 978-981-10-5197-5
eBook Packages: Computer ScienceComputer Science (R0)