Skip to main content

Integration of a Structure from Motion into Virtual and Augmented Reality for Architectural and Urban Simulation

Demonstrated in Real Architectural and Urban Projects

  • Conference paper
  • First Online:
Computer-Aided Architectural Design. Future Trajectories (CAADFutures 2017)

Abstract

Computational visual simulations are extremely useful and powerful tools for decision-making. The use of virtual and augmented reality (VR/AR) has become a common phenomenon due to real-time and interactive visual simulation tools in architectural and urban design studies and presentations. In this study, a demonstration is performed to integrate structure from motion (SfM) into VR and AR. A 3D modeling method is explored by SfM under real-time rendering as a solution for the modeling cost in large-scale VR. The study examines the application of camera parameters of SfM to realize an appropriate registration and tracking accuracy in marker-less AR to visualize full-scale design projects on a planned construction site. The proposed approach is applied to plural real architectural and urban design projects, and results indicate the feasibility and effectiveness of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sheppard, S.J.: Visual Simulation: A Users Guide for Architects, Engineers, and Planners. Van Nostrand Reinhold, New York (1989)

    Google Scholar 

  2. Dorta, T., LaLande, P.: The impact of virtual reality on the design process, digital design studios: do computers make a difference? In: Proceedings of the 18th Annual Conference of the Association for Computer Aided Design in Architecture, ACADIA, pp. 138–163 (1998)

    Google Scholar 

  3. Sun, L., Fukuda, T., Resch, B.: A synchronous distributed cloud-based virtual reality meeting system for architectural and urban design. Front. Archit. Res. 3(4), 348–357 (2014)

    Article  Google Scholar 

  4. Fukuda, T., Ban, H., Yagi, K., Nishiie, J.: Development of high-definition virtual reality for historical architectural and urban digital reconstruction: a case study of Azuchi castle and old castle town in 1581, CAAD Futures 2015 Selected Papers. Commun. Comput. Inf. Sci. 527, 75–89 (2015)

    Google Scholar 

  5. Kieferle, J., Woessner, U.: BIM interactive - about combining BIM and virtual reality - a bidirectional interaction method for BIM models in different environments. In: Proceedings of the 33rd eCAADe Conference, vol. 1, pp. 69–75 (2015)

    Google Scholar 

  6. Dokonal, W., Knight, M., Dengg, E.: VR or not VR - no longer a question? In: Proceedings of the 34th eCAADe Conference—vol. 2, pp. 573–579 (2016)

    Google Scholar 

  7. Schall, G., Wagner, D., Reitmayr, G., Taichmann, E., Wieser, M., Schmalstieg, D., Hofmann-Wellenhof, B.: Global pose estimation using multi-sensor fusion for outdoor augmented reality. In: ISMAR 2009 (2009)

    Google Scholar 

  8. Hii, J.C., Zhou, Z., Karlekar, J., Schneider, M., Lu, W.: Outdoor mobile augmented reality for past and future on-site architectural visualizations. In: CAAD Futures 2009, pp. 557–571 (2009)

    Google Scholar 

  9. Fukuda, T., Zhang, T., Yabuki, N.: Improvement of registration accuracy of a handheld augmented reality system for urban landscape simulation. Front. Archit. Res. 3(4), 386–397 (2014)

    Article  Google Scholar 

  10. Yabuki, N., Miyashita, K., Fukuda, T.: An invisible height evaluation system for building height regulation to preserve good landscapes using augmented reality. Autom. Constr. 20(3), 228–235 (2011)

    Article  Google Scholar 

  11. Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: ISMAR 2007 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225–234 (2007)

    Google Scholar 

  12. Ventura, J., Hollerer, T.: Wide-area scene mapping for mobile visual tracking. In: Proceedings of the IEEE International Symposium on Mixed and Augmented Reality, pp. 3–12 (2012)

    Google Scholar 

  13. Schubert, G., Schattel, D., Tonnis, M., Klinker, G., Petzold, F.: Tangible mixed reality on-site: interactive augmented visualisations from architectural working models in urban design, CAAD Futures 2015 Selected Papers. Commun. Comput. Inf. Sci. 527, 55–74 (2015)

    Google Scholar 

  14. Yabuki, N., Hamada, Y., Fukuda, T.: Development of an accurate registration technique for outdoor augmented reality using point cloud data. In: 14th International Conference on Computing in Civil and Building Engineering (2012)

    Google Scholar 

  15. Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int. J. Comput. Vis. 9(2), 137–154 (1992)

    Article  Google Scholar 

  16. Snavely, N., Seitz, M.S., Szeliski, R.: Modeling the world from internet photo collections. Int. J. Comput. Vis. 80(2), 189–210 (2007)

    Article  Google Scholar 

  17. Nagakura, T., Tsai, D., Choi, J.: Capturing history bit by bit—architectural database of photogrammetric model and panoramic video. In: Proceedings of the 33rd eCAADe Conference—vol. 1, pp. 685–694 (2015)

    Google Scholar 

  18. Datta, S., Beynon, D.: A computational approach to the reconstruction of surface geometry from early temple superstructures. Int. J. Archit. Comput. 3(4), 471–486 (2005)

    Article  Google Scholar 

  19. Agarwal, S., Snavely, N., Simon, I., Seitz, S.M., Szeliski, R.: Building Rome in a day. In: IEEE 12th International Conference on Computer Vision (ICCV), pp. 72–79 (2009)

    Google Scholar 

  20. Verniz, D., Mateus, L., Duarte, J.P., Ferreira, V.: 3D Reconstruction survey of complex informal settlements—towards an understanding of the genesis of form. In: Proceedings of the 34th eCAADe Conference—vol. 2, pp. 365–370 (2016)

    Google Scholar 

  21. Sato, Y., Fukuda, T., Yabuki, N., Michikawa, T., Motamedi, A.: A marker-less augmented reality system using image processing techniques for architecture and urban environment. In: Proceedings of the 21st International Conference on Computer-Aided Architectural Design Research in Asia (CAADRIA 2016), pp. 713–722 (2016)

    Google Scholar 

  22. Inoue, K., Fukuda, T., Yabuki, N., Motamedi, A., Michikawa, T.: Post-Demolition landscape assessment using photogrammetry-based diminished reality (DR). In: Proceedings of the 16th International Conference on Construction Applications of Virtual Reality, pp. 689–699 (2016)

    Google Scholar 

  23. Hanzawa, Y., Torii, A., Okutomi, M.: Practical structure from motion system for online image acquisition. IEICE Trans. Inf. Syst. (Japanese edition) J96-D(8), 1753–1763 (2013)

    Google Scholar 

  24. Hidaka, N., Michikawa, T., Motamedi, A., Yabuki, N., Fukuda, T.: Polygonization of point cloud of elongated civil infrastructures using lofting operation. In: Proceedings of the 16th International Conference on Construction Applications of Virtual Reality, pp. 677–688 (2016)

    Google Scholar 

  25. Bay, H., Ess, A., Tuytelaars, T., Cool, L.: Speeded-up robust feature (SURF). Comput. Vis. Image Underst. 110, 346–359 (2008)

    Article  Google Scholar 

  26. Watanabe, S.: Simulating 3D architecture and urban landscapes in real space. In: Proceedings of the 16th International Conference on Computer Aided Architectural Design Research in Asia, pp. 261–270 (2011)

    Google Scholar 

  27. Miyake, M., Fukuda, T., Yabuki, N., Motamedi, A., Michikawa, T.: Outdoor augmented reality using optical see-through HMD system for visualizing building information. In: 16th International Conference on Computing in Civil and Building Engineering, pp. 1644–1651 (2016)

    Google Scholar 

Download references

Acknowledgements

The research was partly supported by JSPS KAKENHI Grant Number JP25350010 and JP26-04368, and joint research funding between Sakaiminato city office and Osaka University. We would also like to take the opportunity to thank Kyokuyo Electric Co., Ltd. and atelier DoN to apply our proposed AR system to the building design project. We thank all the participants for their generous assistance in conducting projects and experiments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Tomohiro Fukuda .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Fukuda, T. et al. (2017). Integration of a Structure from Motion into Virtual and Augmented Reality for Architectural and Urban Simulation. In: Çağdaş, G., Özkar, M., Gül, L., Gürer, E. (eds) Computer-Aided Architectural Design. Future Trajectories. CAADFutures 2017. Communications in Computer and Information Science, vol 724. Springer, Singapore. https://doi.org/10.1007/978-981-10-5197-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-5197-5_4

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-5196-8

  • Online ISBN: 978-981-10-5197-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics