Skip to main content
Springer Nature Link
Log in

Creating Room-Scale Interactive Mixed-Reality Worlds Using Off-the-Shelf Technologies

  • Conference paper
  • First Online:
Advances in Computer Entertainment Technology (ACE 2017)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10714))

Included in the following conference series:

  • 3193 Accesses

Abstract

Mixed-Reality (MR) represents a combination of real and virtual worlds. Off-the-shelf solutions already exist for quite some time which enable the creation of MR worlds where physical and digital objects co-exist and interact in real time. However, little is still known regarding methodological and technical challenges involved in the development of room scale MR worlds with the use of high-end technologies, especially when considering real-object representation. This paper reports hands-on experiences in creating a room-scale MR world, using widespread, off-the-shelf object-tracking technologies and 3D modelling techniques, which enable free user movement, accurate real-object representation in the virtual world, as well as interactivity between real and virtual objects.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    http://www.artanim.ch/blog/tag/siggraph/.

  2. 2.

    https://www.roadtovr.com/virtsim-virtual-reality-platform/.

  3. 3.

    https://www.oculus.com/blog/oculus-roomscale-tips-for-setting-up-a-killer-vr-room/.

  4. 4.

    https://remake.autodesk.com.

  5. 5.

    www.microsoft.com/en-us/kinectforwindows.

  6. 6.

    http://skanect.occipital.com/.

  7. 7.

    https://www.maxon.net/en/products/cinema-4d/overview/.

  8. 8.

    https://www.vicon.com/products/software/blade.

  9. 9.

    https://unity3d.com/.

  10. 10.

    https://www.vicon.com/products/software/tracker.

  11. 11.

    https://www.vicon.com/products/software/pegasus.

  12. 12.

    https://www.vicon.com/products/software/datastream-sdk.

  13. 13.

    https://docs.vicon.com/display/Pegasus12/Using+Vicon+Pegasus#UsingViconPegasus-UnrealIntegration.

  14. 14.

    The script used to register 3D objects location and rotation to the virtual space based on the props positions can be found at: http://zarcrash.x10.mx/Program.cs.

  15. 15.

    https://developer.oculus.com/downloads/unity/.

  16. 16.

    An example of the MR world created in this work can be found at https://www.youtube.com/watch?v=Hy_wCD1LJYk.

  17. 17.

    https://www.leapmotion.com/.

  18. 18.

    An example of the LeapMotion performance can be found in https://www.youtube.com/watch?v=MoY7R02_ShE.

  19. 19.

    https://manus-vr.com/.

  20. 20.

    An example of the interaction between the user and the cube item can be found at https://www.youtube.com/watch?v=p-f7z2oUk7s.

  21. 21.

    An example of the interaction between the user hand and the cube item can be found at: https://youtu.be/nwnU8BiJX00.

  22. 22.

    An example of the interaction between the user hand and the rock item can be found at: https://www.youtube.com/watch?v=4b3QDFap2Ok.

  23. 23.

    https://www.arduino.cc/.

  24. 24.

    https://learn.sparkfun.com/tutorials/flex-sensor-hookup-guide.

References

  1. Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. Trans. Inf. Syst. 77(12), 1321–1329 (1994)

    Google Scholar 

  2. Cheok, A.D., Sreekumar, A., Lei, C., Thang, L.N.: Capture the flag: mixed-reality social gaming with smart phones. Pervasive Comput. 5(2), 62–69 (2006)

    Article  Google Scholar 

  3. Pan, Z., Cheok, A.D., Yang, H., Zhu, J., Shi, J.: Virtual reality and mixed reality for virtual learning environments. Comput. Graphics 30(1), 20–28 (2006)

    Article  Google Scholar 

  4. Fiorentino, M., de Amicis, R., Monno, G., Stork, A: Spacedesign: a mixed reality workspace for aesthetic industrial design. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, p. 86. IEEE, Darmstadt (2002)

    Google Scholar 

  5. Ferrari, V., Megali, G., Troia, E., Pietrabissa, A., Mosca, F.: A 3-D mixed-reality system for stereoscopic visualization of medical dataset. Trans. Biomed. Eng. 56(11), 2627–2633 (2009)

    Article  Google Scholar 

  6. Hoffman, H.G.: Physically touching virtual objects using tactile augmentation enhances the realism of virtual environments. In: Proceedings of the Virtual Reality Annual International Symposium, pp. 59–63. IEEE, Atlanta (1998)

    Google Scholar 

  7. Sutherland, I.E.: The ultimate display. Int. Fed. Inf. Process. 2, 506–508 (1965)

    Google Scholar 

  8. Usoh, M., Slater, M.: An exploration of immersive virtual environments. Endeavour 19(1), 34–38 (1995)

    Article  Google Scholar 

  9. Milgram, P., Takemura, H., Utsumi, A., Kishino, F.: Augmented reality: a class of displays on the reality-virtuality continuum. Telemanipulator Telepresence Technol. 2351, 282–292 (1994)

    Article  Google Scholar 

  10. Biocca, F., Levy, M.R.: Communication in the Age of Virtual Reality. Routledge, London (2013)

    Google Scholar 

  11. Van Krevelen, D., Poelman, R.: A survey of augmented reality technologies, applications and limitations. Int. J. Virtual Reality 9(2), 1 (2010)

    Google Scholar 

  12. Davies, M., Callaghan., V.: iWorlds: building mixed reality intelligent environments using customisable 3D virtual worlds. In: Proceedings of the 6th International Conference on Intelligent Environments, pp. 311–314. IEEE, Kuala Lumpur (2010)

    Google Scholar 

  13. Tecchia, F., Avveduto, G., Brondi, R., Carrozzino, M., Bergamasco, M., Alem, L.: I’m in VR!: using your own hands in a fully immersive MR system. In: Proceedings of the 20th Symposium on Virtual Reality Software and Technology, pp. 73–76. ACM, Edinburg (2014)

    Google Scholar 

  14. Bernardet, U., Bermúdez, S., Duff, A., Inderbitzin. M., Groux, S., Manzolli, J., Mathews, Z., Mura, A., Väljamäe, A., Verschure, P.: The eXperience induction machine: a new paradigm for mixed-reality interaction design and psychological experimentation. In: Dubois, E., Gray, P., Nigay, L. (eds.) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series, pp. 357–379. Springer, London (2010). https://doi.org/10.1007/978-1-84882-733-2_18

  15. Hughes, C.E., Stapleton, C.B., Hughes, D.E., Smith, E.M.: Mixed reality in education, entertainment, and training. Comput. Graph. Appl. 25(6), 24–30 (2005)

    Article  Google Scholar 

  16. Cheok, A.D., Yang, X., Ying, Z.Z., Billinghurst, M., Kato, H.: Touch-space: mixed reality game space based on ubiquitous, tangible, and social computing. Pers. Ubiquit. Comput. 6(5–6), 430–442 (2002)

    Article  Google Scholar 

  17. Sra, M., Schmandt, S.: Bringing real objects, spaces, actions, and interactions into social VR. In: Proceedings of the 3rd VR International Workshop on Collaborative Virtual Environments, pp. 16–17. IEEE, Greenville (2016)

    Google Scholar 

  18. Luhmann, T., Robson, S., Kyle, S.A., Harley, I.A.: Close Range Photogrammetry: Principles, Techniques and Applications. Whittles, Dunbeath (2006)

    Google Scholar 

  19. Santagati, C., Inzerillo, L., Di Paola, F.: Image-based modeling techniques for architectural heritage 3D digitalization: limits and potentialities. Int. Arch. Photogrammetry, Remote Sens. Spatial Inf. Sci. 5(w2), 555–560 (2013)

    Article  Google Scholar 

  20. Tong, J., Zhou, J., Liu, L., Pan, Z., Yan, H.: Scanning 3D full human bodies using kinects. Trans. Vis. Comput. Graph. 18(4), 643–650 (2012)

    Article  Google Scholar 

  21. Zhang, Z.: Microsoft kinect sensor and its effect. Multimedia 19(2), 4–10 (2012)

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by VR First (https://www.vrfirst.com/).

Author information

Authors and Affiliations

  1. Department of Cultural Technology and Communication, University of the Aegean, Lesvos, Mytilene, Greece

    Vlasios Kasapakis

  2. Department of Product and Systems Design Engineering, University of the Aegean, Syros, Hermoupolis, Greece

    Damianos Gavalas & Elena Dzardanova

Authors
  1. Vlasios Kasapakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Damianos Gavalas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Elena Dzardanova
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vlasios Kasapakis .

Editor information

Editors and Affiliations

  1. City, University of London, London, United Kingdom

    Adrian David Cheok

  2. University of Tokyo, Tokyo, Japan

    Masahiko Inami

  3. NOVA University of Lisbon, Lisbon, Portugal

    Teresa Romão

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kasapakis, V., Gavalas, D., Dzardanova, E. (2018). Creating Room-Scale Interactive Mixed-Reality Worlds Using Off-the-Shelf Technologies. In: Cheok, A., Inami, M., Romão, T. (eds) Advances in Computer Entertainment Technology. ACE 2017. Lecture Notes in Computer Science(), vol 10714. Springer, Cham. https://doi.org/10.1007/978-3-319-76270-8_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-76270-8_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-76269-2

  • Online ISBN: 978-3-319-76270-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics