Skip to main content
SpringerLink
Log in

Mobile Devices for Virtual Reality Interaction. A Survey of Techniques and Metaphors

  • Chapter
  • First Online:
Virtual Realities

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 8844))

Abstract

Virtual Reality applications run in a lot of different environments using several different input devices. This can lead to incoherent input metaphors across different environments, even using the same application. Mobile smart devices, such as smart phones and tablets can be used as alternative input devices. They can provide an uniform way of interaction, independent of the actual setting of the VR environment. Additionally, their use does scale well to the number of users in multi-user environments. This chapter presents the current State-of-the-Art in using smart devices as input devices and assesses their applicability in the field of Virtual Reality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.remotemouse.net/.

References

  1. Baglioni, M., Lecolinet, E., Guiard, Y.: JerkTilts: using accelerometers for eight-choice selection on mobile devices. In: Proceedings of the 13th International Conference on Multimodal Interfaces, ICMI 2011, pp. 121–128. ACM, New York (2011)

    Google Scholar 

  2. Bailly, G., Lecolinet, E.: Flower menus: a new type of marking menu with large menu breadth, within groups and efficient expert mode memorization. In: AVI 2008 Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 15–22 (2008)

    Google Scholar 

  3. Bailly, G., Lecolinet, E., Nigay, L.: Wave menus: improving the novice mode of hierarchical marking menus. In: Baranauskas, C., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 475–488. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  4. Ballagas, R., Borchers, J., Rohs, M., Sheridan, J.G.: The smart phone: a ubiquitous input device. IEEE Pervasive Comput. 5(1), 70–77 (2006)

    Article  Google Scholar 

  5. Ballagas, R., Borchers, J., Rohs, M., Sheridan, J.G., Foley, J., Wallace, V., Chan, P.: The smart phone: a the input design space. Shoot (2006)

    Google Scholar 

  6. Ballagas, R., Rohs, M., Sheridan, J.: Sweep and point and shoot: phonecam-based interactions for large public displays. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1200–1203. ACM (2005)

    Google Scholar 

  7. Bauer, J., Ebert, A., Kreylos, O., Hamann, B.: Marking menus for eyes-free interaction using smart phones and tablets. In: Cuzzocrea, A., Kittl, C., Simos, D.E., Weippl, E., Xu, L. (eds.) CD-ARES 2013. LNCS, vol. 8127, pp. 481–494. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  8. Bauer, J., Thelen, S., Ebert, A.: Using smart phones for large-display interaction. In: 2nd International Conference on User Science and Engineering (I-USEr) (2011)

    Google Scholar 

  9. Birnholtz, J.P., Grossman, T., Mak, C., Balakrishnan, R.: An exploratory study of input configuration and group process in a negotiation task using a large display. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 2007, p. 91 (2007)

    Google Scholar 

  10. Buxton, W.: Lexical and pragmatic considerations of input structures. SIGGRAPH Comput. Graph. 17(1), 31–37 (1983)

    Article  Google Scholar 

  11. Dachselt, R., Buchholz, R.: Throw and tilt seamless interaction across devices using mobile phone gestures. In: Proceedings of the MEIS 2008, pp. 272–278 (2008)

    Google Scholar 

  12. Deller, M., Ebert, A.: Modcontrol – mobile phones as a versatile interaction device for large screen applications. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part II. LNCS, vol. 6947, pp. 289–296. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  13. Foley, J., Wallace, V., Chan, P.: Human factors of computer graphics interaction techniques. IEEE Comput. Graph. Appl. 4(11), 13–48 (1984)

    Article  Google Scholar 

  14. Francone, J., Bailly, G., Lecolinet, E., Mandran, N., Nigay, L.: Wavelet menus on handheld devices: stacking metaphor for novice mode and eyes-free selection for expert mode. In: Proceedings of the International Conference on Advanced Visual Interfaces, AVI 2010, pp. 173–180. ACM, New York (2010)

    Google Scholar 

  15. Francone, J., Bailly, G., Nigay, L., Lecolinet, E.: Wavelet menus: a stacking metaphor for adapting marking menus to mobile devices. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 2–5 (2009)

    Google Scholar 

  16. Gebhardt, S., Pick, S., Oster, T., Hentschel, B., Kuhlen, T.: An evaluation of a smart-phone-based menu system for immersive virtual environments. In: 2014 IEEE Symposium on 3D User Interfaces (3DUI), pp. 31–34, March 2014

    Google Scholar 

  17. Kin, K., Hartmann, B.: Two-handed marking menus for multitouch devices. ACM Trans. Comput. Hum. Interact. (TOCHI) TOCHI Homepage Archive 18(2), 16:1–16:23 (2011)

    Google Scholar 

  18. Kurtenbach, G.P.: The design and evaluation of marking menus. Ph.D. thesis, University of Toronto (1993)

    Google Scholar 

  19. Madhavapeddy, A., Scott, D., Sharp, R.: Using camera-phones to enhance human-computer interaction. In: Proceedings of Ubiquitous (2004)

    Google Scholar 

  20. McCallum, D., Irani, P.: Arc-pad: absolute + relative cursor positioning for large displays with a mobile touchscreen. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 153–156. ACM (2009)

    Google Scholar 

  21. Myers, B.A., Peck, C.H., Nichols, J., Kong, D., Miller, R.: Interacting at a distance using semantic snarfing. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 305–314. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  22. Oakley, I., Park, J.: Motion marking menus: an eyes-free approach to motion input for handheld devices. Int. J. Hum. Comput. Stud. 67(6), 515–532 (2009)

    Article  Google Scholar 

  23. Perlin, K.: Quikwriting: continuous stylus-based text entry. In: Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology, UIST 1998, pp. 215–216. ACM, New York (1998)

    Google Scholar 

  24. Pook, S., Lecolinet, E., Vaysseix, G., Ura, E.C., Bp, M.: Control menus: execution and control in a single interactor. In: CHI 2000 Extended Abstracts on Human Factors in Computing Systems, pp. 263–264, April 2000

    Google Scholar 

  25. Rohs, M.: Marker-based embodied interaction for handheld augmented reality games. Virtual Reality 4(5), 1–12 (2007)

    Google Scholar 

  26. Seewoonauth, K., Rukzio, E., Hardy, R., Holleis, P.: Touch & connect and touch & select: interacting with a computer by touching it with a mobile phone. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, p. 36. ACM (2009)

    Google Scholar 

  27. Thelen, S., Meyer, J., Ebert, A., Hagen, H.: A 3D human brain atlas. In: Magnenat-Thalmann, N. (ed.) 3DPH 2009. LNCS, vol. 5903, pp. 173–186. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Graphics and HCI Lab, University of Kaiserslautern, Kaiserslautern, Germany

    Jens Bauer & Achim Ebert

Authors
  1. Jens Bauer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Achim Ebert
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jens Bauer .

Editor information

Editors and Affiliations

  1. TU Chemnitz, Chemnitz, Germany

    Guido Brunnett

  2. Inria Rhône-Alpes, Saint Ismier Cedex, France

    Sabine Coquillart

  3. CWI - Amsterdam, Amsterdam, The Netherlands

    Robert van Liere

  4. The University of Central Florida, Orlando, Florida, USA

    Gregory Welch

  5. Technische Universität Chemnitz, Chemnitz, Germany

    Libor Váša

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Bauer, J., Ebert, A. (2015). Mobile Devices for Virtual Reality Interaction. A Survey of Techniques and Metaphors. In: Brunnett, G., Coquillart, S., van Liere, R., Welch, G., Váša, L. (eds) Virtual Realities. Lecture Notes in Computer Science(), vol 8844. Springer, Cham. https://doi.org/10.1007/978-3-319-17043-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-17043-5_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-17042-8

  • Online ISBN: 978-3-319-17043-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation