Skip to main content
Springer Nature Link
Log in

A Multi-modal Interface for Control of Omnidirectional Video Playing on Head Mount Display

  • Conference paper
  • First Online:
Advances in Internet, Data and Web Technologies (EIDWT 2020)

Part of the book series: Lecture Notes on Data Engineering and Communications Technologies ((LNDECT,volume 47))

  • 976 Accesses

Abstract

In recent years, the omnidirectional video has been used for various purposes. It can be placed on a Head Mount Display (HMD) to give immersive experiences on a head tracking function. In general, the HMD only support a controller to operate a viewpoint, but it can’t see the controller on a virtual world over the HMD. In this paper, we introduce a multi-modal interface to control a spatio-temporal position of an omnidirectional video on HMD application software. We also show an implementation to use a general HMD attached on a Leap motion controller. The implemented multi-modal interface can operate an omnidirectional video used for motions of hands and voice through the Leap Motion controller and a general microphone.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Vo, M.T., Waibel, A.: A multimodal human-computer interface: combination of speech and gesture recognition. In: Proceedings of InterCHI-1993, pp. 69–70 (1993)

    Google Scholar 

  2. Leap Motion: Ultraleap Ltd (2019). https://www.leapmotion.com/

  3. Machidori, Y., Takayama, K., Sugita, K.: Implementation of multi-modal interface for VR application. In: Proceedings of the iCAST-2019, pp. 370–373 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Engineering, Fukuoka Institute of Technology, 3-30-1 Wajiro-Higashi, Higashi-Ku, Fukuoka, 811-0295, Japan

    Yusi Machidori & Ko Takayama

  2. Department of Information and Communication Engineering, Fukuoka Institute of Technology, 3-30-1 Wajiro-Higashi, Higashi-Ku, Fukuoka, 811-0295, Japan

    Kaoru Sugita

Authors
  1. Yusi Machidori
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ko Takayama
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kaoru Sugita
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kaoru Sugita .

Editor information

Editors and Affiliations

  1. Department of Information and Communication Engineering, Fukuoka Institute of Technology, Fukuoka, Japan

    Leonard Barolli

  2. Innovation Center for Educational Resources, University Library, Kyushu University, Fukuoka, Japan

    Yoshihiro Okada

  3. Department of Electrical Engineering and Information Technology, University of Naples "Frederico II", Naples, Italy

    Flora Amato

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Machidori, Y., Takayama, K., Sugita, K. (2020). A Multi-modal Interface for Control of Omnidirectional Video Playing on Head Mount Display. In: Barolli, L., Okada, Y., Amato, F. (eds) Advances in Internet, Data and Web Technologies. EIDWT 2020. Lecture Notes on Data Engineering and Communications Technologies, vol 47. Springer, Cham. https://doi.org/10.1007/978-3-030-39746-3_2

Download citation

Publish with us

Policies and ethics