Skip to main content
SpringerLink
Log in

Estimation of Racket Grip Vibration from Tennis Video by Neural Network

  • Conference paper
  • First Online:
Haptic Interaction (AsiaHaptics 2018)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 535))

Included in the following conference series:

Abstract

In this paper, vibrotactile perception of a person in a video is automatically estimated from the visual and audio information. We limit the video scene to the back view of a tennis player rallying, but other factors such as locations, a player’s clothes, sound environments are arbitrary. We use tennis videos taken in three locations for neural network learning of the relation between the video and measured acceleration of the racket grip. Then we show the grip sensation can be successfully estimated from an unknown video. The quality of the produced vibrotactile sensation is evaluated by a subject experiment. The system is based on a similar concept to VibVid proposed by the authors. In this paper, we examine more general case than the previous research...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Yoshida, K., Horiuchi, Y., Ichiyama, T., Inoue, S., Makino, Y., Shinoda, H.: Estimation and presentation of racket grip vibration with tennis video. In: IEEE Haptics Symposium 2018, Demo 5, California, USA, San Francisco, 25–28 March 2018 (2018)

    Google Scholar 

  2. Danieau, F., Lecuyer, A., Guillotel, P., Fleureau, J., Mollet, N., Christie, M.: Enhancing audiovisual experience with haptic feedback: a survey on HAV. IEEE Trans. Haptics 6(2), 193–205 (2013)

    Article  Google Scholar 

  3. Kim, M., Lee, S., Choi, S.: Saliency-driven real-time video-to-tactile translation. IEEE Trans. Haptics 7(3), 394–404 (2014)

    Article  Google Scholar 

  4. Hwang, I., Choi, S.: Improved haptic music player with auditory saliency estimation. In: Auvray, M., Duriez C. (eds.) Haptics: Neuroscience, Devices, Modeling, and Applications, EuroHaptics 2014. Lecture Notes in Computer Science, vol. 8618. Springer, Heidelberg (2014)

    Google Scholar 

  5. Lee, J., Choi, S.: Real-time perception-level translation from audio signals to vibrotactile effects. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 2567–2576. ACM, New York (2013)

    Google Scholar 

  6. Lee, J., Han, B., Choi, S.: Motion effects synthesis for 4D films. IEEE Trans. Vis. Comput. Graph. 22(10), 2300–2314 (2016)

    Article  Google Scholar 

  7. Gongora, D., Nagano, H., Konyo, M., Tadokoro, S.: Vibrotactile rendering of camera motion for bimanual experience of first-person view videos. In: 2017 IEEE World Haptics Conference (WHC), Munich, pp. 454–459 (2017)

    Google Scholar 

  8. Danieau, F., et al.: Framework for enhancing video viewing experience with haptic effects of motion. In: 2012 IEEE Haptics Symposium (HAPTICS), Vancouver, BC, pp. 541–546 (2012)

    Google Scholar 

  9. Yoshida, K., Inoue, S., Makino, Y., Shinoda, H.: VibVid: VIBration estimation from VIDeo by using neural network. In: Proceedings of the 27th International Conference on Artificial Reality and Telexistence and the 22st Eurographics Symposium on Virtual Environments (ICAT-EGVE 2017). Eurographics Association, Adelaide (in press)

    Google Scholar 

  10. Akahane, K., Hasegawa, S., Koike, Y., Sato, M.: A development of high definition haptic controller. In: First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference, pp. 576–577 (2005)

    Google Scholar 

  11. Oord, A., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A.W., Kavukcuoglu, K.: WaveNet: a generative model for raw audio. CoRR, abs/1609.03499 (2016)

    Google Scholar 

  12. Kingma, D., Ba, J.: Adam: a method for stochastic optimization. CoRR, abs/1412.6980 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, Japan

    Kentaro Yoshida, Yuuki Horiuchi, Tomohiro Ichiyama, Seki Inoue, Yasutoshi Makino & Hiroyuki Shinoda

  2. Graduate School of Frontier Sciences, The University of Tokyo, 5-1-5 Kashiwanoha, Kashiwa-shi, Chiba, Japan

    Yasutoshi Makino & Hiroyuki Shinoda

Authors
  1. Kentaro Yoshida
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuuki Horiuchi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tomohiro Ichiyama
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Seki Inoue
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yasutoshi Makino
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hiroyuki Shinoda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kentaro Yoshida .

Editor information

Editors and Affiliations

  1. Department of Informatics, The University of Electro-Communications, Chofu, Tokyo, Japan

    Hiroyuki Kajimoto

  2. School of Mechanical and Aerospace Engineering, Seoul National University, Seoul, Korea (Republic of)

    Dongjun Lee

  3. Korea University of Technology and Education, Cheonan-si, Ch´ungch´ong-namdo, Korea (Republic of)

    Sang-Youn Kim

  4. Tohoku University, Miyagi, Miyagi, Japan

    Masashi Konyo

  5. Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, Daejeon, Korea (Republic of)

    Ki-Uk Kyung

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yoshida, K., Horiuchi, Y., Ichiyama, T., Inoue, S., Makino, Y., Shinoda, H. (2019). Estimation of Racket Grip Vibration from Tennis Video by Neural Network. In: Kajimoto, H., Lee, D., Kim, SY., Konyo, M., Kyung, KU. (eds) Haptic Interaction. AsiaHaptics 2018. Lecture Notes in Electrical Engineering, vol 535. Springer, Singapore. https://doi.org/10.1007/978-981-13-3194-7_8

Download citation

Publish with us

Policies and ethics

Search

Navigation