Skip to main content

TV Remote Control Using Human Hand Motion Based on Optical Flow System

  • Conference paper
Computational Science and Its Applications – ICCSA 2012 (ICCSA 2012)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7335))

Included in the following conference series:

Abstract

Motion recognition systems have been widely developed in the field of human computer interaction. Methods, such as pointing, dynamic gesture and static gesture or hand held devices have been proposed for motion recognition. The motion recognition systems have been gradually adapted to home appliances in our daily. In this paper, we focus on TV interaction, since the device is a recent representative multimedia device applying the motion technique. Most motion recognition systems utilize 3D data, such as horizontal, vertical and depth information by stereo camera or ToF (Time of Flight) camera. However, this paper proposes the different techniques for human-TV interaction. We propose an optical flow based motion recognition system that provides direction and speed, in addition to the position of the moving target in real time. These factors are useful in recognizing human motion more effectively and more dynamically. Therefore, we design the natural interaction for human-TV using these motion data. The calculation process of optical flow is outside the scope of this paper. This real time optical flow calculation is implemented using the FPGA chip supporting parallel processing by a hardware team in our laboratory. We propose a method for human motion recognition based on real time optical flow system.

This research was supported by the MKE(The Ministry of Knowledge Economy), Korea, under the ITRC(Information Technology Research Center) support program (NIPA-2012-(H0301-12-3001))supervised by the NIPA(National IT Industry Promotion Agency), and by Priority Research Centers Program through the National Research Foundation of Korea(NRF) funded by the Ministry of Education, Science and Technology(2011-0018397).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wachs, J.P., Kolsch, M., Stern, H., Edan, Y.: Vision-Based Hand-Gesture Applications. Magazine Communication of the ACM 54(2) (2011)

    Google Scholar 

  2. Freeman, A.T., Weissman, C.D.: Television control by hand gesture. In: IEEE Intl. Workshop on Automatic Face and Gesture Recognition, Zurich (June 1995)

    Google Scholar 

  3. Wilson, A., Oliver, N.: GWindows: Robust Stereo Vision for Gesture-Based Control of Windows. In: Proceedings of the 5th International Conference on Multimodal Interfaces, ACM ICMI 2003 (2003)

    Google Scholar 

  4. Michael, V.D.B., Luc, V.G.: Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction. In: 2011 IEEE Workshop on Applications of Computer Vision (WACV), pp. 66–72 (2011)

    Google Scholar 

  5. Takahashi, M., Fujii, M., Naemura, M., Satoh, S.: Human Gesture Recognition using 3.5-Dimensional Trajectory Features for Hands-Free User Interface. In: Proceedings of the First ACM International Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams (ARTEMIS 2010) (October 2010)

    Google Scholar 

  6. Chang, Y.H., Chan, L.W., Ko, J.C., Lee, M.S., Hsu, J., Hung, Y.P.: QPalm: A Gesture Recognition System for Remote Control with List Menu. In: IEEE International Conference on Ubi-Media Computing, pp. 20–26 (2008)

    Google Scholar 

  7. Chen, M.Y., et al.: Controllingyour TV with gestures. In: Proceedings of the International Conference on Multimedia Information Retrieval (MIR) (March 2010)

    Google Scholar 

  8. Hsieh, C.C., Liou, D.H., Lee, D.: A Real Time Hand Gesture Recognition System Using Motion History Image. In: Signal Processing Systems (ICSPS) (2010)

    Google Scholar 

  9. Yamada, R., Kuriiwa, H., Oka, M., Mori, H.: A Study on Selection Ability in the 3D Space by the Finger. In: SICE Annual Conference 2010, pp. 1933–1942 (2010)

    Google Scholar 

  10. Cutler, R., Turk, M.: View-based Interpretation of Real-time Optical Flow for Gesture Recognition. In: Proceedings of Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 416–421 (1998)

    Google Scholar 

  11. Bernard, A., Bing, B.: Hand Gesture Video Browsing for Broadband-Enabled HDTVs. In: 2010 IEEE Sarnoff Symposium, pp. 1–5 (2010)

    Google Scholar 

  12. Chai, X., Fang, Y., Wang, K.: Robust Hand Gesture Analysis and Application in Gallery Browsing. In: IEEE International Conference on Multimedia and Expo., ICME 2009, pp. 938–941 (2009)

    Google Scholar 

  13. Xia, L., Fujimura, K.: Hand Gesture Recognition using Depth Data. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 529–534 (2004)

    Google Scholar 

  14. Lee, D.W., Lim, J.M., Sunwoo, J., Cho, I.Y., Lee, C.H.: Actual Remote Control: A Universal Remote Control using Hand Motions on a Virtual Menu. IEEE Transactions on Consumer Electronics 55(3), 1439–1446 (2009)

    Article  Google Scholar 

  15. Kim, S.K., Park, G.Y., Yim, S.H., Choi, S.M., Choi, S.J.: Gesture-Recognizing Hand-Held Interface with Vibrotactile Feedback for 3D Interaction. IEEE Transactions on Consumer Electronics 55(3), 1169–1177 (2009)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jeong, S., Song, T., Kwon, K., Jeon, J.W. (2012). TV Remote Control Using Human Hand Motion Based on Optical Flow System. In: Murgante, B., et al. Computational Science and Its Applications – ICCSA 2012. ICCSA 2012. Lecture Notes in Computer Science, vol 7335. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31137-6_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-31137-6_24

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-31136-9

  • Online ISBN: 978-3-642-31137-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics