Skip to main content
SpringerLink
Log in
Book cover

Asia-Pacific Web Conference

APWeb 2016: Web Technologies and Applications pp 53–65Cite as

A Real Time Wireless Interactive Multimedia System

  • Conference paper
  • First Online:

  • 2284 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9931))

Abstract

Recent years, various interactive multimedia systems have been applied to relevant fields such as education, entertainment, etc. Researchers exploit sensors, computer vision, ultrasonic, and electromagnetic radiation to achieve human-computer interaction (HCI). This paper proposes an interactive wireless multimedia system which utilizes ubiquitous wireless signals to identify human motions around smart WiFi devices. Compared with related work, our system realizes interactions between human and computer without extra hardware devices. The system identifies human gestures around the smart devices (i.e., a laptop) equipped with the commercial 802.11n NIC, and it maps different gestures into distinguishable computer instructions. We build a proof-of-concept prototype using off-the-shelf laptop and evaluate the system in a laboratory environment with standard WiFi access points. The results show that our system detects human gesture with an accuracy over 95 % and it achieves an average gesture classification accuracy of 89 % for five different users.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Toshibag55. http://www.engadget.com/2008/06/14/toshiba-qosmiog55-featuresspursengine-visual-gesture-controls/

  2. Gupta, S., Morris, D., Patel, S., Tan, D.: Soundwave: using the doppler effect to sense gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1911–1914. ACM (2012)

    Google Scholar 

  3. Shotton, J., Sharp, T., Kipman, A., Fitzgibbon, A., Finocchio, M., Blake, A., Cook, M., Moore, R.: Real-time human pose recognition in parts from single depth images. Commun. ACM 56(1), 116–124 (2013)

    Article  Google Scholar 

  4. Cohn, G., Morris, D., Patel, S., Tan, D.: Humantenna: using the body as an antenna for real-time whole-body interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1901–1910. ACM (2012)

    Google Scholar 

  5. Harrison, C., Tan, D., Morris, D.: Skinput: appropriating the body as an input surface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 453–462. ACM (2010)

    Google Scholar 

  6. Kim, D., Hilliges, O., Izadi, S., Butler, A.D., Chen, J., Oikonomidis, I., Olivier, P.: Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, pp. 167–176. ACM (2012)

    Google Scholar 

  7. Scholz, M., Sigg, S., Schmidtke, H.R., Beigl, M.: Challenges for device-free radio-based activity recognition. In: Proceedings of the 3rd Workshop on Context Systems, Design, Evaluation and Optimisation (CoSDEO 2011), in Conjunction with MobiQuitous, vol. 2011 (2011)

    Google Scholar 

  8. Pu, Q., Gupta, S., Gollakota, S., Patel, S.: Whole-home gesture recognition using wireless signals. In: Proceedings of the 19th Annual International Conference on Mobile Computing & Networking, pp. 27–38. ACM (2013)

    Google Scholar 

  9. Adib, F., Katabi, D.: See through walls with wifi!, vol. 43. ACM (2013)

    Google Scholar 

  10. Halperin, D., Hu, W., Sheth, A., Wetherall, D.: Tool release: gathering 802.11 n traces with channel state information. ACM SIGCOMM Comput. Commun. Rev. 41(1), 53–53 (2011)

    Article  Google Scholar 

  11. Wang, W., Liu, A.X., Shahzad, M., Ling, K., Lu, S.: Understanding and modeling of wifi signal based human activity recognition. In: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, pp. 65–76. ACM (2015)

    Google Scholar 

  12. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The weka data mining software: an update. ACM SIGKDD Explorations Newslett. 11(1), 10–18 (2009)

    Article  Google Scholar 

  13. Myers, B.A.: A brief history of human-computer interaction technology. Interactions 5(2), 44–54 (1998)

    Article  Google Scholar 

  14. Sutherland, I.E.: Sketch pad a man-machine graphical communication system. In: Proceedings of the SHARE Design Automation Workshop, pp. 6–329. ACM (1964)

    Google Scholar 

  15. XboxKinect. http://www.xbox.com/en-US/kinect

  16. Abdelnasser, H., Youssef, M., Harras, K.A.: Wigest: A ubiquitous wifi-based gesture recognition system. In: 2015 IEEE Conference on Computer Communications (INFOCOM), pp. 1472–1480. IEEE (2015)

    Google Scholar 

  17. Pickering, C.A., Burnham, K.J., Richardson, M.J.: A research study of hand gesture recognition technologies and applications for human vehicle interaction. In: 3rd Conference on Automotive Electronics. Citeseer (2007)

    Google Scholar 

  18. Wachs, J.P., Kölsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Commun. ACM 54(2), 60–71 (2011)

    Article  Google Scholar 

  19. Melgarejo, P., Zhang, X., Ramanathan, P., Chu, D.: Leveraging directional antenna capabilities for fine-grained gesture recognition. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 541–551. ACM (2014)

    Google Scholar 

  20. LeapMotion. https://www.leapmotion.com/

  21. Dipietro, L., Sabatini, A.M., Dario, P.: A survey of glove-based systems and their applications. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 38(4), 461–482 (2008)

    Article  Google Scholar 

  22. Tarzia, S.P., Dick, R.P., Dinda, P.A., Memik, G.: Sonar-based measurement of user presence and attention. In: Proceedings of the 11th International Conference on Ubiquitous Computing, pp. 89–92. ACM (2009)

    Google Scholar 

  23. Scholz, M., Riedel, T., Hock, M., Beigl, M.: Device-free and device-bound activity recognition using radio signal strength. In: Proceedings of the 4th Augmented Human International Conference, pp. 100–107. ACM (2013)

    Google Scholar 

  24. Adib, F., Kabelac, Z., Katabi, D., Miller, R.C.: 3d tracking via body radio reflections. In: 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14), pp. 317–329 (2014)

    Google Scholar 

  25. Wang, G., Zou, Y., Zhou, Z., Wu, K., Ni, L.M.: We can hear you with wi-fi! In: Proceedings of the 20th Annual International Conference on Mobile Computing and Networking, pp. 593–604. ACM (2014)

    Google Scholar 

  26. Ali, K., Liu, A.X., Wang, W., Shahzad, M.: Keystroke recognition using wifi signals. In: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, pp. 90–102. ACM (2015)

    Google Scholar 

  27. Sun, L., Sen, S., Koutsonikolas, D., Kim, K.H.: Widraw: enabling hands-free drawing in the air on commodity wifi devices. In: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, pp. 77–89. ACM (2015)

    Google Scholar 

Download references

Acknowledgments

We would like to thank the anonymous reviewers for their valuable comments for improving the quality of the paper. This work was supported by the National Natural Science Foundation of China (No. 61572456) and the Natural Science Foundation of Jiangsu Province of China (No. BK20151241).

Author information

Authors and Affiliations

  1. University of Science and Technology of China, Hefei, China

    Hong Li, Wei Yang, Yang Xu, Jianxin Wang & Liusheng Huang

Authors
  1. Hong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yang Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jianxin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Liusheng Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei Yang .

Editor information

Editors and Affiliations

  1. School of Computing, University of Utah, Salt Lake City, Utah, USA

    Feifei Li

  2. School of Electrical Engineering, Seoul National University, Seoul, Korea (Republic of)

    Kyuseok Shim

  3. Soochow University , Suzhou, China

    Kai Zheng

  4. Soochow University , Suzhou, China

    Guanfeng Liu

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Li, H., Yang, W., Xu, Y., Wang, J., Huang, L. (2016). A Real Time Wireless Interactive Multimedia System. In: Li, F., Shim, K., Zheng, K., Liu, G. (eds) Web Technologies and Applications. APWeb 2016. Lecture Notes in Computer Science(), vol 9931. Springer, Cham. https://doi.org/10.1007/978-3-319-45814-4_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-45814-4_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-45813-7

  • Online ISBN: 978-3-319-45814-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation