skip to main content
research-article

Towards a Diffraction-based Sensing Approach on Human Activity Recognition

Authors Info & Claims
Published:29 March 2019Publication History
Skip Abstract Section

Abstract

In recent years, wireless sensing has been exploited as a promising research direction for contactless human activity recognition. However, one major issue hindering the real deployment of these systems is that the signal variation patterns induced by the human activities with different devices and environmental settings are neither stable nor consistent, resulting in unstable system performance. The existing machine learning based methods usually take the "black box" approach and fails to achieve consistent performance. In this paper, we argue that a deep understanding of radio signal propagation in wireless sensing is needed, and it may be possible to develop a deterministic sensing model to make the signal variation patterns predictable.

With this intuition, in this paper we investigate: 1) how wireless signals are affected by human activities taking transceiver location and environment settings into consideration; 2) a new deterministic sensing approach to model the received signal variation patterns for different human activities; 3) a proof-of-concept prototype to demonstrate our approach and a case study to detect diverse activities. In particular, we propose a diffraction-based sensing model to quantitatively determine the signal change with respect to a target's motions, which eventually links signal variation patterns with motions, and hence can be used to recognize human activities. Through our case study, we demonstrate that the diffraction-based sensing model is effective and robust in recognizing exercises and daily activities. In addition, we demonstrate that the proposed model improves the recognition accuracy of existing machine learning systems by above 10%.

Skip Supplemental Material Section

Supplemental Material

References

  1. 2015. Gymwatch. https://www.gymwatch.com/. Online, accessed 10-November-2017.Google ScholarGoogle Scholar
  2. 2017. Fitbit. https://www.fitbit.com/. Online, accessed 10-November-2017.Google ScholarGoogle Scholar
  3. 2017. Pytorch. https://pytorch.org/. Online, accessed 20-January-2017.Google ScholarGoogle Scholar
  4. Fadel Adib and Dina Katabi. 2013. See Through Walls with Wi-Fi!. In Proceedings of the ACM SIGCOMM. ACM, 75--86. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Keng-Hao Chang, Mike Y. Chen, and John Canny. 2007. Tracking free-weight exercises. In ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp. 19--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Sunny Consolvo, David W. McDonald, Tammy Toscos, Mike Y. Chen, Jon Froehlich, Beverly Harrison, Predrag Klasnja, Anthony LaMarca, Louis LeGrand, and Ryan Libby et al. 2008. Activity Sensing in the Wild: A Field Trial of Ubifit Garden. In Proceedings of ACM CHI, 1797--1806. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Han Ding, Jinsong Han, Longfei Shangguan, Wei Xi, Zhiping Jiang, Zheng Yang, Zimu Zhou, Panglong Yang, and JiZhong Zhao. 2017. A Platform for Free-weight Exercise Monitoring with Passive Tags. IEEE Transactions on Mobile Computing (2017).Google ScholarGoogle Scholar
  8. Shihong Duan, Tianqing Yu, and Jie He. 2018. WiDriver: Driver Activity Recognition System Based on WiFi CSI. In International Journal of Wireless Information Networks. Springer, 146--156.Google ScholarGoogle Scholar
  9. Biyi Fang, Nicholas D. Lane, Mi Zhang, Aidan Boran, and Fahim Kawsar. 2016. BodyScan: A Wearable Device for Contact-less Radio-based Sensing of Body-related Activities. In 14th ACM Conference on Mobile Systems, Applications, and Services (MobiSys '16). ACM, 4503--4269.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chunhai Feng, Sheheryar Arshad, Ruiyun Yu, and Yonghe Liu. 2018. Evaluation and Improvement of Activity Detection Systems with Recurrent Neural Network. In IEEE International Conference on Communications (ICC). IEEE.Google ScholarGoogle Scholar
  11. Xiaonan Guo, Jian Liu, and Yingying Chen. 2017. FitCoach: Virtual fitness coach empowered by wearable mobile devices. In IEEE Conference on Computer Communications, INFOCOM. IEEE, 1--9.Google ScholarGoogle ScholarCross RefCross Ref
  12. Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool release: Gathering 802.11 n traces with channel state information. ACM SIGCOMM Computer Communication Review 41, 1 (2011), 53--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Tian Hao, Guoliang Xing, and Gang Zhou. 2015. RunBuddy: A Smartphone System for Running Rhythm Monitoring. In ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp. 133--144. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Wenfeng He, Kaishun Wu, Yongpan Zou, and Zhong Ming. 2015. WiG: WiFi-Based Gesture Recognition System. In 24th International Conference on Computer Communication and Networks. IEEE.Google ScholarGoogle Scholar
  15. Hristo D. Hristov. 1999. Fresnal Zones in Wireless Links, Zone Plate Lenses and Antennas. Artech House, Boston, London. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hristo D Hristov. 2000. Fresnel Zones in Wireless Links, Zone Plate Lenses and Antennas. Artech House, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. He Li, Kaoru Ota, Mianxiong Dong, and Minyi Guo. 2018. Learning Human Activities through Wi-Fi Channel State Information with Multiple Access Points. In IEEE Communications Magazine, Vol. 56. IEEE. Issue 5.Google ScholarGoogle ScholarCross RefCross Ref
  18. Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. WiFinger: talk to your smart devices with finger-grained gesture. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 250--261. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Shengjie Li, Xiang Li, Qin Lv, Guiyu Tian, and Daqing Zhang. 2018. WiFit: Ubiquitous Bodyweight Exercise Monitoring with Commodity Wi-Fi Devices. In Proceedings of the International Conference on Ubiquitous Intelligence and Computing. IEEE. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Xiang Li, Shengjie Li, Daqing Zhang, Jie Xiong, Yasha Wang, and Hong Mei. 2016. Dynamic-MUSIC: accurate device-free indoor localization. In Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '16. ACM, 196--207. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2016. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 1. ACM. Issue 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Xiang Li, Daqing Zhang, Jie Xiong, Yue Zhang, Shengjie Li, Yasha Wang, and Hong Mei. 2018. Training-Free Human Vitality Monitoring using Commodity Wi-Fi Devices. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Vol. 2. ACM. Issue 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Chen Liu, Dingyi Fang, Zhe Yang, Hongbo Jiang, Xiaojiang Chen, Wei Wang, Tianzhang Xing, and Lin Cai. 2016. RSS distribution-based passive localization and its application in sensor networks. IEEE Transactions on Wireless Communications 15, 4 (2016), 2883--2895.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Xuefeng Liu, Jiannong Cao, Shaojie Tang, Jiaqi Wen, and Peng Guo. 2016. Contactless Respiration Monitoring Via Off-the-Shelf WiFi Devices. IEEE Transactions on Mobile Computing 15 (2016), 2466--2479.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Bishop Christopher M. 1999. In Pattern Recognition and Machine Learning. Springer.Google ScholarGoogle Scholar
  26. Andreas F. Molisch. 2005. Wireless Communications. John Wiley and Sons, Chichester, UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Bobak Jack Mortazavi, Mohammad Pourhomayoun, Gabriel Alsheikh, Nabil Alshurafa, Sunghoon Ivan Lee, and Majid Sarrafzadeh. 2014. Determining the single best axis for exercise repetition recognition and counting on smartwatches. In 11th International Conference on Wearable and Implantable Body Sensor Networks (BSN), 33--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Kai Niu, Fusang Zhang, Zhaoxin Chang, and Daqing Zhang. 2018. A Fresnel Diffraction Model Based Human Respiration Detection System Using COTS Wi-Fi Devices. In Proceedings of the International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Ubicomp. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kai Niu, Fusang Zhang, Jie Xiong, Xiang Li, Enze Yi, and Daqing Zhang. 2018. Boosting fine-grained activity sensing by embracing wireless multipath effects. In Proceedings of the 14th International Conference on emerging Networking Experiments and Technologies, CoNEXT. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Igor Pernek, Karin Anna Hummel, and Peter Kokol. 2013. Exercise repetition detection for resistance training based on smartphones. Personal and ubiquitous computing 17, 4, 771--782. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Kun Qian, Chenshu Wu, Zimu Zhou, Yue Zheng, Zheng Yang, and Yunhao Liu. 2017. Inferring motion direction using commodity wi-fi for interactive exergames. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1961--1972. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Pu Qifan, Gupta Sidhant, Gollakota Shyamnath, and Patel Shwetak. 2013. Whole-home gesture recognition using wireless signals. In Proceedings of the 19th annual international conference on Mobile computing & networking. ACM, 27--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Vittorio Rampa, Stefano Savazzi, Monica Nicoli, and Michele D'Amico. 2015. Physical Modeling and Performance Bounds for Device-free Localization Systems. IEEE Signal Processing Letters 22 (2015), 1864--1868.Google ScholarGoogle ScholarCross RefCross Ref
  34. Ruth Ravichandran, Elliot Saba, Ke-Yu Chen, Mayank Goel, Sidhant Gupta, and Shwetak N Patel. 2015. WiBreathe: Estimating respiration rate using wireless signals in natural settings in the home. In International Conference on Pervasive Computing and Communications (PerCom). IEEE, St. Louis, MO, USA.Google ScholarGoogle ScholarCross RefCross Ref
  35. Zhou Ren, Junsong Yuan, Jingjing Meng, and Zhengyou Zhang. 2013. Robust part-based hand gesture recognition using kinect sensor. In IEEE transactions on multimedia, Vol. 15. IEEE, 1110--1120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Ronald W Schafer. 2011. What is a Savitzky-Golay filter?{lecture notes}. IEEE Signal processing magazine 28, 4 (2011), 111--117.Google ScholarGoogle Scholar
  37. Hao Wang, Daqing Zhang, Junyi Ma, YashaWang, YuxiangWang, DanWu, Tao Gu, and Bing Xie. 2016. Human Respiration Detection with Commodity WiFi Devices: Do User Location and Body Orientation Matter?. In Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '16. ACM, 25--36. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Hao Wang, Daqing Zhang, Kai Niu, Qin Lv, Yuanhuai Liu, Dan Wu, Ruiyang Gao, and Bing Xie. 2017. MFDL: A Multicarrier Fresnel Penetration Model based Device-Free Localization System leveraging Commodity Wi-Fi Cards. arXiv (2017).Google ScholarGoogle Scholar
  39. Hao Wang, Daqing Zhang, Yasha Wang, Junyi Ma, Yuxiang Wang, and Shengjie Li. 2017. RT-Fall: a real-time and contactless fall detection system with commodity wifi devices. IEEE Transactions on Mobile Computing (2017), 511--526. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: Low Human-Effort, Device-Free Localization with Fine-Grained Subcarrier Information. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, MobiCom 2016. ACM, New York City, New York, 243--256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Wei Wang, Alex X. Liu, and Muhammad Shahzad. 2016. Gait Recognition Using WiFi Signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp. ACM, 363--373. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Wei Wang, Alex X. Liu, Muhammad Shazad, Kang Ling, and Sanglu Lu. 2017. Device-free Human Activity Recognition Using Commercial WiFi Devices. IEEE Journal on Selected Areas in Communications 35 (2017). Issue 5.Google ScholarGoogle Scholar
  43. Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures. In Proceedings of the 20th annual international conference on Mobile computing and networking. ACM, 617--628. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Yuxi Wang, Kaishun Wu, and Lionel M. Ni. 2017. WiFall: Device-Free Fall Detection by Wireless Networks. IEEE Transactions on Mobile Computing 16 (2017), 581--594. Issue 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Wang Wei, Liu Alex X, Shahzad Muhammad, Ling Kang, and Lu Sanglu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proceedings of the 21st annual international conference on mobile computing and networking. ACM, 65--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Dan Wu, Daqing Zhang, Chenren Xu, Hao Wang, and Xiang Li. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine 55 (2017).Google ScholarGoogle Scholar
  47. Dan Wu, Daqing Zhang, Chenren Xu, Yasha Wang, and Hao Wang. 2016. WiDir: walking direction estimation using wireless signals. In Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '16. ACM, 351--362. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Fu Xiao, Jing Chen, Xiaohui Xie, Linqing Gui, Lijuan Sun, and Ruchuan Wang. 2018. SEARE: A System for Exercise Activity Recognition and Quality Evaluation Based on Green Sensing. In IEEE Transactions Emerging Topics in Computing. IEEE.Google ScholarGoogle Scholar
  49. Ning Xiao, Panlong Yang, Yubo Yan, Hao Zhou, and Xiang-Yang Li. 2018. Motion-Fi: Recognizing and Counting Repetitive Motions with Passive Wireless Backscattering. In IEEE International Conference on Computer Communications. IEEE.Google ScholarGoogle Scholar
  50. Tong Xin, Bin Guo, Bin Guo, Pei Wang, Jacqueline Chi Kei Lam, Victor Li, and Zhiwen Yu. 2018. FreeSense: A Robust Approach for Indoor Human Detection Using Wi-Fi Signals. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 2. ACM. Issue 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Yanni Yang, Jiannong Cao, Xuefeng Liu, and Kai Xing. 2018. Multi-person Sleeping Respiration Monitoring with COTS WiFi Devices. In 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS). IEEE, 37--45.Google ScholarGoogle Scholar
  52. Nan Yu, Wei Wang, Alex X. Liu, and Lingtao Kong. 2018. QGesture: Quantifying Gesture Distance and Direction with WiFi Signals. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Vol. 2. ACM. Issue 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Yunze Zeng, Parth H. Pathak, and Prasant Mohapatra. 2016. WiWho: wifi-based person identification in smart spaces. In 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Youwei Zeng, Dan Wu, Ruiyang Gao, Tao Gu, and Daqing Zhang. 2018. FullBreathe: Full Human Respiration Detection Exploiting Complementarity of CSI Phase and Amplitude of WiFi Signals. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Daqing Zhang, Hao Wang, and Dan Wu. 2017. Toward Centimeter-Scale Human Activity Sensing with Wi-Fi Signals. IEEE Computer 50 (2017). Google ScholarGoogle ScholarCross RefCross Ref
  56. Fusang Zhang, Daqing Zhang, Jie Xiong, Hao Wang, Kai Niu, Beihong Jin, and Yuxiang Wang. 2018. From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Wenbing Zhao, Hai Feng, Roanna Lun, Deborah D. Espy, and M. Ann Reinthal. 2014. A Kinect-based rehabilitation exercise monitoring and guidance system. In Software Engineering and Service Science, 5th IEEE International Conference on. IEEE, 762--765.Google ScholarGoogle Scholar

Index Terms

  1. Towards a Diffraction-based Sensing Approach on Human Activity Recognition

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 3, Issue 1
      March 2019
      786 pages
      EISSN:2474-9567
      DOI:10.1145/3323054
      Issue’s Table of Contents

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 March 2019
      • Accepted: 1 January 2019
      • Revised: 1 November 2018
      • Received: 1 August 2018
      Published in imwut Volume 3, Issue 1

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader