Abstract
In recent years, wireless sensing has been exploited as a promising research direction for contactless human activity recognition. However, one major issue hindering the real deployment of these systems is that the signal variation patterns induced by the human activities with different devices and environmental settings are neither stable nor consistent, resulting in unstable system performance. The existing machine learning based methods usually take the "black box" approach and fails to achieve consistent performance. In this paper, we argue that a deep understanding of radio signal propagation in wireless sensing is needed, and it may be possible to develop a deterministic sensing model to make the signal variation patterns predictable.
With this intuition, in this paper we investigate: 1) how wireless signals are affected by human activities taking transceiver location and environment settings into consideration; 2) a new deterministic sensing approach to model the received signal variation patterns for different human activities; 3) a proof-of-concept prototype to demonstrate our approach and a case study to detect diverse activities. In particular, we propose a diffraction-based sensing model to quantitatively determine the signal change with respect to a target's motions, which eventually links signal variation patterns with motions, and hence can be used to recognize human activities. Through our case study, we demonstrate that the diffraction-based sensing model is effective and robust in recognizing exercises and daily activities. In addition, we demonstrate that the proposed model improves the recognition accuracy of existing machine learning systems by above 10%.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Towards a Diffraction-based Sensing Approach on Human Activity Recognition
- 2015. Gymwatch. https://www.gymwatch.com/. Online, accessed 10-November-2017.Google Scholar
- 2017. Fitbit. https://www.fitbit.com/. Online, accessed 10-November-2017.Google Scholar
- 2017. Pytorch. https://pytorch.org/. Online, accessed 20-January-2017.Google Scholar
- Fadel Adib and Dina Katabi. 2013. See Through Walls with Wi-Fi!. In Proceedings of the ACM SIGCOMM. ACM, 75--86. Google ScholarDigital Library
- Keng-Hao Chang, Mike Y. Chen, and John Canny. 2007. Tracking free-weight exercises. In ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp. 19--37. Google ScholarDigital Library
- Sunny Consolvo, David W. McDonald, Tammy Toscos, Mike Y. Chen, Jon Froehlich, Beverly Harrison, Predrag Klasnja, Anthony LaMarca, Louis LeGrand, and Ryan Libby et al. 2008. Activity Sensing in the Wild: A Field Trial of Ubifit Garden. In Proceedings of ACM CHI, 1797--1806. Google ScholarDigital Library
- Han Ding, Jinsong Han, Longfei Shangguan, Wei Xi, Zhiping Jiang, Zheng Yang, Zimu Zhou, Panglong Yang, and JiZhong Zhao. 2017. A Platform for Free-weight Exercise Monitoring with Passive Tags. IEEE Transactions on Mobile Computing (2017).Google Scholar
- Shihong Duan, Tianqing Yu, and Jie He. 2018. WiDriver: Driver Activity Recognition System Based on WiFi CSI. In International Journal of Wireless Information Networks. Springer, 146--156.Google Scholar
- Biyi Fang, Nicholas D. Lane, Mi Zhang, Aidan Boran, and Fahim Kawsar. 2016. BodyScan: A Wearable Device for Contact-less Radio-based Sensing of Body-related Activities. In 14th ACM Conference on Mobile Systems, Applications, and Services (MobiSys '16). ACM, 4503--4269.Google ScholarDigital Library
- Chunhai Feng, Sheheryar Arshad, Ruiyun Yu, and Yonghe Liu. 2018. Evaluation and Improvement of Activity Detection Systems with Recurrent Neural Network. In IEEE International Conference on Communications (ICC). IEEE.Google Scholar
- Xiaonan Guo, Jian Liu, and Yingying Chen. 2017. FitCoach: Virtual fitness coach empowered by wearable mobile devices. In IEEE Conference on Computer Communications, INFOCOM. IEEE, 1--9.Google ScholarCross Ref
- Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool release: Gathering 802.11 n traces with channel state information. ACM SIGCOMM Computer Communication Review 41, 1 (2011), 53--53. Google ScholarDigital Library
- Tian Hao, Guoliang Xing, and Gang Zhou. 2015. RunBuddy: A Smartphone System for Running Rhythm Monitoring. In ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp. 133--144. Google ScholarDigital Library
- Wenfeng He, Kaishun Wu, Yongpan Zou, and Zhong Ming. 2015. WiG: WiFi-Based Gesture Recognition System. In 24th International Conference on Computer Communication and Networks. IEEE.Google Scholar
- Hristo D. Hristov. 1999. Fresnal Zones in Wireless Links, Zone Plate Lenses and Antennas. Artech House, Boston, London. Google ScholarDigital Library
- Hristo D Hristov. 2000. Fresnel Zones in Wireless Links, Zone Plate Lenses and Antennas. Artech House, Inc. Google ScholarDigital Library
- He Li, Kaoru Ota, Mianxiong Dong, and Minyi Guo. 2018. Learning Human Activities through Wi-Fi Channel State Information with Multiple Access Points. In IEEE Communications Magazine, Vol. 56. IEEE. Issue 5.Google ScholarCross Ref
- Hong Li, Wei Yang, Jianxin Wang, Yang Xu, and Liusheng Huang. 2016. WiFinger: talk to your smart devices with finger-grained gesture. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 250--261. Google ScholarDigital Library
- Shengjie Li, Xiang Li, Qin Lv, Guiyu Tian, and Daqing Zhang. 2018. WiFit: Ubiquitous Bodyweight Exercise Monitoring with Commodity Wi-Fi Devices. In Proceedings of the International Conference on Ubiquitous Intelligence and Computing. IEEE. Google ScholarDigital Library
- Xiang Li, Shengjie Li, Daqing Zhang, Jie Xiong, Yasha Wang, and Hong Mei. 2016. Dynamic-MUSIC: accurate device-free indoor localization. In Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '16. ACM, 196--207. Google ScholarDigital Library
- Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2016. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 1. ACM. Issue 2. Google ScholarDigital Library
- Xiang Li, Daqing Zhang, Jie Xiong, Yue Zhang, Shengjie Li, Yasha Wang, and Hong Mei. 2018. Training-Free Human Vitality Monitoring using Commodity Wi-Fi Devices. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Vol. 2. ACM. Issue 3. Google ScholarDigital Library
- Chen Liu, Dingyi Fang, Zhe Yang, Hongbo Jiang, Xiaojiang Chen, Wei Wang, Tianzhang Xing, and Lin Cai. 2016. RSS distribution-based passive localization and its application in sensor networks. IEEE Transactions on Wireless Communications 15, 4 (2016), 2883--2895.Google ScholarDigital Library
- Xuefeng Liu, Jiannong Cao, Shaojie Tang, Jiaqi Wen, and Peng Guo. 2016. Contactless Respiration Monitoring Via Off-the-Shelf WiFi Devices. IEEE Transactions on Mobile Computing 15 (2016), 2466--2479.Google ScholarDigital Library
- Bishop Christopher M. 1999. In Pattern Recognition and Machine Learning. Springer.Google Scholar
- Andreas F. Molisch. 2005. Wireless Communications. John Wiley and Sons, Chichester, UK. Google ScholarDigital Library
- Bobak Jack Mortazavi, Mohammad Pourhomayoun, Gabriel Alsheikh, Nabil Alshurafa, Sunghoon Ivan Lee, and Majid Sarrafzadeh. 2014. Determining the single best axis for exercise repetition recognition and counting on smartwatches. In 11th International Conference on Wearable and Implantable Body Sensor Networks (BSN), 33--38. Google ScholarDigital Library
- Kai Niu, Fusang Zhang, Zhaoxin Chang, and Daqing Zhang. 2018. A Fresnel Diffraction Model Based Human Respiration Detection System Using COTS Wi-Fi Devices. In Proceedings of the International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Ubicomp. ACM. Google ScholarDigital Library
- Kai Niu, Fusang Zhang, Jie Xiong, Xiang Li, Enze Yi, and Daqing Zhang. 2018. Boosting fine-grained activity sensing by embracing wireless multipath effects. In Proceedings of the 14th International Conference on emerging Networking Experiments and Technologies, CoNEXT. ACM. Google ScholarDigital Library
- Igor Pernek, Karin Anna Hummel, and Peter Kokol. 2013. Exercise repetition detection for resistance training based on smartphones. Personal and ubiquitous computing 17, 4, 771--782. Google ScholarDigital Library
- Kun Qian, Chenshu Wu, Zimu Zhou, Yue Zheng, Zheng Yang, and Yunhao Liu. 2017. Inferring motion direction using commodity wi-fi for interactive exergames. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1961--1972. Google ScholarDigital Library
- Pu Qifan, Gupta Sidhant, Gollakota Shyamnath, and Patel Shwetak. 2013. Whole-home gesture recognition using wireless signals. In Proceedings of the 19th annual international conference on Mobile computing & networking. ACM, 27--38. Google ScholarDigital Library
- Vittorio Rampa, Stefano Savazzi, Monica Nicoli, and Michele D'Amico. 2015. Physical Modeling and Performance Bounds for Device-free Localization Systems. IEEE Signal Processing Letters 22 (2015), 1864--1868.Google ScholarCross Ref
- Ruth Ravichandran, Elliot Saba, Ke-Yu Chen, Mayank Goel, Sidhant Gupta, and Shwetak N Patel. 2015. WiBreathe: Estimating respiration rate using wireless signals in natural settings in the home. In International Conference on Pervasive Computing and Communications (PerCom). IEEE, St. Louis, MO, USA.Google ScholarCross Ref
- Zhou Ren, Junsong Yuan, Jingjing Meng, and Zhengyou Zhang. 2013. Robust part-based hand gesture recognition using kinect sensor. In IEEE transactions on multimedia, Vol. 15. IEEE, 1110--1120. Google ScholarDigital Library
- Ronald W Schafer. 2011. What is a Savitzky-Golay filter?{lecture notes}. IEEE Signal processing magazine 28, 4 (2011), 111--117.Google Scholar
- Hao Wang, Daqing Zhang, Junyi Ma, YashaWang, YuxiangWang, DanWu, Tao Gu, and Bing Xie. 2016. Human Respiration Detection with Commodity WiFi Devices: Do User Location and Body Orientation Matter?. In Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '16. ACM, 25--36. Google ScholarDigital Library
- Hao Wang, Daqing Zhang, Kai Niu, Qin Lv, Yuanhuai Liu, Dan Wu, Ruiyang Gao, and Bing Xie. 2017. MFDL: A Multicarrier Fresnel Penetration Model based Device-Free Localization System leveraging Commodity Wi-Fi Cards. arXiv (2017).Google Scholar
- Hao Wang, Daqing Zhang, Yasha Wang, Junyi Ma, Yuxiang Wang, and Shengjie Li. 2017. RT-Fall: a real-time and contactless fall detection system with commodity wifi devices. IEEE Transactions on Mobile Computing (2017), 511--526. Google ScholarDigital Library
- Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: Low Human-Effort, Device-Free Localization with Fine-Grained Subcarrier Information. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, MobiCom 2016. ACM, New York City, New York, 243--256. Google ScholarDigital Library
- Wei Wang, Alex X. Liu, and Muhammad Shahzad. 2016. Gait Recognition Using WiFi Signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp. ACM, 363--373. Google ScholarDigital Library
- Wei Wang, Alex X. Liu, Muhammad Shazad, Kang Ling, and Sanglu Lu. 2017. Device-free Human Activity Recognition Using Commercial WiFi Devices. IEEE Journal on Selected Areas in Communications 35 (2017). Issue 5.Google Scholar
- Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures. In Proceedings of the 20th annual international conference on Mobile computing and networking. ACM, 617--628. Google ScholarDigital Library
- Yuxi Wang, Kaishun Wu, and Lionel M. Ni. 2017. WiFall: Device-Free Fall Detection by Wireless Networks. IEEE Transactions on Mobile Computing 16 (2017), 581--594. Issue 2. Google ScholarDigital Library
- Wang Wei, Liu Alex X, Shahzad Muhammad, Ling Kang, and Lu Sanglu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proceedings of the 21st annual international conference on mobile computing and networking. ACM, 65--76. Google ScholarDigital Library
- Dan Wu, Daqing Zhang, Chenren Xu, Hao Wang, and Xiang Li. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine 55 (2017).Google Scholar
- Dan Wu, Daqing Zhang, Chenren Xu, Yasha Wang, and Hao Wang. 2016. WiDir: walking direction estimation using wireless signals. In Proceedings of the International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp '16. ACM, 351--362. Google ScholarDigital Library
- Fu Xiao, Jing Chen, Xiaohui Xie, Linqing Gui, Lijuan Sun, and Ruchuan Wang. 2018. SEARE: A System for Exercise Activity Recognition and Quality Evaluation Based on Green Sensing. In IEEE Transactions Emerging Topics in Computing. IEEE.Google Scholar
- Ning Xiao, Panlong Yang, Yubo Yan, Hao Zhou, and Xiang-Yang Li. 2018. Motion-Fi: Recognizing and Counting Repetitive Motions with Passive Wireless Backscattering. In IEEE International Conference on Computer Communications. IEEE.Google Scholar
- Tong Xin, Bin Guo, Bin Guo, Pei Wang, Jacqueline Chi Kei Lam, Victor Li, and Zhiwen Yu. 2018. FreeSense: A Robust Approach for Indoor Human Detection Using Wi-Fi Signals. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Vol. 2. ACM. Issue 3. Google ScholarDigital Library
- Yanni Yang, Jiannong Cao, Xuefeng Liu, and Kai Xing. 2018. Multi-person Sleeping Respiration Monitoring with COTS WiFi Devices. In 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS). IEEE, 37--45.Google Scholar
- Nan Yu, Wei Wang, Alex X. Liu, and Lingtao Kong. 2018. QGesture: Quantifying Gesture Distance and Direction with WiFi Signals. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Vol. 2. ACM. Issue 1. Google ScholarDigital Library
- Yunze Zeng, Parth H. Pathak, and Prasant Mohapatra. 2016. WiWho: wifi-based person identification in smart spaces. In 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE. Google ScholarDigital Library
- Youwei Zeng, Dan Wu, Ruiyang Gao, Tao Gu, and Daqing Zhang. 2018. FullBreathe: Full Human Respiration Detection Exploiting Complementarity of CSI Phase and Amplitude of WiFi Signals. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. ACM. Google ScholarDigital Library
- Daqing Zhang, Hao Wang, and Dan Wu. 2017. Toward Centimeter-Scale Human Activity Sensing with Wi-Fi Signals. IEEE Computer 50 (2017). Google ScholarCross Ref
- Fusang Zhang, Daqing Zhang, Jie Xiong, Hao Wang, Kai Niu, Beihong Jin, and Yuxiang Wang. 2018. From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices. In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. ACM. Google ScholarDigital Library
- Wenbing Zhao, Hai Feng, Roanna Lun, Deborah D. Espy, and M. Ann Reinthal. 2014. A Kinect-based rehabilitation exercise monitoring and guidance system. In Software Engineering and Service Science, 5th IEEE International Conference on. IEEE, 762--765.Google Scholar
Index Terms
- Towards a Diffraction-based Sensing Approach on Human Activity Recognition
Recommendations
From Fresnel Diffraction Model to Fine-grained Human Respiration Sensing with Commodity Wi-Fi Devices
Non-intrusive respiration sensing without any device attached to the target plays a particular important role in our everyday lives. However, existing solutions either require dedicated hardware or employ special-purpose signals which are not cost-...
Wearable Sensing Framework for Human Activity Monitoring
WearSys '15: Proceedings of the 2015 workshop on Wearable Systems and ApplicationsWearable computation is getting integrated into our daily life day by day. In this work, we propose a generic framework to continuously monitor users' daily activities. The framework proposes light computation tasks on the wearable device to reduce the ...
A Hierarchical Approach towards Activity Recognition
PETRA '17: Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive EnvironmentsActivity recognition with the use of inertial sensors, namely accelerometers and gyroscopes, has gained increasing attention during the last decades. In this work, we propose a novel way of tackling activity classification by developing a multi-step ...
Comments