skip to main content
research-article

LiteWiSys: A Lightweight System for WiFi-based Dual-task Action Perception

Published: 11 May 2024 Publication History

Abstract

As two important contents in WiFi-based action perception, detection and recognition require localizing motion regions from the entire temporal sequences and classifying the corresponding categories. Existing approaches, though yielding reasonably acceptable performances, are suffering from two major drawbacks: heavy empirical dependency and large computational complexity. In order to solve these issues, we develop LiteWiSys in this article, a lightweight system in an end-to-end deep learning manner to simultaneously detect and recognize WiFi-based human actions. Specifically, we assign different attentions on sub-carriers, which are then compressed to reduce noise and information redundancy. Then, LiteWiSys integrates deep separable convolution and a channel shuffle mechanism into a multi-scale convolutional backbone structure. By feature channel split, two network branches are obtained and further trained with a joint loss function for dual tasks. We collect different datasets at multi-scenes and conduct experiments to evaluate the performance of LiteWiSys. In comparison to existing WiFi sensing systems, LiteWiSys achieves promising precision with lower complexity.

References

[1]
Heba Abdelnasser, Moustafa Youssef, and Khaled A. Harras. 2015. Wigest: A ubiquitous WiFi-based gesture recognition system. In 2015 IEEE Conference on Computer Communications. IEEE, 1472–1480.
[2]
Musaab Alaziz, Zhenhua Jia, Richard Howard, Xiaodong Lin, and Yanyong Zhang. 2020. In-bed body motion detection and classification system. ACM Transactions on Sensor Networks 16, 2 (2020), 1–26.
[3]
Kamran Ali, Alex X. Liu, Wei Wang, and Muhammad Shahzad. 2015. Keystroke recognition using WiFi signals. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 90–102.
[4]
Yu-Wei Chao, Sudheendra Vijayanarasimhan, Bryan Seybold, David A. Ross, Jia Deng, and Rahul Sukthankar. 2018. Rethinking the faster R-CNN architecture for temporal action localization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1130–1139.
[5]
Jianyang Ding and Yong Wang. 2019. WiFi CSI-based human activity recognition using deep recurrent neural network. IEEE Access 7 (2019), 174257–174269.
[6]
Chao Feng, Nan Wang, Yicheng Jiang, Xia Zheng, Kang Li, Zheng Wang, and Xiaojiang Chen. 2022. Wi-Learner: Towards one-shot learning for cross-domain WiFi based gesture recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–27.
[7]
Yu Gu, Xiang Zhang, Zhi Liu, and Fuji Ren. 2019. BeSense: Leveraging WiFi channel data and computational intelligence for behavior analysis. IEEE Computational Intelligence Magazine 14, 4 (2019), 31–41.
[8]
Chunmei Han, Kaishun Wu, Yuxi Wang, and Lionel M. Ni. 2014. WiFall: Device-free fall detection by wireless networks. In IEEE Conference on Computer Communications (IEEE INFOCOM ’14). 271–279.
[9]
Kai Han, Yunhe Wang, Qi Tian, Jianyuan Guo, Chunjing Xu, and Chang Xu. 2020. Ghostnet: More features from cheap operations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 1580–1589.
[10]
Andrew Howard, Mark Sandler, Grace Chu, Liang-Chieh Chen, Bo Chen, Mingxing Tan, Weijun Wang, Yukun Zhu, Ruoming Pang, Vijay Vasudevan, Quoc V. Le, and Hartwig Adam. 2019. Searching for mobilenetv3. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 1314–1324.
[11]
Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Hartwig Adam. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017).
[12]
Jie Hu, Li Shen, and Gang Sun. 2018. Squeeze-and-excitation networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7132–7141.
[13]
Jinyang Huang, Bin Liu, Hongxin Jin, and Zhiqiang Liu. 2018. WiAnti: An anti-interference activity recognition system based on WiFi CSI. In IEEE International Conference on Internet of Things and IEEE Green Computing and Communications and IEEE Cyber, Physical, and Social Computing and IEEE Smart Data. IEEE, 58–65.
[14]
Forrest N. Iandola, Song Han, Matthew W. Moskewicz, Khalid Ashraf, William J. Dally, and Kurt Keutzer. 2016. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and< 0.5 MB model size. arXiv preprint arXiv:1602.07360 (2016).
[15]
Zahid Younas Khan and Zhendong Niu. 2021. CNN with depthwise separable convolutions and combined kernels for rating prediction. Expert Systems with Applications 170 (2021), 114528.
[16]
Hok-Shing Lau, Ryan McConville, Mohammud J. Bocus, Robert J. Piechocki, and Raul Santos-Rodriguez. 2021. Self-supervised WiFi-based activity recognition. arXiv preprint arXiv:2104.09072 (2021).
[17]
Hang Li, Xi Chen, Ju Wang, Di Wu, and Xue Liu. 2021. DAFI: WiFi-based device-free indoor localization via domain adaptation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 4 (2021), 1–21.
[18]
Shengjie Li, Xiang Li, Qin Lv, Guiyu Tian, and Daqing Zhang. 2018. WiFit: Ubiquitous bodyweight exercise monitoring with commodity WiFi devices. In Proceedings of the IEEE on SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation. 530–537.
[19]
Xin Li and Dawei Li. 2021. GPFS: A graph-based human pose forecasting system for smart home with online learning. ACM Transactions on Sensor Networks 17, 3 (2021), 1–19.
[20]
Yantao Li, Hailong Hu, Zhangqian Zhu, and Gang Zhou. 2020. SCANet: Sensor-based continuous authentication with two-stream convolutional neural networks. ACM Transactions on Sensor Networks 16, 3 (2020), 1–27.
[21]
Chi Lin, Pengfei Wang, Chuanying Ji, Mohammad S. Obaidat, Lei Wang, Guowei Wu, and Qiang Zhang. 2022. A contactless authentication system based on WiFi CSI. ACM Transactions on Sensor Networks 19, 2 (2022), 1–20.
[22]
Jian Liu, Yan Wang, Yingying Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015. Tracking vital signs during sleep leveraging off-the-shelf WiFi. In Proceedings of the 16th ACM International Symposium on Mobile ad Hoc Networking and Computing. 267–276.
[23]
Ningning Ma, Xiangyu Zhang, Hai-Tao Zheng, and Jian Sun. 2018. Shufflenetv2: Practical guidelines for efficient CNN architecture design. In Proceedings of the European Conference on Computer Vision. 116–131.
[24]
Mahdi H. Miraz, Maaruf Ali, Peter S. Excell, and Rich Picking. 2015. A review on internet of things (IoT), internet of everything (IoE) and internet of nano things (IoNT). In Proceedings of the IEEE on Internet Technologies and Applications. 219–224.
[25]
Sameera Palipana, David Rojas, Piyush Agrawal, and Dirk Pesch. 2018. FallDeFi: Ubiquitous fall detection using commodity WiFi devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1–25.
[26]
Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home gesture recognition using wireless signals. In Proceedings of the 19th Annual International Conference on Mobile Computing and Networking. 27–38.
[27]
Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, 234–241.
[28]
Mark Sandler, Andrew Howard, Menglong Zhu, Andrey Zhmoginov, and Liang-Chieh Chen. 2018. Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4510–4520.
[29]
Islam Md Shafiqul, Mir Kanon Ara Jannat, Jin-Woo Kim, Soo-Wook Lee, and Sung-Hyun Yang. 2022. HHI-AttentionNet: An enhanced human-human interaction recognition method based on a lightweight deep learning model with attention network from CSI. Sensors 22, 16 (2022), 6018.
[30]
Cong Shi, Jian Liu, Hongbo Liu, and Yingying Chen. 2017. Smart user authentication through actuation of daily activities leveraging WiFi-enabled IoT. In Proceedings of the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing. 1–10.
[31]
Stephan Sigg, Markus Scholz, Shuyu Shi, Yusheng Ji, and Michael Beigl. 2013. RF-sensing of activities from non-cooperative subjects in device-free recognition systems using ambient and local signals. IEEE Transactions on Mobile Computing 13, 4 (2013), 907–920.
[32]
Qun Song, Zhenyu Yan, and Rui Tan. 2021. DeepMTD: Moving target defense for deep visual sensing against adversarial examples. ACM Transactions on Sensor Networks 18, 1 (2021), 1–32.
[33]
Chandra Sekhar Vorugunti, Viswanath Pulabaigari, Rama Krishna Sai Subrahmanyam Gorthi, and Prerana Mukherjee. 2020. OSVFuseNet: Online signature verification by feature fusion and depth-wise separable convolution based deep learning. Neurocomputing 409 (2020), 157–172.
[34]
Fangxin Wang, Jiangchuan Liu, and Wei Gong. 2019. WiCAR: WiFi-based in-car activity recognition with multi-adversarial domain adaptation. In IEEE/ACM 27th International Symposium on Quality of Service. IEEE, 1–10.
[35]
Fei Wang, Yunpeng Song, Jimuyang Zhang, Jinsong Han, and Dong Huang. 2019. Temporal Unet: Sample level human action recognition using WiFi. arXiv preprint arXiv:1904.11953 (2019).
[36]
Wei Wang, Alex X. Liu, and Muhammad Shahzad. 2016. Gait recognition using WiFi signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 363–373.
[37]
Chunjing Xiao, Yue Lei, Yongsen Ma, Fan Zhou, and Zhiguang Qin. 2020. DeepSeg: Deep-learning-based activity segmentation framework for activity recognition using WiFi. IEEE Internet of Things Journal 8, 7 (2020), 5669–5681.
[38]
Tianzhang Xing, Qing Yang, Zhiping Jiang, Xinhua Fu, Junfeng Wang, Chase Q. Wu, and Xiaojiang Chen. 2022. WiFine: Real-time gesture recognition using WiFi with edge intelligence. ACM Transactions on Sensor Networks 19, 1 (2022), 1–24.
[39]
Huijuan Xu, Abir Das, and Kate Saenko. 2017. R-C3D: Region convolutional 3D network for temporal activity detection. In Proceedings of the IEEE International Conference on Computer Vision. 5783–5792.
[40]
Leiyang Xu, Xiaolong Zheng, Xiangyuan Li, Yucheng Zhang, Liang Liu, and Huadong Ma. 2022. WiCAM: Imperceptible adversarial attack on deep learning based WiFi sensing. In International Conference on Sensing, Communication, and Networking. IEEE, 10–18.
[41]
Huan Yan, Yong Zhang, Yujie Wang, and Kangle Xu. 2019. WiAct: A passive WiFi-based human activity recognition system. IEEE Sensors Journal 20, 1 (2019), 296–305.
[42]
Jianfei Yang, Xinyan Chen, Han Zou, Dazhuo Wang, Qianwen Xu, and Lihua Xie. 2022. Efficientfi: Towards large-scale lightweight WiFi sensing via CSI compression. IEEE Internet of Things Journal 9, 15 (2022), 13086–13095.
[43]
Kun Yang, Xiaolong Zheng, Jie Xiong, Liang Liu, and Huadong Ma. 2022. WiImg: Pushing the limit of WiFi sensing with low transmission rates. In 2022 19th Annual IEEE International Conference on Sensing, Communication, and Networking. 1–9.
[44]
Changqian Yu, Bin Xiao, Changxin Gao, Lu Yuan, Lei Zhang, Nong Sang, and Jingdong Wang. 2021. Lite-hrnet: A lightweight high-resolution network. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10440–10450.
[45]
Youwei Zeng, Dan Wu, Jie Xiong, Enze Yi, Ruiyang Gao, and Daqing Zhang. 2019. FarSense: Pushing the range limit of WiFi-based respiration sensing with CSI ratio of two antennas. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–26.
[46]
Lei Zhang, Yixiang Zhang, and Xiaolong Zheng. 2020. Wisign: Ubiquitous American Sign Language recognition using commercial WiFi devices. ACM Transactions on Intelligent Systems and Technology 11, 3 (2020), 1–24.
[47]
Xiangyu Zhang, Xinyu Zhou, Mengxiao Lin, and Jian Sun. 2018. Shufflenet: An extremely efficient convolutional neural network for mobile devices. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6848–6856.
[48]
Xiaolong Zheng, Jiliang Wang, Longfei Shangguan, Zimu Zhou, and Yunhao Liu. 2016. Smokey: Ubiquitous smoking detection with commercial WiFi infrastructures. In IEEE International Conference on Computer Communications. IEEE, 1–9.
[49]
Xiaolong Zheng, Jiliang Wang, Longfei Shangguan, Zimu Zhou, and Yunhao Liu. 2017. Design and implementation of a CSI-based ubiquitous smoking detection system. IEEE/ACM Transactions on Networking 25, 6 (2017), 3781–3793.

Index Terms

  1. LiteWiSys: A Lightweight System for WiFi-based Dual-task Action Perception

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Sensor Networks
    ACM Transactions on Sensor Networks  Volume 20, Issue 4
    July 2024
    603 pages
    EISSN:1550-4867
    DOI:10.1145/3618082
    • Editor:
    • Wen Hu
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Journal Family

    Publication History

    Published: 11 May 2024
    Online AM: 10 November 2023
    Accepted: 30 October 2023
    Revised: 20 September 2023
    Received: 06 February 2023
    Published in TOSN Volume 20, Issue 4

    Check for updates

    Author Tags

    1. Lightweight
    2. dual-task
    3. wifi-based action perception
    4. detection and recognition

    Qualifiers

    • Research-article

    Funding Sources

    • National Science Fund for Distinguished Young Scholars of China
    • National Natural Science Foundation of China
    • National Science Foundation for Excellent Young Scholars of Jiangsu Province
    • Key Program of the National Natural Science Foundation of China
    • China Postdoctoral Science Foundation
    • China Postdoctoral Special Grant Foundation

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 378
      Total Downloads
    • Downloads (Last 12 months)288
    • Downloads (Last 6 weeks)20
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media