skip to main content
research-article

RDGait: A mmWave Based Gait User Recognition System for Complex Indoor Environments Using Single-chip Radar

Published: 09 September 2024 Publication History

Abstract

In this paper, we aim to study millimeter-wave-based gait recognition in complex indoor environments, focusing on dealing with multipath ghosts and supporting rapid deployment to new environments. We design a ghost detection algorithm based on velocity change patterns. This algorithm relies solely on velocity estimation, requiring no environmental priors or multipath modeling. Hence, it is suitable for single-chip millimeter-wave radar with low angular resolution and can be conveniently deployed in new indoor settings. In addition, we build a gait recognition network based on an attention-based Recurrent Neural Network (RNN) to extract spatiotemporal-velocity features from RD heatmaps.
We have evaluated RDGait in two scenarios: a corridor scenario and a crowded office scenario, with 125 volunteers of different genders and ages ranging from 6 to 63. RDGait achieves a user recognition accuracy exceeding 95% among 125 candidates in both scenarios. We have further deployed RDGait in two additional scenarios using the pretrain-finetune approach. With minimal user registration data, RDGait could achieve satisfactory (> 90%) recognition accuracy in these new environments considering different radar placements, heights, and number of co-existing users.

References

[1]
Hervé Abdi. 2007. The Kendall rank correlation coefficient. Encyclopedia of Measurement and Statistics. Sage, Thousand Oaks, CA (2007), 508--510.
[2]
M Umair Bin Altaf, Taras Butko, and Biing-Hwang Juang. 2015. Acoustic gaits: Gait analysis with footstep sounds. IEEE Transactions on Biomedical Engineering(TBME) 62, 8 (2015), 2001--2011.
[3]
Dongjiang Cao, Ruofeng Liu, Hao Li, Shuai Wang, Wenchao Jiang, and Chris Xiaoxuan Lu. 2022. Cross vision-rf gait re-identification with low-cost rgb-d cameras and mmwave radars. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies(IMWUT) 6, 3 (2022), 1--25.
[4]
Hanqing Chao, Kun Wang, Yiwei He, Junping Zhang, and Jianfeng Feng. 2022. GaitSet: Cross-View Gait Recognition Through Utilizing Gait As a Deep Set. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 44, 7 (2022), 3467--3478.
[5]
Weiyan Chen, Hongliu Yang, Xiaoyang Bi, Rong Zheng, Fusang Zhang, Peng Bao, Zhaoxin Chang, Xujun Ma, and Daqing Zhang. 2023. Environment-aware Multi-person Tracking in Indoor Environments with MmWave Radars. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies(IMWUT) 7, 3 (2023), 1--29.
[6]
Yuwei Cheng and Yimin Liu. 2021. Person reidentification based on automotive radar point clouds. IEEE Transactions on Geoscience and Remote Sensing (TGRS) 60 (2021), 1--13.
[7]
Israel Cohen, Yiteng Huang, Jingdong Chen, Jacob Benesty, Jacob Benesty, Jingdong Chen, Yiteng Huang, and Israel Cohen. 2009. Pearson correlation coefficient. Noise reduction in speech processing (2009), 1--4.
[8]
Giuseppe Esposito, Ilaria Catapano, Giovanni Ludeno, Francesco Soldovieri, and Gianluca Gennarelli. 2023. A Deep Learning Strategy for Multipath Ghosts Filtering via Microwave Tomography. IEEE Transactions on Geoscience and Remote Sensing(TGRS) 62 (2023), 1--14.
[9]
Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, et al. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), Vol. 96. 226--231.
[10]
Chao Fan, Yunjie Peng, Chunshui Cao, Xu Liu, Saihui Hou, Jiannan Chi, Yongzhen Huang, Qing Li, and Zhiqiang He. 2020. GaitPart: Temporal Part-Based Model for Gait Recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
[11]
Jinmeng Fan, Hao Zhou, Fengyu Zhou, Xiaoyan Wang, Zhi Liu, and Xiang-Yang Li. 2022. WiVi: WiFi-video cross-modal fusion based multi-path gait recognition system. In 2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS). IEEE, 1--10.
[12]
Xiaoran Fan, David Pearl, Richard Howard, Longfei Shangguan, and Trausti Thormundsson. 2023. APG: Audioplethysmography for Cardiac Monitoring in Hearables. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking (MobiCom). 1--15.
[13]
Ruoyu Feng, Eddy De Greef, Maxim Rykunov, Hichem Sahli, Sofie Pollin, and Andre Bourdoux. 2021. Multipath ghost recognition for indoor mimo radar. IEEE Transactions on Geoscience and Remote Sensing (TGRS) 60 (2021), 1--10.
[14]
Claudio Filipi Gonçalves dos Santos, Diego de Souza Oliveira, Leandro A. Passos, Rafael Gonçalves Pires, Daniel Felipe Silva Santos, Lucas Pascotti Valem, Thierry P. Moreira, Marcos Cleison S. Santana, Mateus Roder, Jo Paulo Papa, et al. 2022. Gait recognition based on deep learning: A survey. ACM Computing Surveys (CSUR) 55, 2 (2022), 1--34.
[15]
Hannah Friederike Fischer, Daniela Wittmann, Alejandro Baucells Costa, Bo Zhou, Gesche Joost, and Paul Lukowicz. 2021. Masquare: A functional smart mask design for health monitoring. In Proceedings of the 2021 ACM International Symposium on Wearable Computers (ISWC). 175--178.
[16]
Xiaonan Guo, Jian Liu, and Yingying Chen. 2016. Automatic personal fitness assistance through wearable mobile devices: Poster. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (MobiCom). 437--438.
[17]
Carl Gustafson, Katsuyuki Haneda, Shurjeel Wyne, and Fredrik Tufvesson. 2013. On mm-wave multipath clustering and channel modeling. IEEE transactions on antennas and propagation 62, 3 (2013), 1445--1455.
[18]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition(CVPR). 770--778.
[19]
James Oat JudgeRoy, B Davis III, and Sylvia Õunpuu. 1996. Step length reductions in advanced age: the role of ankle and hip kinetics. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences 51, 6 (1996), M303-M312.
[20]
Rudolph Emil Kalman. 1960. A new approach to linear filtering and prediction problems. Journal of basic Engineering 82, 1 (1960), 35--45.
[21]
Alexander Kamann, Patrick Held, Florian Perras, Patrick Zaumseil, Thomas Brandmeier, and Ulrich T Schwarz. 2018. Automotive radar multipath propagation in uncertain environments. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC). IEEE, 859--864.
[22]
Belal Korany, Chitra R Karanam, Hong Cai, and Yasamin Mostofi. 2019. XModal-ID: Using WiFi for through-wall person identification from candidate video footage. In The 25th Annual International Conference on Mobile Computing and Networking (MobiCom). 1--15.
[23]
Harold W Kuhn. 1955. The Hungarian method for the assignment problem. Naval research logistics quarterly 2, 1--2 (1955), 83--97.
[24]
Jiarong Li, Zihan Wang, Zihao Zhao, Yuchao Jin, Jihong Yin, Shao-Lun Huang, and Jiyu Wang. 2021. TriboGait: A deep learning enabled triboelectric gait sensor system for human activity recognition and individual identification. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers (UbiComp/ISWC). 643--648.
[25]
Tao Li, Dianqi Han, Jiawei Li, Ang Li, Yan Zhang, Rui Zhang, and Yanchao Zhang. 2021. Your home is insecure: Practical attacks on wireless home alarm systems. In IEEE Conference on Computer Communications (INFOCOM). 1--10.
[26]
Xiang Li, Yasushi Makihara, Chi Xu, Yasushi Yagi, Shiqi Yu, and Mingwu Ren. 2020. End-to-end model-based gait recognition. In Proceedings of the Asian conference on computer vision (ACCV).
[27]
Yunda Li and Xiaolei Shang. 2022. Multipath ghost target identification for automotive MIMO radar. In 2022 IEEE 96th Vehicular Technology Conference (VTC2022-Fall). IEEE, 1--5.
[28]
Jie Lian, Changlai Du, Jiadong Lou, Li Chen, and Xu Yuan. 2023. EchoSensor: Fine-Grained Ultrasonic Sensing for Smart Home Intrusion Detection. ACM Transactions on Sensor Networks (TOSN) 20, 1 (2023), 1--24.
[29]
Hankai Liu, Xiulong Liu, Xin Xie, Xinyu Tong, and Keqiu Li. 2024. PmTrack: Enabling Personalized mmWave-based Human Tracking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 7, 4 (2024), 1--30.
[30]
James MacQueen et al. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of the fifth Berkeley symposium on mathematical statistics and probability, Vol. 1. 281--297.
[31]
Zhen Meng, Song Fu, Jie Yan, Hongyuan Liang, Anfu Zhou, Shilin Zhu, Huadong Ma, Jianhua Liu, and Ning Yang. 2020. Gait recognition for co-existing multiple people using millimeter wave sensing. In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), Vol. 34. 849--856.
[32]
Mostafa Mirshekari, Jonathon Fagert, Amelie Bonde, Pei Zhang, and Hae Young Noh. 2018. Human gait monitoring using footstep-induced floor vibrations across different structures. In Proceedings of the 2018 ACM international joint conference and 2018 international symposium on pervasive and ubiquitous computing and wearable computers (UbiComp/ISWC). 1382--1391.
[33]
Leann Myers and Maria J Sirois. 2004. Spearman correlation coefficients, differences between. Encyclopedia of statistical sciences 12 (2004).
[34]
Edwin Pan, Jingning Tang, Dash Kosaka, Ruihao Yao, and Arjun Gupta. 2019. OpenRadar. https://github.com/presenseradar/openradar.
[35]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, et al. 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems (NeurIPS) 32 (2019).
[36]
Jacopo Pegoraro, Francesca Meneghello, and Michele Rossi. 2020. Multiperson continuous tracking and identification from mm-wave micro-Doppler signatures. IEEE Transactions on Geoscience and Remote Sensing (TGRS) 59, 4 (2020), 2994--3009.
[37]
Jacopo Pegoraro and Michele Rossi. 2022. Human tracking with mmWave radars: A deep learning approach with uncertainty estimation. In 2022 IEEE 23rd International Workshop on Signal Processing Advances in Wireless Communication (SPAWC). IEEE, 1--5.
[38]
Jacopo Pegoraro, Domenico Solimini, Federico Matteo, Enver Bashirov, Francesca Meneghello, and Michele Rossi. 2020. Deep learning for accurate indoor human tracking with a mm-wave radar. In 2020 IEEE Radar Conference (RadarConf20). IEEE, 1--6.
[39]
Akarsh Pokkunuru, Kalvik Jakkala, Arupjyoti Bhuyan, Pu Wang, and Zhi Sun. 2018. NeuralWave: Gait-based user identification through commodity WiFi and deep learning. In IECON 2018-44th Annual Conference of the IEEE Industrial Electronics Society. IEEE, 758--765.
[40]
Yao Qin, Dongjin Song, Haifeng Cheng, Wei Cheng, Guofei Jiang, and Garrison W Cottrell. 2017. A dual-stage attention-based recurrent neural network for time series prediction. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI). 2627--2633.
[41]
Veenu Rani and Munish Kumar. 2023. Human gait recognition: A systematic review. Multimedia Tools and Applications (MTA) (2023), 1--35.
[42]
Yili Ren, Yichao Wang, Sheng Tan, Yingying Chen, and Jie Yang. 2022. Person re-identification using wifi signals. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking (MobiCom). 829--831.
[43]
Lior Rokach and Oded Maimon. 2005. Clustering methods. Data mining and knowledge discovery handbook (2005), 321--352.
[44]
Ali Hussein Sabry, Ahmed Sabry, Wan Zuha Wan Hasan, Mohd Nazim Mohtar, Raja Mohd Kamil Raja Ahmad, Hafiz Rashidi Ramli, Ang Swee Peng, and Zainidi Haji Abdul Hamid. 2018. Foot plantar pressure distribution modeling based on image processing. In IEEE International Conference on Smart Instrumentation, Measurement and Application (ICSIMA). 1--4.
[45]
Alireza Sepas-Moghaddam and Ali Etemad. 2022. Deep gait recognition: A survey. IEEE transactions on pattern analysis and machine intelligence (TPAMI) 45, 1 (2022), 264--284.
[46]
Xingzhe Song, Boyuan Yang, Ge Yang, Ruirong Chen, Erick Forno, Wei Chen, and Wei Gao. 2020. SpiroSonic: monitoring human lung function via acoustic sensing on commodity smartphones. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking (MobiCom). 1--14.
[47]
Torben Teepe, Ali Khan, Johannes Gilg, Fabian Herzog, Stefan Hörmann, and Gerhard Rigoll. 2021. Gaitgraph: Graph convolutional network for skeleton-based gait recognition. In IEEE International Conference on Image Processing (ICIP). 2314--2318.
[48]
TI. 2019. DCA1000 evaluation module for real-time data capture and streaming. https://www.ti.com.com/tool/DCA1000EVM.
[49]
TI. 2021. IWR6843 intelligent mmWave sensor standard antenna plug-in module. https://www.ti.com/tool/IWR6843ISK.
[50]
J v. Neumann. 1928. Zur theorie der gesellschaftsspiele. Mathematische annalen 100, 1 (1928), 295--320.
[51]
Philip van Dorp and FCA Groen. 2008. Feature-based human motion parameter estimation with radar. IET Radar, Sonar & Navigation 2, 2 (2008), 135--145.
[52]
Baptist Vandersmissen, Nicolas Knudde, Azarakhsh Jalalvand, Ivo Couckuyt, Andre Bourdoux, Wesley De Neve, and Tom Dhaene. 2018. Indoor person identification using a low-power FMCW radar. IEEE Transactions on Geoscience and Remote Sensing (TGRS) 56, 7 (2018), 3941--3952.
[53]
Jack L Walker. 1980. Range-Doppler imaging of rotating objects. IEEE Transactions on Aerospace and Electronic systems (TAES) 1 (1980), 23--52.
[54]
Changsheng Wan, Li Wang, and Vir V Phoha. 2018. A survey on gait recognition. ACM Computing Surveys (CSUR) 51, 5 (2018), 1--35.
[55]
Yinxin Wan, Xuanli Lin, Kuai Xu, Feng Wang, and Guoliang Xue. 2023. Extracting Spatial Information of IoT Device Events for Smart Home Safety Monitoring. In IEEE Conference on Computer Communications (INFOCOM). 1--10.
[56]
Wei Wang, Alex X Liu, and Muhammad Shahzad. 2016. Gait recognition using wifi signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp). 363--373.
[57]
Xinshuo Weng, Jianren Wang, David Held, and Kris Kitani. 2020. 3d multi-object tracking: A baseline and new evaluation metrics. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 10359--10366.
[58]
Yadong Xie, Fan Li, Yue Wu, and Yu Wang. 2021. HearFit: Fitness monitoring on smart speakers via active acoustic sensing. In IEEE Conference on Computer Communications (INFOCOM). 1--10.
[59]
Wei Xu, ZhiWen Yu, Zhu Wang, Bin Guo, and Qi Han. 2019. Acousticid: gait-based human identification using acoustic signal. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 3, 3 (2019), 1--25.
[60]
Hongfei Xue, Yan Ju, Chenglin Miao, Yijiang Wang, Shiyang Wang, Aidong Zhang, and Lu Su. 2021. mmMesh: Towards 3D real-time dynamic human mesh construction using millimeter-wave. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys). 269--282.
[61]
Xin Yang, Jian Liu, Yingying Chen, Xiaonan Guo, and Yucheng Xie. 2020. MU-ID: Multi-user identification through gaits using millimeter wave radios. In IEEE Conference on Computer Communications (INFOCOM). 2589--2598.
[62]
Jia Zhang, Rui Xi, Yuan He, Yimiao Sun, Xiuzhen Guo, Weiguo Wang, Xin Na, Yunhao Liu, Zhenguo Shi, and Tao Gu. 2023. A survey of mmWave-based human sensing: Technology, platforms and applications. IEEE Communications Surveys & Tutorials (2023).
[63]
Shaohu Zhang and Anupam Das. 2021. A 2-FA for home voice assistants using inaudible acoustic signal. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking (MobiCom). 834--836.
[64]
Jingyue Zheng, Xingyu Gu, Shisheng Guo, and Guolong Cui. 2021. Multipath False Target Removal for Indoor Localization. In International Conference on Autonomous Unmanned Systems. Springer, 1367--1378.

Cited By

View all
  • (2025)mmWave Based User Identification using Gait Signatures2025 17th International Conference on COMmunication Systems and NETworks (COMSNETS)10.1109/COMSNETS63942.2025.10885571(1032-1036)Online publication date: 6-Jan-2025
  • (2024)LR-Auth: Towards Practical Implementation of Implicit User Authentication on EarbudsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997938:4(1-27)Online publication date: 21-Nov-2024
  • (2024)SpaceBeat: Identity-aware Multi-person Vital Signs Monitoring Using Commodity WiFiProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785908:3(1-23)Online publication date: 9-Sep-2024
  • Show More Cited By

Index Terms

  1. RDGait: A mmWave Based Gait User Recognition System for Complex Indoor Environments Using Single-chip Radar

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 8, Issue 3
    September 2024
    1782 pages
    EISSN:2474-9567
    DOI:10.1145/3695755
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 September 2024
    Published in IMWUT Volume 8, Issue 3

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. ghost identification
    2. human identification
    3. mmWave radar

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)470
    • Downloads (Last 6 weeks)71
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)mmWave Based User Identification using Gait Signatures2025 17th International Conference on COMmunication Systems and NETworks (COMSNETS)10.1109/COMSNETS63942.2025.10885571(1032-1036)Online publication date: 6-Jan-2025
    • (2024)LR-Auth: Towards Practical Implementation of Implicit User Authentication on EarbudsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997938:4(1-27)Online publication date: 21-Nov-2024
    • (2024)SpaceBeat: Identity-aware Multi-person Vital Signs Monitoring Using Commodity WiFiProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785908:3(1-23)Online publication date: 9-Sep-2024
    • (2024)Functional Now, Wearable Later: Examining the Design Practices of Wearable TechnologistsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676615(71-81)Online publication date: 5-Oct-2024
    • (2024)Emotion Recognition on the Go: Utilizing Wearable IMUs for Personalized Emotion RecognitionCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678452(537-544)Online publication date: 5-Oct-2024
    • (2024)Pushing the Limits of Acoustic Spatial Perception via Incident Angle EncodingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595838:2(1-28)Online publication date: 15-May-2024
    • (2024)Thermal In Motion: Designing Thermal Flow Illusions with Tactile and Thermal InteractionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676460(1-13)Online publication date: 13-Oct-2024
    • (2024)Adaptive Metasurface-Based Acoustic Imaging using Joint OptimizationProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661863(492-504)Online publication date: 3-Jun-2024
    • (2024)See Through Vehicles: Fully Occluded Vehicle Detection with Millimeter Wave RadarProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690658(740-754)Online publication date: 4-Dec-2024
    • (2024)Affective RelevanceIEEE Intelligent Systems10.1109/MIS.2024.339150839:4(12-22)Online publication date: 19-Apr-2024

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media