skip to main content
research-article

TagFree Activity Identification with RFIDs

Published: 26 March 2018 Publication History

Abstract

Human activity identification plays a critical role in many Internet-of-Things applications, which is typically achieved through attaching tracking devices, e.g., RFID tags, to human bodies. The attachment can be inconvenient and considered intrusive. A tag-free solution instead deploys stationary tags as references, and analyzes the backscattered signals that could be affected by human activities in close proximity. The information offered by today's RFID tags however are quite limited, and the typical raw data (RSSI and phase angles) are not necessarily good indicators of human activities (being either insensitive or unreliable as revealed by our realworld experiments). As such, existing tag-based activity identification solutions are far from being satisfactory, not to mention tag-free. It is also well known that the accuracy of the readings can be noticeably affected by multipath, which unfortunately is inevitable in an indoor environment and is complicated with multiple reference tags.
In this paper, we however argue that multipath indeed brings rich information that can be explored to identify fine-grained human activities. Our experiments suggest that both the backscattered signal power and angle are correlated with human activities, impacting multiple paths with different levels. We present TagFree, the first RFID-based device-free activity identification system by analyzing the multipath signals. Different from conventional solutions that directly rely on the unreliable raw data, TagFree gathers massive angle information as spectrum frames from multiple tags, and preprocesses them to extract key features. It then analyzes their patterns through a deep learning framework. Our TagFree is readily deployable using off-the-shelf RFID devices and a prototype has been implemented using a commercial Impinj reader. Our extensive experiments demonstrate the superiority of our TagFree on activity identification in multipath-rich environments.

References

[1]
Muhammad Raisul Alam, Mamun Bin Ibne Reaz, and Mohd Alauddin Mohd Ali. 2012. A review of smart homespast. present, and future. IEEE Transactions on Systems, Man, and Cybernetics 42, 6 (2012), 1190--1203.
[2]
Mathieu Aubry and Bryan C Russell. Understanding deep features with computer-generated imagery. In Proceedings of IEEE CVPR 2015.
[3]
Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using body-worn inertial sensors. Comput. Surveys 46, 3 (2014).
[4]
Jose M Chaquet, Enrique J Carmona, and Antonio Fernández-Caballero. 2013. A survey of video datasets for human action and activity recognition. Computer Vision and Image Understanding 117, 6 (2013), 633--659.
[5]
Krishna Chintalapudi, Anand Padmanabha Iyer, and Venkata N Padmanabhan. Indoor localization without the pain. In Proceedings of ACM MobiCom 2010.
[6]
Han Ding, Longfei Shangguan, Zheng Yang, Jinsong Han, Zimu Zhou, Panlong Yang, Wei Xi, and Jizhong Zhao. Femo: A platform for free-weight exercise monitoring with rfids. In Proceedings of ACM SenSys 2015.
[7]
Jeffrey Donahue, Lisa Anne Hendricks, Sergio Guadarrama, Marcus Rohrbach, Subhashini Venugopalan, Kate Saenko. and Trevor Darrell. Long-term recurrent convolutional networks for visual recognition and description. In Proceedings of IEEE CVPR 2015.
[8]
Xavier Glorot, Antoine Bordes, and Yoshua Bengio. Deep sparse rectifier neural networks. In Proceedings of AISTATS 2011.
[9]
Alex Graves, Marcus Liwicki, Santiago Fernández, Roman Bertolami, Horst Bunke, and Jürgen Schmidhuber. 2009. A novel connectionist system for unconstrained handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 5 (2009), 855--868.
[10]
Alex Graves, Abdel-rahman Mohamed, and Geoffrey Hinton. Speech recognition with deep recurrent neural networks. In Proceedings of IEEE ICASSP 2013.
[11]
Jinsong Han, Han Ding, Chen Qian, Wei Xi, Zhi Wang, Zhiping Jiang, Longfei Shangguan, and Jizhong Zhao. 2016. Cbid: A customer behavior identification system using passive tags. IEEE/ACM Transactions on Networking 24, 5 (2016), 2885--2898.
[12]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of IEEE CVPR 2016.
[13]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735--1780.
[14]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. Imagenet classification with deep convolutional neural networks. In Proceedings of NIPS 2012.
[15]
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner. 1998. Gradient-based learning applied to document recognition. Proc. IEEE 86, 11 (1998), 2278--2324.
[16]
Xinyu Li, Yanyi Zhang, Ivan Marsic, Aleksandra Sarcevic, and Randall S Burd. Deep Learning for RFID-Based Activity Recognition. In Proceedings of ACM SenSys 2016.
[17]
Fabian Pedregosa, Gaël Varoquaux, Alexandre Granifort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, and others. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research 12, Oct (2011), 2825--2830.
[18]
Low Level Reader Protocol. 2007. Version 1.0. 1. EPCglobal Inc, Aug (2007).
[19]
Anshul Rai, Krishna Kant Chintalapudi, Venkata N Padmanabhan, and Rijurekha Sen. Zee: zero-effort crowdsourcing for indoor localization. In Proceedings of ACM MobiCom 2012.
[20]
Ralph Schmidt. 1986. Multiple emitter location and signal parameter estimation. IEEE Transactions on Antennas and Propagation 34, 3 (1986), 276--280.
[21]
Moustafa Seifeldin, Ahmed Saeed, Ahmed E Kosba, Amr El-Keyi, and Moustafa Youssef. 2013. Nuzzer: A large-scale device-free passive localization system for wireless environments. IEEE Transactions on Mobile Computing 12, 7 (2013), 1321--1334.
[22]
Longfei Shangguan, Zheng Yang, Alex X Liu, Zimu Zhou, and Yunhao Liu. Relative Localization of RFID Tags using Spatial-Temporal Phase Profiling. In Proceedings of USENIX NSDI 2015.
[23]
Benjamin Wagner and Dirk Timmermann. Adaptive clustering for device free user positioning utilizing passive RFID. In Proceedings of ACM UbiComp 2013.
[24]
Jue Wang, Fadel Adib, Ross Knepper, Dina Katabi, and Daniela Rus. RF-compass: robot object manipulation using RFIDs. In Proceedings of ACM MobiCom 2013.
[25]
Jue Wang, Deepak Vasisht, and Dina Katabi. RF-IDraw: virtual touch screen in the air using RF signals. In Proceedings of ACM SIGCOMM 2015.
[26]
Ju Wang, Jie Xiong, Hongbo Jiang, Xiaojiang Chen, and Dingyi Fang. D-watch: Embracing" bad" multipaths for device-free localization with COTS RFID devices. In Proceedings of ACM CoNEXT 2016.
[27]
Wei Wang, Alex X Liu, and Muhammad Shahzad. Gait recognition using wifi signals. In Proceedings of ACM UbiComp 2016.
[28]
Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures. In Proceedings of ACM MobiCom 2014.
[29]
Teng Wei and Xinyu Zhang. Gyro in the air: tracking 3D orientation of batteryless internet-of-things. In Proceedings of ACM MobiCom 2016.
[30]
Jiang Xiao, Zimu Zhou, Youwen Yi, and Lionel M Ni. 2016. A Survey on Wireless Indoor Localization from the Device Perspective. Comput. Surveys 49, 2 (2016).
[31]
Lei Yang, Yekui Chen, Xiang-Yang Li, Chaowei Xiao, Mo Li, and Yunhao Liu. Tagoram: Real-time tracking of mobile RFID tags to high precision using COTS devices. In Proceedings of ACM MobiCom 2014.
[32]
Moustafa Youssef, Matthew Mah, and Ashok Agrawala. Challenges: device-free passive localization for wireless environments. In Proceedings of ACM MobiCom 2007.
[33]
Joe Yue-Hei Ng, Matthew Hausknecht, Sudheendra Vijayanarasimhan, Oriol Vinyals, Rajat Monga, and George Toderici. Beyond short snippets: Deep networks for video classification. In Proceedings of IEEE CVPR 2015.
[34]
Daqiang Zhang, Jingyu Zhou, Minyi Guo, Jiannong Cao, and Tianbao Li. 2011. TASA: Tag-free activity sensing using RFID tag arrays. IEEE Transactions on Parallel and Distributed Systems 22, 4 (2011), 558--570.
[35]
Yiyang Zhao, Yunhao Liu, and Lionel M Ni. VIRE: Active RFID-based localization using virtual reference elimination. In Proceedings of IEEE ICPP 2007.

Cited By

View all
  • (2024)Wavelet-domain human activity recognition utilizing convolutional neural networksJournal of Ambient Intelligence and Smart Environments10.3233/AIS-23017416:4(513-526)Online publication date: 1-Jan-2024
  • (2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
  • (2024)Demand-driven Urban Facility Visit PredictionACM Transactions on Intelligent Systems and Technology10.1145/362523315:2(1-24)Online publication date: 22-Feb-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 1
March 2018
1370 pages
EISSN:2474-9567
DOI:10.1145/3200905
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2018
Accepted: 01 January 2018
Revised: 01 November 2017
Received: 01 May 2017
Published in IMWUT Volume 2, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Activity Identification
  2. Backscatter
  3. Deep Learning
  4. RFID

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)36
  • Downloads (Last 6 weeks)7
Reflects downloads up to 01 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Wavelet-domain human activity recognition utilizing convolutional neural networksJournal of Ambient Intelligence and Smart Environments10.3233/AIS-23017416:4(513-526)Online publication date: 1-Jan-2024
  • (2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
  • (2024)Demand-driven Urban Facility Visit PredictionACM Transactions on Intelligent Systems and Technology10.1145/362523315:2(1-24)Online publication date: 22-Feb-2024
  • (2024)Retrieving Similar Trajectories from Cellular Data of Multiple Carriers at City ScaleACM Transactions on Sensor Networks10.1145/361324520:2(1-28)Online publication date: 16-Feb-2024
  • (2024)Human activity recognition: A comprehensive reviewExpert Systems10.1111/exsy.1368041:11Online publication date: 27-Jul-2024
  • (2024)SAT: A Selective Adversarial Training Approach for WiFi-Based Human Activity RecognitionIEEE Transactions on Mobile Computing10.1109/TMC.2024.342040523:12(12706-12716)Online publication date: Dec-2024
  • (2024)WiFi-Based Human Sensing With Deep Learning: Recent Advances, Challenges, and OpportunitiesIEEE Open Journal of the Communications Society10.1109/OJCOMS.2024.34115295(3595-3623)Online publication date: 2024
  • (2024)RF-AcSense: Device-Free Activity Localization and Recognition via Passive RFID Tag Array2024 IEEE 49th Conference on Local Computer Networks (LCN)10.1109/LCN60385.2024.10639663(1-9)Online publication date: 8-Oct-2024
  • (2024)RF-Sign: Position-Independent Sign Language Recognition Using Passive RFID TagsIEEE Internet of Things Journal10.1109/JIOT.2023.332222811:5(9056-9071)Online publication date: 1-Mar-2024
  • (2024)Skeleton-Based Human Activities Fine-grained Recognition with RFID Technology2024 9th International Conference on Signal and Image Processing (ICSIP)10.1109/ICSIP61881.2024.10671507(6-12)Online publication date: 12-Jul-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media