skip to main content
10.1145/3416010.3423241acmconferencesArticle/Chapter ViewAbstractPublication PagesmswimConference Proceedingsconference-collections
short-paper

Trajectory-Assisted Robust RFID-tagged Object Tracking and Recognition in Room Environment

Published: 16 November 2020 Publication History

Abstract

This paper takes a Computer-Vision (CV) and RFID fusion approach to tracking RFID-tagged objects in a room environment. Unlike similar CV-RFID fusion techniques that fuse two different estimates from CV and RFID systems to increase the certainty of locations, our system does not directly localize RFID tags. Instead, each tag-attached object's usage time by a human is detected by observation of the tag's phase variance. The time is then used to identify the pinpoint locations where the object is handed and released by the human, using the corresponding human trajectory observed by 3D depth cameras. RSSI variance caused by human movement is also leveraged to estimate rough locations of such objects that are not used by humans. Finally, the correspondence between the objects and RFID tags is automatically recognized by clustering the feature vectors of objects. Consequently, once the type of one object, such as pen, book, and cup, the other objects in the cluster can be annotated with the same object type to facilitate object management in the system. The experimental results have shown that object usage is detected with 0.984 accuracy, objects are localized with 58.3cm median error in severe NLoS environment, and ten types of objects are identified with 0.842 accuracy in a laboratory room.

References

[1]
E. L. Berz, D. A. Tesch, and F. P. Hessel. 2018. Machine-learning-based system for multi-sensor 3D localisation of stationary objects. IET Cyber-Physical Systems: Theory Applications, Vol. 3, 2 (2018), 81--88.
[2]
L. Chang, X. li, J. Wang, H. Meng, X. Chen, D. Fang, Z. Tang, and Z. Wang. 2018. Towards Large-Scale RFID Positioning: A Low-cost, High-precision Solution Based on Compressive Sensing. In 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10.
[3]
C. Duan, X. Rao, L. Yang, and Y. Liu. 2017. Fusing RFID and computer vision for fine-grained object tracking. In IEEE INFOCOM 2017 - IEEE Conference on Computer Communications. 1--9.
[4]
Hanchuan Li, Peijin Zhang, Samer Al Moubayed, Shwetak N. Patel, and Alanson P. Sample. 2016. ID-Match: A Hybrid Computer Vision and RFID System for Recognizing Individuals in Groups. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 4933--4944. https://doi.org/10.1145/2858036.2858209
[5]
F. Manzoor, Y. Huang, and K. Menzel. 2010. Passive RFID-based Indoor Positioning System, An Algorithmic Approach. In 2010 IEEE International Conference on RFID-Technology and Applications. 112--117.
[6]
Jue Wang and Dina Katabi. 2013. Dude, Where's My Card? RFID Positioning That Works with Multipath and Non-Line of Sight. SIGCOMM Comput. Commun. Rev., Vol. 43, 4 (Aug. 2013), 51--62. https://doi.org/10.1145/2534169.2486029
[7]
Zhongqin Wang, Min Xu, Ning Ye, Ruchuan Wang, and Haiping Huang. 2019. RF-Focus: Computer Vision-Assisted Region-of-Interest RFID Tag Recognition and Localization in Multipath-Prevalent Environments. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 3, 1, Article 29 (March 2019), 30 pages. https://doi.org/10.1145/3314416
[8]
Y. Zhang, Y. Ma, X. Miao, S. Zhang, and B. Wang. 2019. Multipath Mitigation Algorithm for Multifrequency-Based Ranging via Convex Relaxation in Passive UHF RFID. IEEE Internet of Things Journal, Vol. 6, 1 (2019), 744--752.

Cited By

View all
  • (2025)Review on Systems Combining Computer Vision and Radio Frequency IdentificationIEEE Internet of Things Journal10.1109/JIOT.2024.348475512:2(1291-1319)Online publication date: 15-Jan-2025

Index Terms

  1. Trajectory-Assisted Robust RFID-tagged Object Tracking and Recognition in Room Environment

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MSWiM '20: Proceedings of the 23rd International ACM Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems
    November 2020
    278 pages
    ISBN:9781450381178
    DOI:10.1145/3416010
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 November 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. data fusion
    2. object localization
    3. rfid
    4. tracking

    Qualifiers

    • Short-paper

    Conference

    MSWiM '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 398 of 1,577 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)16
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Review on Systems Combining Computer Vision and Radio Frequency IdentificationIEEE Internet of Things Journal10.1109/JIOT.2024.348475512:2(1291-1319)Online publication date: 15-Jan-2025

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media