skip to main content
10.1145/3341163.3347724acmconferencesArticle/Chapter ViewAbstractPublication PagesubicompConference Proceedingsconference-collections
short-paper

InDexMo: exploring finger-worn RFID motion tracking for activity recognition on tagged objects

Published: 09 September 2019 Publication History

Abstract

This work explores and evaluates the designs of finger-worn radio-frequency identification (RFID) motion tracking for activity recognition on tagged objects. We propose an index-finger-worn device that consists of a short-range (~2cm) RFID reader and a pair of two inertial measurement units (IMUs), which are mounted at the locations where an artificial nail and a ring are worn. The short-range RFID reader recognizes the tagged object on finger touch, and then the IMU data are used for activity recognition. Data collected from the user of this device allows for a post-hoc analysis, which informs the activity recognition performance in various RFID+IMU and IMU-only configurations on the same task. The results of a ten-participant user study show that when the objects have similar physical form factors, the hybrid RFID motion tracking significantly outperforms the IMU-only tracking, especially in a larger-number set of objects. In our test, three IMU configurations (i.e., NailOnly, RingOnly, and Nail+Ring) achieved comparable action recognition performances, i.e., ≥90% accuracy, with 500 ms recognition time, though the NailOnly RFID+IMU configuration provided the highest wearability. The practical challenges toward a real-world deployment of a finger-worn RFID motion tracking system are also discussed.

References

[1]
Gilles Bailly, Jörg Müller, Michael Rohs, Daniel Wigdor, and Sven Kratz. 2012. ShoeSense: A New Perspective on Gestural Interaction and Wearable Applications. In Proc. ACM CHI '12. 1239--1248.
[2]
J. C. Becker and N. V. Thakor. 1988. A study of the range of motion of human fingers with application to anthropomorphic designs. IEEE Transactions on Biomedical Engineering (1988), 110--117.
[3]
Eugen Berlin, Jun Liu, Kristof van Laerhoven, and Bernt Schiele. {n. d.}. Coming to Grips with the Objects We Grasp: Detecting Interactions with Efficient Wrist-worn Sensors. In Proc. TEI '10.
[4]
Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang, and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. In Proc. ACM UIST '15. 549--556.
[5]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. {n. d.}. FingerPad: Private and Subtle Interaction Using Fingertips. In Proc. ACM UIST '13.
[6]
Chih-Chung Chang and Chih-Jen Lin. 2011. LIBSVM: A Library for Support Vector Machines. ACM Trans. Intell. Syst. Technol. 2, 3, Article 27 (May 2011), 27:1--27:27 pages.
[7]
Ke-Yu Chen, Kent Lyons, Sean White, and Shwetak Patel. {n. d.}. uTrack: 3D Input Using Two Magnetic Sensors. In Proc. ACM UIST '13.
[8]
Andrea Colaço, Ahmed Kirmani, Hye Soo Yang, Nan-Wei Gong, Chris Schmandt, and Vivek K. Goyal. {n. d.}. Mime: Compact, Low Power 3D Gesture Sensing for Interaction with Head Mounted Displays. In Proc. ACM UIST '13.
[9]
Artem Dementyev and Joseph A. Paradiso. {n. d.}. WristFlex: Low-power Gesture Input with Wrist-worn Pressure Sensors. In Proc. ACM UIST '14.
[10]
Christine Dierk, Tomás Vega Gálvez, and Eric Paulos. {n. d.}. AlterNail: Ambient, Batteryless, Stateful, Dynamic Displays at Your Fingertips. In Proc. ACM CHI '17.
[11]
L. Dipietro, A. M. Sabatini, and P. Dario. 2008. A Survey of Glove-Based Systems and Their Applications. IEEE Transactions on Systems, Man, and Cybernetics, Part C 38, 4 (2008), 461--482.
[12]
Assaf Feldman, Emmanuel Munguia Tapia, Sajid Sadi, Pattie Maes, and Chris Schmandt. {n. d.}. ReachMedia: On-the-move Interaction with Everyday Objects. In Proc. IEEE ISWC '05.
[13]
K. P. Fishkin, M. Philipose, and A. Rea. {n. d.}. Hands-on RFID: wireless wearables for detecting use of objects. In Proc. IEEE ISWC '05.
[14]
Sean Gustafson, Daniel Bierwirth, and Patrick Baudisch. 2010. Imaginary Interfaces: Spatial Interaction with Empty Hands and Without Visual Feedback. In Proc. ACM UIST '10. 3--12.
[15]
Chris Harrison, Hrvoje Benko, and Andrew D. Wilson. 2011. OmniTouch: Wearable Multitouch Interaction Everywhere. In Proc. ACM UIST '11. 441--450.
[16]
Chris Harrison, Desney Tan, and Dan Morris. {n. d.}. Skinput: Appropriating the Body As an Input Surface. In Proc. ACM CHI '10.
[17]
Jason Hong. 2013. Considering Privacy Issues in the Context of Google Glass. Commun. ACM 56, 11 (Nov. 2013), 10--11.
[18]
Yi-Ta Hsieh, Antti Jylhä, Valeria Orso, Luciano Gamberini, and Giulio Jacucci. 2016. Designing a Willing-to-Use-in-Public Hand Gestural Interaction Technique for Smart Glasses. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4203--4215.
[19]
Da-Yuan Huang, Liwei Chan, Shuo Yang, Fan Wang, Rong-Hao Liang, De-Nian Yang, Yi-Ping Hung, and Bing-Yu Chen. {n. d.}. DigitSpace: Designing Thumb-to-Fingers Touch Interfaces for One-Handed and Eyes-Free Interactions. In Proc. ACM CHI '16.
[20]
Lei Jing, Yinghui Zhou, Zixue Cheng, and Tongjun Huang. 2012. Magic ring: A finger-worn device for multiple appliances control using static finger gestures. Sensors 12, 5 (2012), 5775--5790.
[21]
Hsin-Liu (Cindy) Kao, Artem Dementyev, Joseph A. Paradiso, and Chris Schmandt. {n. d.}. NailO: Fingernails As an Input Surface. In Proc. ACM CHI '15.
[22]
Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. {n. d.}. DuoSkin: Rapidly Prototyping On-skin User Interfaces Using Skin-friendly Materials. In Proc. ACM ISWC '16.
[23]
Wolf Kienzle and Ken Hinckley. {n. d.}. LightRing: Always-available 2D Input on Any Surface. In Proc. ACM UIST '14.
[24]
David Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: Freehand 3D Interactions Anywhere Using a Wrist-worn Gloveless Sensor. In Proc. ACM UIST '12. 167--176.
[25]
Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proc. ACM UIST '16. 321--333.
[26]
Gierad Laput, Chouchang Yang, Robert Xiao, Alanson Sample, and Chris Harrison. 2015. EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects. In Proc. ACM UIST '15. 157--166.
[27]
Rong-Hao Liang, Meng-Ju Hsieh, Jheng-You Ke, Jr-Ling Guo, and Bing-Yu Chen. {n. d.}. RFIMatch: Distributed Batteryless Near-Field Identification Using RFID-Tagged Magnet-Biased Reed Switches. In Proc. ACM UIST '18.
[28]
Shu-Yang Lin, Chao-Huai Su, Kai-Yin Cheng, Rong-Hao Liang, Tzu-Hao Kuo, and Bing-Yu Chen. {n. d.}. Pub - Point Upon Body: Exploring Eyes-free Interaction and Methods on an Arm. In Proc. ACM UIST '11.
[29]
Christine L MacKenzie and Thea Iberall. 1994. The grasping hand. Vol. 104. Elsevier.
[30]
Einar Sneve Martinussen and Timo Arnall. {n. d.}. Designing with RFID. In Proc. ACM TEI '09.
[31]
Masa Ogata, Yuta Sugiura, Hirotaka Osawa, and Michita Imai. {n. d.}. iRing: Intelligent Ring Using Infrared Reflection. In Proc. ACM UIST '12.
[32]
T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, and James A. Landay. {n. d.}. Enabling Always-available Input with Muscle-computer Interfaces. In Proc. ACM UIST '09.
[33]
Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touche: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proc. ACM CHI'12. 483--492.
[34]
Roy Shilkrot, Jochen Huber, Connie Liu, Pattie Maes, and Suranga Chandima Nanayakkara. {n. d.}. FingerReader: A Wearable Device to Support Text Reading on the Go. In ACM CHI EA '14.
[35]
Chao-Huai Su, Liwei Chan, Chien-Ting Weng, Rong-Hao Liang, Kai-Yin Cheng, and Bing-Yu Chen. {n. d.}. NailDisplay: Bringing an Always Available Visual Display to Fingertips. In Proc. ACM CHI '13.
[36]
Katia Vega and Hugo Fuks. 2013. Beauty Tech Nails: Interactive Technology at Your Fingertips. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). ACM, New York, NY, USA, 61--64.
[37]
Mark Weiser. 1991. The computer for the 21st century. Scientific american 265, 3 (1991), 94--104.
[38]
Katrin Wolf and Jonas Willaredt. 2015. PickRing: Seamless Interaction Through Pick-up Detection. In Proceedings of the 6th Augmented Human International Conference (AH '15). ACM, New York, NY, USA, 13--20.
[39]
Xing-Dong Yang, Tovi Grossman, Daniel Wigdor, and George Fitzmaurice. 2012. Magic Finger: Always-available Input Through Finger Instrumentation. In Proc. ACM UIST '12. 147--156.
[40]
Sang Ho Yoon, Yunbo Zhang, Ke Huo, and Karthik Ramani. {n. d.}. TRing: Instant and Customizable Interactions with Objects Using an Embedded Magnet and a Finger-Worn Device. In Proc. ACM UIST '16.
[41]
Yang Zhang and Chris Harrison. {n. d.}. Tomo: Wearable, Low-Cost Electrical Impedance Tomography for Hand Gesture Recognition. In Proc. ACM UIST '15.

Cited By

View all
  • (2024)Functional Now, Wearable Later: Examining the Design Practices of Wearable TechnologistsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676615(71-81)Online publication date: 5-Oct-2024
  • (2024)A Handwriting Recognition System With WiFiIEEE Transactions on Mobile Computing10.1109/TMC.2023.327960823:4(3391-3409)Online publication date: Apr-2024
  • (2023)Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581422(1-18)Online publication date: 19-Apr-2023
  • Show More Cited By

Index Terms

  1. InDexMo: exploring finger-worn RFID motion tracking for activity recognition on tagged objects

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ISWC '19: Proceedings of the 2019 ACM International Symposium on Wearable Computers
    September 2019
    355 pages
    ISBN:9781450368704
    DOI:10.1145/3341163
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 September 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. RFID
    2. activity recognition
    3. finger-worn device
    4. motion tracking
    5. nail-mounted device

    Qualifiers

    • Short-paper

    Conference

    UbiComp '19

    Acceptance Rates

    Overall Acceptance Rate 38 of 196 submissions, 19%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)22
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 10 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Functional Now, Wearable Later: Examining the Design Practices of Wearable TechnologistsProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676615(71-81)Online publication date: 5-Oct-2024
    • (2024)A Handwriting Recognition System With WiFiIEEE Transactions on Mobile Computing10.1109/TMC.2023.327960823:4(3391-3409)Online publication date: Apr-2024
    • (2023)Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581422(1-18)Online publication date: 19-Apr-2023
    • (2023)ACTIVA: Innovation in Quality of Care for Nursing Homes Through Activity RecognitionIEEE Access10.1109/ACCESS.2023.332974811(123335-123349)Online publication date: 2023
    • (2023)TAHAR: A Transferable Attention-Based Adversarial Network for Human Activity Recognition with RFIDAdvanced Intelligent Computing Technology and Applications10.1007/978-981-99-4742-3_20(247-259)Online publication date: 30-Jul-2023
    • (2022)MicroFluIDProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35502966:3(1-23)Online publication date: 7-Sep-2022
    • (2022)Body-Centric NFC: Body-Centric Interaction with NFC Devices Through Near-Field Enabled ClothingProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3534569(1626-1639)Online publication date: 13-Jun-2022
    • (2022)Sensing Performance of Multi-Channel RFID-Based Finger Augmentation Devices for Tactile InternetIEEE Journal of Radio Frequency Identification10.1109/JRFID.2022.31783486(209-217)Online publication date: 2022
    • (2021)Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future ChallengesACM Computing Surveys10.1145/346796354:8(1-38)Online publication date: 4-Oct-2021
    • (2021)RFInsole: Batteryless Gait-Monitoring Smart Insole Based on Passive RFID TagsProceedings of the 2021 ACM International Symposium on Wearable Computers10.1145/3460421.3478810(141-143)Online publication date: 21-Sep-2021
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media