research-article

RIO: A Pervasive RFID-based Touch Gesture Interface

Authors:

Swadhin Pradhan,

Karthikeyan Sundaresan,

Mohammad A. Khojastepour,

Sampath RangarajanAuthors Info & Claims

MobiCom '17: Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking

Pages 261 - 274

https://doi.org/10.1145/3117811.3117818

Published: 04 October 2017 Publication History

Abstract

In this paper, we design and develop RIO, a novel battery-free touch sensing user interface (UI) primitive for future IoT and smart spaces. RIO enables UIs to be constructed using off-the-shelf RFID readers and tags, and provides a unique approach to designing smart IoT spaces. With RIO, any surface can be turned into a touch-aware surface by simply attaching RFID tags to them. RIO also supports custom-designed RFID tags, and thus allows specially customized UIs to be easily deployed into a real-world environment. RIO is built using the technique of impedance tracking: when a human finger touches the surface of an RFID tag, the impedance of the antenna changes. This change manifests as a change in the phase of the RFID backscattered signal, and is used by RIO to track fine-grained touch movement over both off-the shelf and custom built tags. We study this impedance behavior in-depth and show how RIO is a reliable UI primitive that is robust even within a multi-tag environment. We leverage this primitive to build a prototype of RIO that can continuously locate a finger during a swipe movement to within 3 mm of its actual position. We also show how custom-design RFID tags can be built and used with RIO, and provide two example applications that demonstrate its real-world use.

References

[1]

Q. Pu, S. Gupta, S. Gollakota, and S. Patel, "Whole-home gesture recognition using wireless signals," in Proceedings of the 19th Annual International Conference on Mobile Computing & Networking, MobiCom '13, (New York, NY, USA), pp. 27--38, ACM, 2013.

Digital Library

[2]

L. Sun, S. Sen, D. Koutsonikolas, and K.-H. Kim, "Widraw: Enabling hands-free drawing in the air on commodity wifi devices," in Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, MobiCom '15, (New York, NY, USA), pp. 77--89, ACM, 2015.

Digital Library

[3]

S. Yun, Y.-C. Chen, and L. Qiu, "Turning a mobile device into a mouse in the air," in Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services, MobiSys '15, (New York, NY, USA), pp. 15--29, ACM, 2015.

Digital Library

[4]

S. Kim, W. Choi, W. Rim, Y. Chun, H. Shim, H. Kwon, J. Kim, I. Kee, S. Kim, S. Lee, and J. Park, "A highly sensitive capacitive touch sensor integrated on a thin-film-encapsulated active-matrix oled for ultrathin displays," IEEE Transactions on Electron Devices, vol. 58, pp. 3609--3615, Oct 2011.

[5]

M. Kranz, P. Holleis, and A. Schmidt, "Embedded interaction: Interacting with the internet of things," IEEE Internet Computing, vol. 14, pp. 46--53, March 2010.

Digital Library

[6]

H. Ding, L. Shangguan, Z. Yang, J. Han, Z. Zhou, P. Yang, W. Xi, and J. Zhao, "Femo: A platform for free-weight exercise monitoring with rfids," in Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems, SenSys '15, (New York, NY, USA), pp. 141--154, ACM, 2015.

Digital Library

[7]

Y. Zou, J. Xiao, J. Han, K. Wu, Y. Li, and L. M. Ni, "Grfid: A device-free gesture recognition system using cots rfid device," IEEE Transactions on Mobile Computing, vol. PP, no. 99, pp. 1--1, 2016.

[8]

H. Li, C. Ye, and A. P. Sample, "Idsense: A human object interaction detection system based on passive uhf rfid," in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, (New York, NY, USA), pp. 2555--2564, ACM, 2015.

Digital Library

[9]

H. Li, E. Brockmeyer, E. J. Carter, J. Fromm, S. E. Hudson, S. N. Patel, and A. Sample, "Paperid: A technique for drawing functional battery-free wireless interfaces on paper," in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, CHI '16, (New York, NY, USA), pp. 5885--5896, ACM, 2016.

Digital Library

[10]

J. Wang, D. Vasisht, and D. Katabi, "Rf-idraw: Virtual touch screen in the air using rf signals," in Proceedings of the 2014 ACM Conference on SIGCOMM, SIGCOMM '14, (New York, NY, USA), pp. 235--246, ACM, 2014.

Digital Library

[11]

L. Yang, Y. Chen, X.-Y. Li, C. Xiao, M. Li, and Y. Liu, "Tagoram: Real-time tracking of mobile rfid tags to high precision using cots devices," in Proceedings of the 20th Annual International Conference on Mobile Computing and Networking, MobiCom '14, (New York, NY, USA), pp. 237--248, ACM, 2014.

Digital Library

[12]

A. P. Sample, D. J. Yeager, and J. R. Smith, "A capacitive touch interface for passive rfid tags," in 2009 IEEE International Conference on RFID, pp. 103--109, April 2009.

[13]

K. Aga, H. Tarao, and S. Urushihara, "Calculation of human body resistance at power frequency using anatomic numerical human model," Energy Procedia, vol. 89, pp. 401 -- 407, 2016. CoE on Sustainable Energy System (Thai-Japan), Faculty of Engineering, Rajamangala University of Technology Thanyaburi (RMUTT), Thailand.

[14]

N. Jonassen, "Human body capacitance: static or dynamic concept? {esd}," in Electrical Overstress/ Electrostatic Discharge Symposium Proceedings. 1998 (Cat. No.98TH8347), pp. 111--117, Oct 1998.

[15]

"Smartrac dogbone rfid paper tag (monza 4d)." https://www.atlasrfidstore.com/smartrac-dogbone-rfid-paper-tag-monza-4d/a.

[16]

Y. Tanaka, Y. Umeda, O. Takyu, M. Nakayama, and K. Kodama, "Change of read range for uhf passive rfid tags in close proximity," in 2009 IEEE International Conference on RFID, pp. 338--345, April 2009.

[17]

S. E. Asl, M. T. Ghasr, M. Zawodniok, and K. E. Robinson, "Preliminary study of mutual coupling effect on a passive rfid antenna array," in 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), pp. 138--141, May 2013.

[18]

P. V. Nikitin and K. V. S. Rao, "Theory and measurement of backscattering from rfid tags," IEEE Antennas and Propagation Magazine, vol. 48, pp. 212--218, Dec 2006.

[19]

T. Wei and X. Zhang, "Gyro in the air: Tracking 3d orientation of batteryless internet-of-things," in Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking, MobiCom '16, (New York, NY, USA), pp. 55--68, ACM, 2016.

Digital Library

[20]

K. V. S. Rao, P. V. Nikitin, and S. F. Lam, "Impedance matching concepts in rfid transponder design," in Proceedings of the Fourth IEEE Workshop on Automatic Identification Advanced Technologies, AUTOID '05, (Washington, DC, USA), pp. 39--42, IEEE Computer Society, 2005.

Digital Library

[21]

P. V. Nikitin, K. V. S. Rao, S. Member, and S. Lazar, "An overview of near field uhf rfid," 2007.

[22]

"Impinj speedway uhf rfid reader." https://www.impinj.com/products/readers/.

[23]

"Epc/rfid llrp standards." http://www.gs1.org/epcrfid/epc-rfid-llrp/1--1-0.

[24]

"Octane sdk for impinj." https://support.impinj.com/hc/en-us/articles/202755268-Octane-SDK.

[25]

"Speedway revolution reader application note low level." http://bit.ly/2geiFVA.

[26]

N. Cho, J. Yoo, S. J. Song, J. Lee, S. Jeon, and H. J. Yoo, "The human body characteristics as a signal transmission medium for intrabody communication," IEEE Transactions on Microwave Theory and Techniques, vol. 55, pp. 1080--1086, May 2007.

[27]

L. Baxter, Capacitive Sensors: Design and Applications. IEEE Press Series on Electronics Technology, John Wiley & Sons, 1996.

[28]

R. A. A. Rodrigues, E. C. Gurjão, and F. M. de Assis, "Radar cross-section and electric field analysis of backscattering elements of chipless rfid tag," in 2014 IEEE RFID Technology and Applications Conference (RFID-TA), pp. 103--108, Sept 2014.

[29]

B. D. Braaten, G. J. Owen, and R. M. Nelson, "Design of space-filling antennas for passive uhf rfid tags," INTECH Open Access Publisher, 2010.

[30]

W. Stutzman and G. Thiele, Antenna Theory and Design. Antenna Theory and Design, Wiley, 2012.

[31]

"Array Solutions VNA-UHF - Two Port Vector Network Analyzer, 5 kHz to 1200 MHz. " https://www.arraysolutions.com/vna-uhf.

[32]

"Mutual coupling in antenna arrays." https://nus.edu/2o5J8IN.

[33]

A. Park and J. R. Glass, "Towards unsupervised pattern discovery in speech," in IEEE Workshop on Automatic Speech Recognition and Understanding, pp. 53--58, Nov 2005.

[34]

Y. Zhang and J. R. Glass, "Unsupervised spoken keyword spotting via segmental dtw on gaussian posteriorgrams.," in ASRU, pp. 398--403, IEEE, 2009.

[35]

A. S. Park and J. R. Glass, "Unsupervised pattern discovery in speech," IEEE Transactions on Audio, Speech, and Language Processing, vol. 16, pp. 186--197, Jan 2008.

Digital Library

[36]

"Specification for rfid air interface epc radio-frequency identity protocols class-1 generation-2 uhf rfid protocol for communications at 860 mhz--960 mhz." http://bit.ly/2gem5Ie.

[37]

"ipod click wheel." http://bit.ly/2gfTW2z.

[38]

"Alien 9613 higgs-3 loop near-field rfid tag." https://www.atlasrfidstore.com/alien-sit-rfid-white-wet-inlay-aln-9613-higgs-3/.

[39]

K. V. S. Rao, P. V. Nikitin, and S. F. Lam, "Antenna design for uhf rfid tags: a review and a practical application," IEEE Transactions on Antennas and Propagation, vol. 53, pp. 3870--3876, Dec 2005.

[40]

N. Ma and L. Chen, "The design of folded dipole antenna," in 2008 4th International Conference on Wireless Communications, Networking and Mobile Computing, pp. 1--3, Oct 2008.

[41]

"Rfid coil antennas." http://bit.ly/2h8wLZI.

[42]

M. Deng and D. Campbell-Wilson, "The cloverleaf antenna: A compact wide-bandwidth dual-polarization feed for chime," in 2014 16th International Symposium on Antenna Technology and Applied Electromagnetics (ANTEM), pp. 1--2, July 2014.

[43]

"Opencv python 3.1.0.3." https://pypi.python.org/pypi/opencv-python.

[44]

"Monza r6 datasheet." https://support.impinj.com/hc/en-us/articles/202765328-Monza-R6-Product-Datasheet.

[45]

A. P. Sample, D. J. Yeager, P. S. Powledge, and J. R. Smith, "Design of a passively-powered, programmable sensing platform for uhf rfid systems," in 2007 IEEE International Conference on RFID, pp. 149--156, March 2007.

[46]

P. Asadzadeh, L. Kulik, and E. Tanin, "Gesture recognition using rfid technology," Personal Ubiquitous Comput., vol. 16, pp. 225--234, Mar. 2012.

Digital Library

[47]

S. Amendola, L. Bianchi, and G. Marrocco, "Movement detection of human body segments: Passive radio-frequency identification and machine-learning technologies.," IEEE Antennas and Propagation Magazine, vol. 57, pp. 23--37, June 2015.

[48]

J. Han, H. Ding, C. Qian, W. Xi, Z. Wang, Z. Jiang, L. Shangguan, and J. Zhao, "Cbid: A customer behavior identification system using passive tags," IEEE/ACM Transactions on Networking, vol. 24, pp. 2885--2898, Oct 2016.

Digital Library

[49]

L. Shangguan, Z. Zhou, X. Zheng, L. Yang, Y. Liu, and J. Han, "Shopminer: Mining customer shopping behavior in physical clothing stores with cots rfid devices," in Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems, SenSys '15, (New York, NY, USA), pp. 113--125, ACM, 2015.

Digital Library

[50]

L. Shangguan and K. Jamieson, "Leveraging electromagnetic polarization in a two-antenna motion tracking system," ACM CoNext, 2016.

Digital Library

[51]

Q. Lin, L. Yang, Y. Sun, T. Liu, X. Y. Li, and Y. Liu, "Beyond one-dollar mouse: A battery-free device for 3d human-computer interaction via rfid tags," in 2015 IEEE Conference on Computer Communications (INFOCOM), pp. 1661--1669, April 2015.

[52]

S. Sarkka, V. V. Viikari, M. Huusko, and K. Jaakkola, "Phase-based uhf rfid tracking with nonlinear kalman filtering and smoothing," IEEE Sensors Journal, vol. 12, pp. 904--910, May 2012.

[53]

G. Marrocco and F. Amato, "Self-sensing passive rfid: From theory to tag design and experimentation," in 2009 European Microwave Conference (EuMC), pp. 001--004, Sept 2009.

[54]

S. Amendola, G. Bovesecchi, A. Palombi, P. Coppa, and G. Marrocco, "Design, calibration and experimentation of an epidermal rfid sensor for remote temperature monitoring," IEEE Sensors Journal, vol. 16, pp. 7250--7257, Oct 2016.

[55]

S. Milici, S. Amendola, A. Bianco, and G. Marrocco, "Epidermal rfid passive sensor for body temperature measurements," in 2014 IEEE RFID Technology and Applications Conference (RFID-TA), pp. 140--144, Sept 2014.

[56]

R. Bhattacharyya, C. Floerkemeier, and S. Sarma, "Rfid tag antenna based sensing: Does your beverage glass need a refill?," in 2010 IEEE International Conference on RFID (IEEE RFID 2010), pp. 126--133, April 2010.

[57]

S. Manzari, A. Catini, G. Pomarico, C. D. Natale, and G. Marrocco, "Development of an uhf rfid chemical sensor array for battery-less ambient sensing," IEEE Sensors Journal, vol. 14, pp. 3616--3623, Oct 2014.

[58]

S. Manzari, C. Occhiuzzi, S. Nawale, A. Catini, C. D. Natale, and G. Marrocco, "Humidity sensing by polymer-loaded uhf rfid antennas," IEEE Sensors Journal, vol. 12, pp. 2851--2858, Sept 2012.

[59]

C. Occhiuzzi, A. Rida, G. Marrocco, and M. Tentzeris, "Rfid passive gas sensor integrating carbon nanotubes," IEEE Transactions on Microwave Theory and Techniques, vol. 59, pp. 2674--2684, Oct 2011.

[60]

M. Philipose, J. R. Smith, B. Jiang, A. Mamishev, S. Roy, and K. Sundara-Rajan, "Battery-free wireless identification and sensing," IEEE Pervasive Computing, vol. 4, pp. 37--45, Jan 2005.

Digital Library

[61]

D. Avrahami and S. E. Hudson, "Forming interactivity: A tool for rapid prototyping of physical interactive products," in Proceedings of the 4th Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, 2002.

Digital Library

[62]

N. Marquardt, A. S. Taylor, N. Villar, and S. Greenberg, "Rethinking rfid: Awareness and control for interaction with rfid systems," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '10, (New York, NY, USA), pp. 2307--2316, ACM, 2010.

Digital Library

Cited By

Sun WSrinivasan K(2024)RFDrive: Tagged Human-Vehicle Interaction for AllACM Journal on Computing and Sustainable Societies10.1145/36485332:2(1-19)Online publication date: 15-Feb-2024
https://dl.acm.org/doi/10.1145/3648533
Ahmed MBansal AYuan KZhang JKumar SPapavassiliou SSchmid S(2024)Towards Ubiquitous IoT through Long Range Wireless Energy HarvestingProceedings of the Twenty-fifth International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing10.1145/3641512.3686379(21-30)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3641512.3686379
Jiao WWang JGao XDu LLi YZhao LFang DChen XGanesan DLane NShi W(2024)ZEROECG: Zero-Sensation ECG Monitoring By Exploring RFID MOSFETProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690690(1237-1251)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3690690
Show More Cited By

Index Terms

RIO: A Pervasive RFID-based Touch Gesture Interface
1. General and reference
  1. Cross-computing tools and techniques
    1. Experimentation
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
    2. Interaction techniques
      1. Gestural input

Recommendations

A new unpredictability-based radio frequency identification forward privacy model and a provably secure construction

The privacy model of radio frequency identification RFID systems is for formalizing the adversarial capabilities and the security requirements of RFID anonymity and untraceability. Existing unpredictability-based privacy models such as unp-privacy, eunp-...
On two RFID privacy notions and their relations

Privacy of RFID systems is receiving increasing attention in the RFID community. Basically, there are two kinds of RFID privacy notions in the literature: one based on the indistinguishability of two tags, denoted as ind-privacy, and the other based on ...
Attacks on ownership transfer scheme for multi-tag multi-owner passive RFID environments

Sundaresan etźal. proposed recently a novel ownership transfer protocol for multi-tag multi-owner RFID environments that complies with the EPC Class1 Generation2 standard. The authors claim that this provides individual-owner privacy and prevents ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobiCom '17: Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking

October 2017

628 pages

ISBN:9781450349161

DOI:10.1145/3117811

General Chair:
Kobus Van der Merwe
University of Utah
,
Program Chairs:
Ben Greenstein
Google, USA
,
Kannan Srinivasan
Ohio State University, USA

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobiCom '17

Sponsor:

SIGMOBILE

MobiCom '17: The 23rd Annual International Conference on Mobile Computing and Networking

October 16 - 20, 2017

Utah, Snowbird, USA

Acceptance Rates

MobiCom '17 Paper Acceptance Rate 35 of 186 submissions, 19%;

Overall Acceptance Rate 440 of 2,972 submissions, 15%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

102
Total Citations
View Citations
1,864
Total Downloads

Downloads (Last 12 months)94
Downloads (Last 6 weeks)14

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Sun WSrinivasan K(2024)RFDrive: Tagged Human-Vehicle Interaction for AllACM Journal on Computing and Sustainable Societies10.1145/36485332:2(1-19)Online publication date: 15-Feb-2024
https://dl.acm.org/doi/10.1145/3648533
Ahmed MBansal AYuan KZhang JKumar SPapavassiliou SSchmid S(2024)Towards Ubiquitous IoT through Long Range Wireless Energy HarvestingProceedings of the Twenty-fifth International Symposium on Theory, Algorithmic Foundations, and Protocol Design for Mobile Networks and Mobile Computing10.1145/3641512.3686379(21-30)Online publication date: 14-Oct-2024
https://dl.acm.org/doi/10.1145/3641512.3686379
Jiao WWang JGao XDu LLi YZhao LFang DChen XGanesan DLane NShi W(2024)ZEROECG: Zero-Sensation ECG Monitoring By Exploring RFID MOSFETProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690690(1237-1251)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3690690
Xie MJin MZhu FZhang YTian XWang XZhou CGanesan DShi W(2024)Enabling High-rate Backscatter Sensing at ScaleProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649351(124-138)Online publication date: 29-May-2024
https://dl.acm.org/doi/10.1145/3636534.3649351
Nolan JQian KZhang X(2024)KeyStubProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314427:4(1-23)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631442
Su YZhang TFeng JShi YYang XWu T(2024)Tagnoo: Enabling Smart Room-Scale Environments with RFID-Augmented PlywoodProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642356(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642356
Jiao WWang JHe YXi XWang FFang DChen X(2024)Eliminating Design Effort: A Reconfigurable Sensing Framework for Chipless, Backscatter TagsIEEE/ACM Transactions on Networking10.1109/TNET.2023.332026332:2(1155-1170)Online publication date: Apr-2024
https://doi.org/10.1109/TNET.2023.3320263
Liu XZhang BWang LChen SXie XTong XGu TLi K(2024)Fine-Grained Recognition of Manipulation Activities on Objects via Multi-Modal SensingIEEE Transactions on Mobile Computing10.1109/TMC.2024.336452223:10(9614-9628)Online publication date: Oct-2024
https://doi.org/10.1109/TMC.2024.3364522
Zhao HEsfahani MKrishnan SAbari O(2024)A Passive Back Posture Monitoring System Using Orthogonal RFID DesignIEEE Sensors Journal10.1109/JSEN.2024.342648524:21(35610-35620)Online publication date: 1-Nov-2024
https://doi.org/10.1109/JSEN.2024.3426485
Zhang YZhan ZJin WLi YShi D(2024)RF-Keypad: A Battery-Free Keypad Based on COTS RFID Tag ArrayIEEE Internet of Things Journal10.1109/JIOT.2023.331245011:4(6761-6775)Online publication date: 15-Feb-2024
https://doi.org/10.1109/JIOT.2023.3312450
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

EPUB

View this article in ePub.

Figures

Tables

Media

View Table of Conten