ABSTRACT
Gesture recognition is a well-establish topic of research that is widely adopted for a broad range of applications. For instance, it can be exploited for the command of a smart environment without any remote control unit or even for the recognition of human activities from a set of video cameras deployed in strategic position. Many researchers working on assistive smart home, such as our team, believe that the intrusiveness of that technology will prevent the future adoption and commercialization of smart homes. In this paper, we propose a novel gesture recognition algorithm that is solely based on passive RFID technology. This technology enables the localization of small tags that can be embedded in everyday life objects (a cup or a book, for instance) while remaining non intrusive. However, until now, this technology has been largely ignored by researchers on gesture recognition, mostly because it is easily disturbed by noise (metal, human, etc.) and offer limited precision. Despite these issues, the localization algorithms have improved over the years, and our recent efforts resulted in a real-time tracking algorithm with a precision approaching 14cm. With this, we developed a gesture recognition algorithm able to perform segmentation of gestures and prediction on a spatio-temporal data series. Our new model, exploiting works on qualitative spatial reasoning, achieves recognition of 91%. Our goal is to ultimately use that knowledge for both human activity recognition and errors detection.
- K. Bouchard, B. Bouchard, and A. Bouzouane, "Guideline to Efficient Smart Home Design for Rapid AI Prototyping: A Case Study," in International Conference on PErvasive Technologies Related to Assistive Environments, Crete Island, Greece, 2012. Google ScholarDigital Library
- J. C. Augusto and C. D. Nugent, "Smart homes can be smarter," in Designing Smart Homes: Role of Artificial Intelligence. vol. 4008, ed Berlin: Springer-Verlag Berlin, 2006, pp. 1--15. Google ScholarDigital Library
- D. J. Patterson, D. Fox, H. Kautz, and M. Philipose, "Fine-Grained Activity Recognition by Aggregating Abstract Object Usage," presented at the Proceedings of the Ninth IEEE International Symposium on Wearable Computers, 2005. Google ScholarDigital Library
- K. Bouchard, B. Bouchard, and A. Bouzouane, "Spatial recognition of activities for cognitive assistance: realistic scenarios using clinical data from Alzheimer's patients," Journal of Ambient Intelligence and Humanized Computing, pp. 1--16, 2013/09/13 2013.Google Scholar
- V. Jakkula and D. J. Cook, "Mining Sensor Data in Smart Environment for Temporal Activity Prediction," in KDD'07, San Jose, California, USA, 2007.Google Scholar
- J. C. Augusto, J. Liu, P. McCullagh, and H. Wang, "Management of uncertainty and spatio-temporal aspects for monitoring and diagnosis in a Smart Home," International Journal of Computational Intelligence Systems vol. 1, pp. 361--378, 2008.Google ScholarCross Ref
- T. Westeyn, H. Brashear, A. Atrash, and T. Starner, "Georgia tech gesture toolkit: supporting experiments in gesture recognition," in Proceedings of the 5th international conference on Multimodal interfaces, 2003, pp. 85--92. Google ScholarDigital Library
- S. Mitra and T. Acharya, "Gesture recognition: A survey," Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol. 37, pp. 311--324, 2007. Google ScholarDigital Library
- J. Liu, L. Zhong, J. Wickramasuriya, and V. Vasudevan, "uWave: Accelerometer-based personalized gesture recognition and its applications," Pervasive and Mobile Computing, vol. 5, pp. 657--675, 2009. Google ScholarDigital Library
- K. Mäkelä, S. Belt, D. Greenblatt, and J. Häkkilä, "Mobile interaction with visual and RFID tags: a field study on user perceptions," presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose, California, USA, 2007. Google ScholarDigital Library
- L. M. Ni, Y. Liu, Y. C. Lau, and A. P. Patil, "LANDMARC: Indoor Location Sensing Using Active RFID," ACM Wireless Networks, vol. 10, pp. 701--710, 2004. Google ScholarDigital Library
- P. Vorst, S. Schneegans, Y. Bin, and A. Zell, "Self-Localization with RFID snapshots in densely tagged environments," in Intelligent Robots and Systems, 2008. IROS 2008. IEEE/RSJ International Conference on, 2008, pp. 1353--1358.Google Scholar
- D. Joho, C. Plagemann, and W. Burgard, "Modeling RFID signal strength and tag detection for localization and mapping," presented at the Proceedings of the 2009 IEEE international conference on Robotics and Automation, Kobe, Japan, 2009. Google ScholarDigital Library
- F.-S. Chen, C.-M. Fu, and C.-L. Huang, "Hand gesture recognition using a real-time tracking method and hidden Markov models," Image and vision computing, vol. 21, pp. 745--758, 2003.Google Scholar
- C. Shan, Y. Wei, T. Tan, and F. Ojardias, "Real time hand tracking by combining particle filtering and mean shift," in Automatic Face and Gesture Recognition, 2004. Proceedings. Sixth IEEE International Conference on, 2004, pp. 669--674. Google ScholarDigital Library
- F. Samaria and S. Young, "HMM-based architecture for face identification," Image and vision computing, vol. 12, pp. 537--543, 1994.Google Scholar
- L. Bretzner, I. Laptev, and T. Lindeberg, "Hand gesture recognition using multi-scale colour features, hierarchical models and particle filtering," in Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference on, 2002, pp. 423--428. Google ScholarDigital Library
- P. Hong, M. Turk, and T. S. Huang, "Gesture modeling and recognition using finite state machines," in Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on, 2000, pp. 410--415. Google ScholarDigital Library
- C. Y. Chen, J. P. Yang, G. J. Tseng, Y. H. Wu, and R. C. Hwang, "An Indoor positioning technique based on fuzzy logic," in MultiConference of Engineers and Computer Scientists, Hong Kong, 2010.Google Scholar
- P. Asadzadeh, L. Kulik, and E. Tanin, "Gesture recognition using RFID technology," Personal and Ubiquitous Computing, vol. 16, pp. 225--234, 2012/03/01 2012. Google ScholarDigital Library
- D. Fortin-Simard, K. Bouchard, S. Gaboury, B. Bouchard, and A. Bouzouane, "Accurate Passive RFID Localization System for Smart Homes," presented at the 3th IEEE International Conference on Networked Embedded Systems for Every Application, Liverpool, UK, 2012. Google ScholarDigital Library
- E. Clementini, P. D. Felice, and D. Hernández, "Qualitative representation of positional information," Artificial Intelligence, vol. 95, pp. 317--356, 1997. Google ScholarDigital Library
Index Terms
- Gesture recognition in smart home using passive RFID technology
Recommendations
Real-time Arm Gesture Recognition in Smart Home Scenarios via Millimeter Wave Sensing
"In air" gesture recognition using millimeter wave (mmWave) radar and its applications in natural human-computer-interaction for smart home has shown its potential. However, the state-of-the-art works still fall short in terms of limited gesture space, ...
Accurate passive RFID localization system for smart homes
NESEA '12: Proceedings of the 2012 IEEE 3rd International Conference on Networked Embedded Systems for Every Application (NESEA)The smart home paradigm is a promising new trend of research aiming to propose an alternative to postpone the institutionalization of cognitively-impaired silver-aged people. These habitats are intended to provide security, guidance and direct support ...
Precise passive RFID localization for service delivery in smart home
UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous ComputingSmart home research foresees a future where persons afflicted by a type of cognitive impairment, such as Alzheimer's disease, could pursue a longer autonomous life at home by being punctually assisted in their everyday activities. Few research teams ...
Comments