Marian Theiss
Kristof Van Laerhoven
ABSTRACT
Detecting the task at hand can often be improved when it is also known what object the user is holding. Several sensing modalities have been suggested to identify handheld objects, from wrist-worn RFID readers to cameras. A critical obstacle to using such sensors, however, is that they tend to be too power hungry for continuous usage. This paper proposes a system that detects grasping using first inertial sensors and then Electromyography (EMG) on the forearm, to then selectively activate the object identification sensors. This three-tiered approach would therefore only attempt to identify in-hand objects once it is known a grasping has occurred. Our experiments show that high recall can be obtained for grasp detection, 95% on average across participants, with the grasping of lighter and smaller objects clearly being more difficult.
- F. Ahmad and P. Musilek. A keystroke and pointer control input interface for wearable computers. In Fourth Annual IEEE Intl. Conf. on Pervasive Computing and Communications, pages 2--11, 2006. Google Scholar
Digital Library
- O. Amft, H. Junker, P. Lukowicz, G. Troester, and C. Schuster. Sensing muscle activities with body-worn sensors. In BSN 2006: Proceedings of the International Workshop on Wearable and Implantable Body Sensor Networks. IEEE press, 2006. Google ScholarDigital Library
- E. Berlin, J. Liu, K. Van Laerhoven, and B. Schiele. Coming to grips with the objects we grasp: Detecting interactions with efficient wrist-worn sensors. In International Conference on Tangible and Embedded Interaction (TEI 2010), pages 57--64, Cambridge MA, USA, 01/2010 2010. ACM Press, ACM Press. Google ScholarDigital Library
- A. Feldman, E. M. Tapia, S. Sadi, P. Maes, and C. Schmandt. Reachmedia: On-the-move interaction with everyday objects. In Proceedings of the Ninth IEEE International Symposium on Wearable Computers, ISWC '05, pages 52--59, Washington, DC, USA, 2005. IEEE Computer Society. Google ScholarDigital Library
- K. P. Fishkin, M. Philipose, and A. D. Rea. Hands-on RFID: wireless wearables for detecting use of objects. In Ninth IEEE International Symposium on Wearable Computers (ISWC 2005), 18-21 October 2005, Osaka, Japan, pages 38--43. IEEE Computer Society, 2005. Google ScholarDigital Library
- N. Gillian and J. A. Paradiso. The gesture recognition toolkit. The Journal of Machine Learning Research, 15(1):3483--3487, 2014. Google ScholarDigital Library
- T. Grosse-Puppendahl. Capacitive Sensing and Communication for Ubiquitous Interaction and Env. Perception. PhD thesis, TU Darmstadt, May 2015.Google Scholar
- T. Grosse-Puppendahl, E. Berlin, and M. Borazio. Enhancing accelerometer-based activity recognition with capacitive proximity sensing. In Ambient Intelligence, volume 7683 of LNCS, pages 17--32. Springer, 2012.Google ScholarCross Ref
- A. Hein and T. Kirste. A hybrid approach for recognizing adls and care activities using inertial sensors and rfid. In C. Stephanidis, editor, Intelligent and Ubiquitous Interaction Environments, 5th International Conference, UAHCI 2009, Lecture Notes in Computer Science, pages 178--188, San Diego, CA, USA, 2009. Springer. Google ScholarDigital Library
- A. Latwesen and P. E. Patterson. Identification of lower arm motions using the emg signals of shoulder muscles. Medical Engineering and Physics, 16(2), 1994.Google Scholar
- T. Maekawa, Y. Kishino, Y. Yanagisawa, and Y. Sakurai. Wristsense: Wrist-worn sensor device with camera for daily activity recognition. In Pervasive Computing and Communications Workshops, 2012 IEEE Intl. Conf. on, pages 510--512, March 2012.Google ScholarCross Ref
- T. Maekawa, Y. Yanagisawa, Y. Kishino, K. Ishiguro, K. Kamei, Y. Sakurai, and T. Okadome. Object-based activity recognition with heterogeneous sensors on wrist. In Pervasive Computing, volume 6030 of Lecture Notes in Computer Science, pages 246--264. Springer Berlin, 2010. Google ScholarDigital Library
- D. J. Patterson, D. Fox, H. A. Kautz, and M. Philipose. Fine-grained activity recognition by aggregating abstract object usage. In Ninth IEEE International Symposium on Wearable Computers (ISWC 2005), 18-21 October 2005, Osaka, Japan, pages 44--51. IEEE Computer Society, 2005. Google ScholarDigital Library
- M. Philipose, K. P. Fishkin, M. Perkowitz, D. J. Patterson, D. Fox, H. Kautz, and D. Hahnel. Inferring activities from interactions with objects. Pervasive Computing, 3(4):50âĂŞ57, 2004. Google ScholarDigital Library
- J. Rekimoto. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Proceedings of the 5th IEEE International Symposium on Wearable Computers, ISWC '01, pages 21--, Washington, DC, USA, 2001. IEEE Computer Society. Google ScholarDigital Library
- A. Schmidt, H. Gellersen, and C. Merz. Enabling implicit human computer interaction: A wearable rfid-tag reader. In Fourth International Symposium on Wearable Computers (ISWC 2000), Atlanta, Georgia, USA, 18--21 October 2000, Proceedings., pages 193--194, 2000. Google ScholarDigital Library
- F. Tavakolizadeh, J. Gu, and B. Saket. Traceband: Locating missing items by visual remembrance. In Proceedings of the Adjunct Publication of the 27th Annual ACM Symposium on User Interface Software and Technology, UIST'14 Adjunct, pages 109--110, New York, NY, USA, 2014. ACM. Google ScholarDigital Library
- R. Want. An introduction to rfid technology. IEEE Pervasive Computing, 5(1):25--33, Jan. 2006. Google ScholarDigital Library
- K. Wolf and J. Willaredt. Pickring: seamless interaction through pick-up detection. In Proceedings of the 6th Augmented Human International Conference, AH 2015, Singapore, March 9--11, 2015, pages 13--20, 2015. Google ScholarDigital Library
- A. Zinnen, K. Van Laerhoven, and B. Schiele. Toward recognition of short and non-repetitive activities from wearable sensors. In Proceedings of the 2007 European conference on Ambient intelligence, pages 142--158. Springer-Verlag, 2007. Google ScholarDigital Library
Recommendations
GaitTracker: 3D Skeletal Tracking for Gait Analysis Based on Inertial Measurement Units
Gait rehabilitation is a common method of postoperative recovery after the user sustains an injury or disability. However, traditional gait rehabilitations are usually performed under the supervision of rehabilitation specialists, which implies that the ...
Gesture recognition for transhumeral prosthesis control using EMG and NIR
A key challenge associated with myoelectric prosthesis limbs is the acquisition of a good quality gesture intent signal from the residual anatomy of an amputee. In this study, the authors aim to overcome this limitation by observing the classification ...
A low cost wearable wireless sensing system for paretic hand management after stroke
This paper describes the design of a low cost wearable hand exercise device that can assist repetitive wrist and finger exercise for stroke patients. The design of this device was guided by neurobiological principles of motor learning, such as sensory-...
Comments