ABSTRACT
We present Tomo, a wearable, low-cost system using Electrical Impedance Tomography (EIT) to recover the interior impedance geometry of a user's arm. This is achieved by measuring the cross-sectional impedances between all pairs of eight electrodes resting on a user's skin. Our approach is sufficiently compact and low-powered that we integrated the technology into a prototype wrist- and armband, which can monitor and classify gestures in real-time. We conducted a user study that evaluated two gesture sets, one focused on gross hand gestures and another using thumb-to-finger pinches. Our wrist location achieved 97% and 87% accuracies on these gesture sets respectively, while our arm location achieved 93% and 81%. We ultimately envision this technique being integrated into future smartwatches, allowing hand gestures and direct touch manipulation to work synergistically to support interactive tasks on small screens.
Supplemental Material
- Amento, B., Hill, W., and Terveen, L. The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface. In Proc. CHI '02, 724--725. Google ScholarDigital Library
- Amma, C. Krings, T., Böer, J. and Schultz, T. Advancing Muscle-Computer Interfaces with High-Density Electromyography. In Proc. CHI '15, 929--938. Google ScholarDigital Library
- Analog Devices Inc. http://www.analog.com/media/en/technical-documentation/data-sheets/AD5933.pdfGoogle Scholar
- Beck, M. S., Dyakowski, T and William, R. A. Process Tomography-The State of Art. Transactions of the Institute of Measurement and Control. 20(4), 163--177. Oct. 1998.Google ScholarCross Ref
- Cheng, J., Zhou, B., Kunze, K., Rheinländer, C. C., Wille, S., Wehn, N., Weppner, J and Lukowicz, P. Activity recognition and nutrition monitoring in every day situations with a textile capacitive neckband. In Adj. Proc. UbiComp '13, 155--158. Google ScholarDigital Library
- Cornelius, C., Peterson, R., Skinner, J., Halter, R., and Kotz, D. A wearable system that knows who wears it. In Proc. MobiSys '14, 55--67. Google ScholarDigital Library
- Holder, D. S. 2015. Electrical Impedance Tomography, Methods, History and Applications. Institute of Physics Publishing.Google Scholar
- Dementyev, A., and Paradiso, J. A. WristFlex: Lowpower gesture input with wrist-worn pressure sensors. In Proc. UIST '14, 161--166. Google ScholarDigital Library
- Deyle, T., Palinko, S., Poole, E. S., and Starner, T. Hambone: A bio-acoustic gesture interface. In Proc. ISWC '07, 3--10. Google ScholarDigital Library
- Fitbit, Inc. http://www.fitbit.com/aria Figure 11.Google Scholar
- Fukui, R., Watanabe, M., Gyota, T., Shimosaka, M., and Sato, T. Hand shape classification with a wrist contour sensor: development of a prototype device. In Proc. Ubicomp '11, 311--314. Google ScholarDigital Library
- Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I.H. The WEKA Data Mining Software: An Update. SIGKDD Explor. 11(1), 2009. Google ScholarDigital Library
- Henderson, R. P. and Webster, J. G. An Impedance Camera for Spatially Specific Measurements of the Thorax. IEEE Trans. on Biomedical Engineering, 25(3), 250--254. May. 1978.Google Scholar
- Jung, P. G., Lim, G., Kim, S., and Kong, K. A Wearable Gesture Recognition Device for Detecting Muscular Activities Based on Air-Pressure Sensors. IEEE Trans. on Industrial Informatics, 11(2), 485--494. Feb. 2015.Google ScholarCross Ref
- Kim, D., Hilliges, O., Izadi, S., Butler, A., Chen, J., Oikonomidis, I. and Olivier, P. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proc. UIST '12, 167--176. Google ScholarDigital Library
- Ogata, M. and Imai, M. SkinWatch: skin gesture interaction for smart watch. In Proc. AH '15, 21--24. Google ScholarDigital Library
- Perng, J. K., Fisher, B., Hollar, S. and Pister, K. S. Acceleration sensing glove. In Proc. ISWC '09, 178--180. Google ScholarDigital Library
- Rekimoto, J. Gesturewrist and gesturepad: Unobtrusive wearable interaction devices. In Proc. ISWC '01, 21--27. Google ScholarDigital Library
- Sato, M., Poupyrev, I., and Harrison, C. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proc. CHI '12, 483--492. Google ScholarDigital Library
- Saponas, T. S., Tan, D. S., Morris, D., and Balakrishnan, R. Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces. In Proc. CHI '08, 515--524. Google ScholarDigital Library
- Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. A. Enabling always-available input with muscle-computer interfaces. In Proc. UIST '09, 167--176. Google ScholarDigital Library
- Skulput, Inc. http://www.skulpt.meGoogle Scholar
- Thalmic Lab, Inc. http://www.thalmic.com/myo/Google Scholar
- Way, D., and Paradiso, J. A usability user study concerning free-hand microgesture and wrist-worn sensors. In Proc. BSN '14, 138--142. Google ScholarDigital Library
- Xu, C., Pathak, P. H., and Mohapatra, P. Finger-writing with Smartwatch: A Case for Finger and Hand Gesture Recognition using Smartwatch. In Proc. HotMobile '15, 9--14. Google ScholarDigital Library
Index Terms
- Tomo: Wearable, Low-Cost Electrical Impedance Tomography for Hand Gesture Recognition
Recommendations
Advancing Hand Gesture Recognition with High Resolution Electrical Impedance Tomography
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and TechnologyElectrical Impedance Tomography (EIT) was recently employed in the HCI domain to detect hand gestures using an instrumented smartwatch. This prior work demonstrated great promise for non-invasive, high accuracy recognition of gestures for interactive ...
DiscoBand: Multiview Depth-Sensing Smartwatch Strap for Hand, Body and Environment Tracking
UIST '22: Proceedings of the 35th Annual ACM Symposium on User Interface Software and TechnologyReal-time tracking of a user’s hands, arms and environment is valuable in a wide variety of HCI applications, from context awareness to virtual reality. Rather than rely on fixed and external tracking infrastructure, the most flexible and consumer-...
Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices
UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technologyWe present Abracadabra, a magnetically driven input technique that offers users wireless, unpowered, high fidelity finger input for mobile devices with very small screens. By extending the input area to many times the size of the device's screen, our ...
Comments