Ke-Yu Chen
Shwetak Patel
ABSTRACT
While much progress has been made in wearable computing in recent years, input techniques remain a key challenge. In this paper, we introduce uTrack, a technique to convert the thumb and fingers into a 3D input system using magnetic field (MF) sensing. A user wears a pair of magnetometers on the back of their fingers and a permanent magnet affixed to the back of the thumb. By moving the thumb across the fingers, we obtain a continuous input stream that can be used for 3D pointing. Specifically, our novel algorithm calculates the magnet's 3D position and tilt angle directly from the sensor readings. We evaluated uTrack as an input device, showing an average tracking accuracy of 4.84 mm in 3D space - sufficient for subtle interaction. We also demonstrate a real-time prototype and example applications allowing users to interact with the computer using 3D finger input.
Supplemental Material
- C. Amma and T. Schultz. 2012. Airwriting: demonstrat- ing mobile text input by 3D-space handwriting. In Proc. of IUI '12, pp.319--320. Google Scholar
Digital Library
- D. Ashbrook, P. Baudisch, and S. White. 2011. Nenya: subtle and eyes-free mobile input with a magnetically- tracked finger ring. In Proc. of CHI '11, pp.2043--2046. Google ScholarDigital Library
- D. Ashbrook, J. Clawson, K. Lyons, N. Patel, and T. Starner. Quickdraw: The impact of mobility and on-body placement on device access time. In Proc. of CHI, 2008, pp.219--222. Google ScholarDigital Library
- A.Butler,S.Izadi,andS.Hodges.2008.SideSight:mul- ti-"touch" interaction around small devices. In Proc. of UIST '08, pp.201--204. Google ScholarDigital Library
- T. Deyle, S. Palinko, E.S. Poole and T. Starner, "Ham- bone: A Bio-Acoustic Gesture Interface," Wearable Computers, 2007, pp.3--10. Google ScholarDigital Library
- X. Han, H. Seki, Y. Kamiya, and M. Hikizu, Wearable handwriting input device using magnetic field. In Proc. SICE'07, pp.365--368.Google Scholar
- X. Han, H. Seki, Y . Kamiya, and M. Hikizu, W earable handwriting input device using magnetic field: 2nd re- port: Influence of misalignment of magnet and writing plane, Precision Engineering, July 2010, pp.37--43.Google Scholar
- C. Harrison and S. E. Hudson. 2009. Abracadabra: wire- less, high-precision, and unpowered finger input for very small mobile devices. In Proc. of UIST '09, pp.121--124. Google ScholarDigital Library
- C. Harrison, and D.M. Tan, Skinput: Appropriating the Body as an Input Surface. In Proc. of CHI 2010, pp.453--462. Google ScholarDigital Library
- C. Harrison, H. Benko, A.D. Wilson, OmniTouch: Wearable Multitouch Interaction Everywhere. In Proc. of UIST '11, pp.441--450. Google ScholarDigital Library
- D. Kim, O. Hilliges, S. Izadi, A. D. Butler, J. Chen, I. Oikonomidis, and P. Olivier. 2012. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sen- sor. In Proc. of UIST '12, pp.167--176. Google ScholarDigital Library
- M.R. Kraichman, Handbook of Electromagnetic Propa- gation in Conducting Media, 2nd ed. Washington, D.C.; Head-quarters Naval Material Command, 1976.Google Scholar
- R. Liang, K. Cheng, C. Su, C. Weng, B. Chen, and D. Yang, 2012. GaussSense: attachable stylus sensing using magnetic sensor grid, In Proc. of UIST '12, pp.319--326. Google ScholarDigital Library
- J. Lementec and P. Bajcsy. Recognition of arm gestures using multiple orientation sensors: gesture classification. Proceedings of the 7th International IEEE Conference on Intelligent Transportation Systems, 2004, pp.965--970.Google ScholarCross Ref
- F.H. Raab, E.B. Blood, T.O. Steiner, and H.R. Jones, Magnetic Position and Orientation Tracking System, Aerospace and Electronic Systems, IEEE Transactions on, Sept. 1979, pp.709--718.Google Scholar
- T. S. Saponas, D. S. Tan, D. Morris, R. Balakrishnan, Jim Turner, and J. A. Landay. 2009. Enabling always- available input with muscle-computer interfaces. In Proc. of UIST '09. ACM, New York, USA, pp.167--176. Google ScholarDigital Library
- T. Starner, J. Auxier, D. Ashbrook and M. Gandy (2000), The Gesture Pendant: A Self-illuminating, Wearable, Infrared Computer Vision System for Home Automation Control and Medical Monitoring, In Proc. of ISWC'00, pp.87--94. Google ScholarDigital Library
- J. E. Zucco, B. H. Thomas, K. Grimmer-Somers and A. Cockburn. "A Comparison of Menu Configurations and Pointing Devices for use with Wearable Computers while Mobile and Stationary". In Thirteenth International Symposium on Wearable Computers, Linz, Austria, Sep- tember 2009. IEEE, pp.63--70. Google ScholarDigital Library
Index Terms
- uTrack: 3D input using two magnetic sensors
Recommendations
An analysis of the index finger as a pointing device
CHI EA '99: CHI '99 Extended Abstracts on Human Factors in Computing SystemsWe have conducted three related experiments in order to analyze the performance of the index finger as a pointing device. The results indicate that the performance of the index finger is significantly better as a direct pointing device [1] than as an ...
Look and lean: accurate head-assisted eye pointing
ETRA '14: Proceedings of the Symposium on Eye Tracking Research and ApplicationsCompared to the mouse, eye pointing is inaccurate. As a consequence, small objects are difficult to point by gaze alone. We suggest using a combination of eye pointing and subtle head movements to achieve accurate hands-free pointing in a conventional ...
Eliciting Wrist and Finger Gestures to Guide Recognizer Design
GI'19: Proceedings of the 45th Graphics Interface Conference on Proceedings of Graphics Interface 2019While hand gestures, i.e. movements of the fingers and wrist, are a low-effort input modality, sensing and recognition of these smallscale gestures is challenging. In particular, while many authors have explored varying designs of hardware to support ...
Comments