Teng Han
ABSTRACT
Vibrational signals that are generated when a finger is swept over an uneven surface can be reliably detected via low-cost sensors that are in proximity to the interaction surface. Such interactions provide an alternative to touchscreens by enabling always-available input. In this paper we demonstrate that Inertial Measurement Units (known as IMUs) embedded in many off-the-shelf smartwear are well suited for capturing vibrational signals generated by a user's finger swipes, even when the IMU appears in a smartring or smartwatch. In comparison to acoustic based approaches for capturing vibrational signals, IMUs are sensitive to a vast number of factors, both, in terms of the surface and swipe properties, when the interaction is carried out. We contribute by examining the impact of these surface and swipe properties, including surface or bump height and density, surface stability, sensor location, swipe style, and swipe direction. Based on our results, we present a number of usage scenarios to demonstrate how this approach can be used to provide always-available input for digital interactions.
- Avrahami, D., Wobbrock, J.O., and Izadi, S. Portico: tangible interaction on and around a tablet. In Proc. UIST 2011, ACM (2011), 347--356. Google Scholar
Digital Library
- Chang, C.-C., and Lin, C.-J. LIBSVM: A library for support vector machines. ACM Trans. on Intelligent Systems and Technology, 2, 3, (2011), 27 pages. Google ScholarDigital Library
- Gustafson, S., Holz, C., and Baudisch, P. Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device. In Proc. UIST 2011, ACM (2011), 283--292. Google ScholarDigital Library
- Harrison, C., Benko, H., and Wilson, A.D. OmniTouch: wearable multitouch interaction every-where. In Proc. UIST 2011, ACM (2011), 441--450. Google ScholarDigital Library
- Harrison, C. and Hudson, S.E. Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. In Proc. UIST 2008, ACM (2008), 205--208. Google ScholarDigital Library
- Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. In Proc. CHI 2010, ACM (2010), 453--462. Google ScholarDigital Library
- Harrison, C., Xiao, R., and Hudson, S. Acoustic barcodes: passive, durable and inexpensive notched identification tags. In Proc. UIST 2012, ACM, 563--568. Google ScholarDigital Library
- Holz, C., Grossman, T., Fitzmaurice, G., and Agur, A. Implanted user interfaces. In Proc. CHI 2012, ACM (2012), 503--512. Google ScholarDigital Library
- Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A.D., Philipose, M., and LaMarca, A. 2009. Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In Proc. UIST 2009, ACM (2009), 129--138. Google ScholarDigital Library
- Karrer, T., Wittenhagen, M., Lichtschlag, L., Heller, F., and Borchers, J. Pinstripe: eyes-free continuous input on interactive clothing. In Proc. CHI 2011, ACM (2011), 1313--1322. Google ScholarDigital Library
- Kim, J.E., Sunwoo, J., Son, Y.-K., Lee, D.-W. and Cho, I.-Y. A gestural input through finger writing on a textured pad. In Ext. Abstracts CHI 2007, ACM (2007), 2495--2500. Google ScholarDigital Library
- McGrath, W. and Li, Y. Detecting tapping motion on the side of mobile devices by probabilistically combining hand postures. In Proc. UIST 2014, ACM (2014), 215--219. Google ScholarDigital Library
- Murray-Smith, R., Williamson, J., Hughes, S. and Quaade. T. Stane: synthesized surfaces for tactile input. In Proc. CHI 2008, ACM (2008), 1299--1302. Google ScholarDigital Library
- Ni, T. and Baudisch, P. Disappearing mobile devices. In Proc. UIST 2009, ACM (2009), 101--110. Google ScholarDigital Library
- Ono, M., Shizuki, B. and Tanaka, J. Touch & activate: adding interactivity to existing objects using active acoustic sensing. In Proc. UIST 2013, ACM (2013), 31--40. Google ScholarDigital Library
- Saponas, T., Harrison, C. and Benko, H. PocketTouch: through-fabric capacitive touch input. In Proc. UIST 2011. ACM (2011), 303--308. Google ScholarDigital Library
- Saponas, T., Tan, D., Morris, D., Balakrishnan, R., Turner, J. and Landay, J. Enabling always-available input with muscle-computer interfaces. In Proc. UIST 2009, ACM (2009), 167--176. Google ScholarDigital Library
- Sato, M., Poupyrev, I. and Harrison, C. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proc. CHI 2012. ACM (2012), 483--492. Google ScholarDigital Library
- Savage, V., Head, A., Hartmann, B., Goldman, D., Mysore, G. and Li, W. Lamello: Passive Acoustic Sensing for Tangible Input Components. In Proc. CHI 2015, ACM (2015), 1277--1280. Google ScholarDigital Library
- Sukhoy, V., Sahai, R., Sinapov, J., and Stoytchev, A. Vibrotactile recognition of surface textures by a humanoid robot. In Proc. Humanoids Workshop Tactile Sensing in Humanoids, 2009, pp. 57--60.Google Scholar
- Wilson A.D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proc. UIST 2010. ACM, 273--282. Google ScholarDigital Library
- Wimmer, R. and Baudisch, P. Modular and deformable touch-sensitive surfaces based on time domain reflectometry. In Proc. UIST 2011, ACM (2011), 517--526. Google ScholarDigital Library
- Xiao, R., Lew, G., Marsanico, J., Hariharan, D., Hudson, S. and Harrison, C. Toffee: enabling ad hoc, around-device interaction with acoustic time-of-arrival correlation. In Proc. MobileHCI 2014, ACM (2014), 67--76. Google ScholarDigital Library
- Yang, X., Grossman, T., Wigdor, D. and Fitzmaurice, G. Magic finger: always-available input through finger instrumentation. In Proc. UIST 2012, ACM, 147--156. Google ScholarDigital Library
Index Terms
- Exploring Design Factors for Transforming Passive Vibration Signals into Smartwear Interactions
Recommendations
Exploring tilt for no-touch, wrist-only interactions on smartwatches
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and ServicesBecause smartwatches are worn on the wrist, they do not require users to hold the device, leaving at least one hand free to engage in other activities. Unfortunately, this benefit is thwarted by the typical interaction model of smartwatches; for ...
PocketTouch: through-fabric capacitive touch input
UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technologyPocketTouch is a capacitive sensing prototype that enables eyes-free multitouch input on a handheld device without having to remove the device from the pocket of one's pants, shirt, bag, or purse. PocketTouch enables a rich set of gesture interactions, ...
BackTap: robust four-point tapping on the back of an off-the-shelf smartphone
UIST '13 Adjunct: Adjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and TechnologyWe present BackTap, an interaction technique that extends the input modality of a smartphone to add four distinct tap locations on the back case of a smartphone. The BackTap interaction can be used eyes-free with the phone in a user's pocket, purse, or ...
Comments