Anne Roudaut
Andreas Rau
Pedro Lopes
Patrick Baudisch
ABSTRACT
We propose using spatial gestures not only for input but also for output. Analogous to gesture input, the proposed gesture output moves the user's finger in a gesture, which the user then recognizes. We use our concept in a mobile scenario where a motion path forming a "5" informs users about new emails, or a heart-shaped path serves as a mes- sage from a friend. We built two prototypes: (1) The long- RangeOuija is a stationary prototype that offers a motion range of up to 4cm; (2) The pocketOuija is self-contained mobile device based on an iPhone with up to 1cm motion range. Both devices actuate the user's fingers by means of an actuated transparent foil overlaid onto a touchscreen. We conducted three studies with the longRangeOuija in which participants recognized 2cm marks with 97% accu- racy, Graffiti digits with 98.8%, pairs of Graffiti digits with 90.5%, and Graffiti letters with 93.4%. Participants previ- ously unfamiliar with Graffiti identified 96.2% of digits and 76.4% of letters, suggesting that properly designed gesture output is guessable. After the experiment, the same participants were able to enter 100% of Graffiti digits by heart and 92.2% of letters. This suggests that participants learned gesture input as a side effect of using gesture output on our prototypes.
Supplemental Material
- Bragdon, A., Nelson, E. Li, Y., Hinckley, K. Experimental analysis of touch-screen gesture designs in mobile environments. CHI'11, 403--412. Google Scholar
Digital Library
- Brave. S., Dahley, A. inTouch: a medium for haptic interpersonal communication. CHI EA'97, 363--364. Google ScholarDigital Library
- Brewster S., Brown, L.M. Tactons: structured tactile messages for non-visual information display. Auic'04, 15--23. Google ScholarDigital Library
- Chubb, E.C, Colgate, J. E., Peshkin, M. A. ShiverPaD: A Glass Haptic Surface That Produces Shear Force on a Bare Finger. Haptic'10, 189--198. Google ScholarDigital Library
- Dang, T., Annaswamy, T.M., Srinivasan, M.A. Development and evaluation of an epidural injection simulator with force feedback for medical training. Medicine Meets VR, 97--102.Google Scholar
- Enriquez, M., MacLean, K. The hapticon editor: a tool in support ofhapticcommunication research. Haptic'03, 356362. Google ScholarDigital Library
- Feygin, D., Keehner, M., Tendick, F. Haptic Guidance: Experimental Evaluation of a Haptic Training Method for a Perceptual Motor Skill. Haptic'02. 40--47. Google ScholarDigital Library
- Geldard, F.A. 1960. Some neglected Possibilities of Communication, Science 131, 1583--1588.Google ScholarCross Ref
- Goldberg, K., Wallace, I. Denta Dentata, SIGGRAPH '93.Google Scholar
- Israr, A. and Poupyrev, I. Tactile Brush: Drawing on Skin with Tactile Grid Display. CHI'11, 2019--2028. Google ScholarDigital Library
- Kurtenbach, G., Buxton, W. Issues in Combining Marking and Direct Manipulation Techniques. UIST'91, 137--144. Google ScholarDigital Library
- Li, K, A. Designing easily learnable eyes-free interaction, Ph.D. Thesis. 2009.Google Scholar
- Li, K.A., Baudisch, P., Griswold, W.G., Hollan, J.D. Tapping and rubbing: exploring new dimensions of tactile feedback with voice coil motors. UIST '08, 181--190. Google ScholarDigital Library
- MacKenzie S., Zhang, S.X. The immediate usability of graffiti. GI'97, 129--137. Google ScholarDigital Library
- Morris, D., Tan, H.Z., Barbagli, F., Chang, T., Salisbury, K., Haptic feedbackenhances force skill learning.WHC'07, 21--26. Google ScholarDigital Library
- Mullenbach, J., D. Johnson, J. E. Colgate, and M. A. Peshkin, ActivePaD surface haptic device", Haptic'02. 414, 2012.Google Scholar
- Ni, T., Baudisch, P. Disappearing mobile devices. UIST'09, 101. Google ScholarDigital Library
- Noma, H. Miyasato, T., Kishino, F. A palmtop display for dextrous manipulation with haptic sensation. CHI'96, 126133. Google ScholarDigital Library
- Pangaro, G., Maynes-Aminzade, D., Ishii, H. The actuated workbench: computer-controlled actuation in tabletop tangible interfaces. UIST'02, 181--190. Google ScholarDigital Library
- Patten, J., Ishii, H. Mechanical constraints as computational constraints in tabletop tangible interfaces. CHI '07, 809--818. Google ScholarDigital Library
- Poupyrev, I., Maruyama, S., Rekimoto, J. Ambient Touch: Designing tactile interfaces for handhelds. UIST'02. 51--60. Google ScholarDigital Library
- Saponas, T.S., Harrison, C., Benko, H. PocketTouch: throughfabric capacitive touch input. UIST '11, 303--308. Google ScholarDigital Library
- Sato M., Development of String-based Force Display: SPIDAR. VSMM'02. 1034--1039.Google Scholar
- Seo, J., Choi, S. Initial study for creating linearly moving vibrotactile sensation on mobile device. Haptic'10, 67--70. Google ScholarDigital Library
- Srimathveeravalli G., Thenkurussi, K.Motor Skill Training Assistance Using Haptic Attributes. WHC '05, 452--457. Google ScholarDigital Library
- Tan, H. Z., Durlach, N., Rabinowitz, W. Reed, C.M, Santos, J. Reception of Morse Code through Motional, Vibrotactile and Auditory Stimulation. Perception & Psychophysics, 59, 7, '97.Google Scholar
- Teo, C., Burdet, E., Lim, H. A robotic teacher of Chinese handwriting. HAPTIC'02, 335--341. Google ScholarDigital Library
- Wang, D., Rossi, M., Tuer, K., Madill, D. Method and System for Providing Haptic Effects. US Patent 20060209037.Google Scholar
- Wang, D., Tuer, K., Rossi, M., Shu, J. Haptic Overlay Device for Flat Panel Touch Displays. Demo at Haptic'04. Google ScholarDigital Library
- Weiss, M., Schwarz, F., Jakubowski, S., Borchers, J. Madgets: actuating widgets on interactive tabletops. UIST '10, 293--302. Google ScholarDigital Library
- Weiss, M., Wacharamanotham, C., Voelker, S., Borchers, J. FingerFlux: Near-Surface Haptic Feedback on Tabletops. UIST '11, 615--620. Google ScholarDigital Library
- White, N., Back D. Telephonic Arm Wrestling, Strategic Arts Initiative Symposium (Salerno, Italy, Spring 1986).Google Scholar
- Williamson, J., Murray-Smith, R., Hughes, S. Shoogle: excitatory multimodal interaction on mobile devices. CHI'07,121124. Google ScholarDigital Library
- Winfield, L., Glassmire, J., Colgate, J. E.. Peshkin. M. T-pad: Tactile pattern display through variable friction reduction. WHC'07, 421--426. Google ScholarDigital Library
- Wobbrock, J.O., Myers, B.A., Kembel, J. EdgeWrite: a stylusbased text entry method designed for high accuracy and stability of motion. UIST '03, 61--70. Google ScholarDigital Library
- Yang, Y., Zhang, Y., Hou, Z., Lemaire-Semail, B. FingViewer: A new multi-touch force feedback touch screen. ICMI'11, 837--838.Google Scholar
- Yatani, K., Truong, K.N. SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices. UIST '09. ACM, 111--120. Google ScholarDigital Library
- Yokokohji, Y., Hollis, R. L., Kanade, T., Henmi, K., Yoshikawa, T. Toward machine mediated training of motor skillsskill transfer from human to human via virtual environment. In RO-MAN 1996, 32--37.Google Scholar
Index Terms
- Gesture output: eyes-free output using a force feedback touch surface
Recommendations
Gunslinger: Subtle Arms-down Mid-air Interaction
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyWe describe Gunslinger, a mid-air interaction technique using barehand postures and gestures. Unlike past work, we explore a relaxed arms-down position with both hands interacting at the sides of the body. It features "hand-cursor" feedback to ...
Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects
CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing SystemsSingle-hand microgestures have been recognized for their potential to support direct and subtle interactions. While pioneering work has investigated sensing techniques and presented first sets of intuitive gestures, we still lack a systematic ...
What caused that touch?: expressive interaction with a surface through fiduciary-tagged gloves
ITS '10: ACM International Conference on Interactive Tabletops and SurfacesThe hand has incredible potential as an expressive input device. Yet most touch technologies imprecisely recognize limited hand parts (if at all), usually by inferring the hand part from the touch shapes. We introduce the fiduciary-tagged glove as a ...
Comments