Takehiro Niikura
ABSTRACT
The current trend towards smaller and smaller mobile devices may cause considerable difficulties in using them. In this paper, we propose an interface called Anywhere Surface Touch, which allows any flat or curved surface in a real environment to be used as an input area. The interface uses only a single small camera and a contact microphone to recognize several kinds of interaction between the fingers of the user and the surface. The system recognizes which fingers are interacting and in which direction the fingers are moving. Additionally, the fusion of vision and sound allows the system to distinguish the contact conditions between the fingers and the surface. Evaluation experiments showed that users became accustomed to our system quickly, soon being able to perform input operations on various surfaces.
- Ahmad, F., and Musilek, P. Ubihand: a wearable input device for 3d interaction. In ACM SIGGRAPH '06 Research posters (2006). Google Scholar
Digital Library
- Amento, B., Hill, W., and Terveen, L. The sound of one hand: A wrist-mounted bio-acoustic fingertip gesture interface. In CHI '02 Extended Abstracts (2002), 724--725. Google ScholarDigital Library
- Atrey, P., Hossain, M., El Saddik, A., and Kankanhalli, M. Multimodal fusion for multimedia analysis: a survey. Multimedia Systems 16, 6 (2010), 345--379.Google ScholarDigital Library
- Deyle, T., Palinko, S., Poole, E., and Starner, T. Hambone: A bio-acoustic gesture interface. In Proc. ISWC '07 (2007), 3--10. Google ScholarDigital Library
- Harrison, C., Benko, H., and Wilson, A. D. Omnitouch: wearable multitouch interaction everywhere. In Proc. UIST '11 (2011), 441--450. Google ScholarDigital Library
- Harrison, C., and Hudson, S. E. Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. In Proc. UIST '08 (2008), 205--208. Google ScholarDigital Library
- Harrison, C., and Hudson, S. E. Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In Proc. UIST '09 (2009), 121--124. Google ScholarDigital Library
- Harrison, C., and Hudson, S. E. Minput: enabling interaction on small mobile devices with high-precision, low-cost, multipoint optical tracking. In Proc. CHI '10 (2010), 1661--1664. Google ScholarDigital Library
- Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. In Proc. CHI '10 (2010), 453--462. Google ScholarDigital Library
- Kim, D., Hilliges, O., Izadi, S., Butler, A. D., Chen, J., Oikonomidis, I., and Olivier, P. Digits: freehand 3d interactions anywhere using a wrist-worn gloveless sensor. In Proc. UIST '12 (2012), 167--176. Google ScholarDigital Library
- Mistry, P., and Maes, P. Sixthsense: a wearable gestural interface. In ACM SIGGRAPH ASIA '09 Sketches (2009), 11:1--11:1. Google ScholarDigital Library
- Nakatsuma, K., and Shinoda, H. Wristband-shaped input interface using user's back of hand. In WHC '11 Demo (2011).Google Scholar
- Nanayakkara, S., Shilkrot, R., Yeo, K. P., and Maes, P. Eyering: A finger worn input device for seamless interactions with our surroundings. In Proc. AH '13 (2013), 13--20. Google ScholarDigital Library
- Niikura, T., Hirobe, Y., Cassinelli, A., Watanabe, Y., Komuro, T., and Ishikawa, M. In-air typing interface for mobile devices with vibration feedback. In ACM SIGGRAPH '10 Emerging Technologies (2010), 15:1--15:1. Google ScholarDigital Library
- Roeber, H., Bacus, J., and Tomasi, C. Typing in thin air: the canesta projection keyboard - a new method of interaction with electronic devices. In CHI '03 Extended Abstracts (2003), 712--713. Google ScholarDigital Library
- Shiratori, T., Park, H. S., Sigal, L., Sheikh, Y., and Hodgins, J. K. Motion capture from body-mounted cameras. ACM Trans. Graph. 30, 4 (2011), 31:1--31:10. Google ScholarDigital Library
- Villar, N., Izadi, S., Rosenfeld, D., Benko, H., Helmes, J., Westhues, J., Hodges, S., Ofek, E., Butler, A., Cao, X., and Chen, B. Mouse 2.0: multi-touch meets the mouse. In Proc. UIST '09 (2009), 33--42. Google ScholarDigital Library
- Watanabe, Y., Hatanaka, T., Komuro, T., and Ishikawa, M. Human gait estimation using a wearable camera. In Proc. WACV '11 (2011), 276--281. Google ScholarDigital Library
- Wilson, A. D. Playanywhere: a compact interactive tabletop projection-vision system. In Proc. UIST '05 (2005), 83--92. Google ScholarDigital Library
- Yatani, K., and Truong, K. N. Bodyscope: a wearable acoustic sensor for activity recognition. In Proc. UbiComp '12 (2012), 341--350. Google ScholarDigital Library
Index Terms
- Anywhere surface touch: utilizing any surface as an input area
Recommendations
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyIn this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
Air+touch: interweaving touch & in-air gestures
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyWe present Air+Touch, a new class of interactions that interweave touch events with in-air gestures, offering a unified input modality with expressiveness greater than each input modality alone. We demonstrate how air and touch are highly complementary: ...
3D touch panel interface using an autostereoscopic display
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfacesWe propose a 3D touch panel interface using an autostereoscopic display and a high-speed stereo camera. With this system, the virtual objects are stereoscopically-presented, and the objects respond to the hand movement captured by a stereo camera, which ...
Comments