Jun Rekimoto
ABSTRACT
We introduce a new sensor architecture for robust gesture recognition that uses a combination of a high-speed camera and synchronous LED illumination. This sensor looks at shadows cast by a user's hand for recognizing position. The position of the hand can be robustly recognized by independently tracking multiple shadows and by using multiple light sources with time-synchronous modulation with the camera. We also developed a multi-finger tracking system that uses similar modulated illumination from multiple light positions. We expect that these sensing configurations can be naturally integrated into our daily environments as LED lighting becomes more commonplace.
- Cassinelli, A., Perrin, S., and Ishikawa, M., Smart laser-scanner for 3D human-machine interface, CHI'05 extended abstracts, pp. 1138--1139, 2005. Google Scholar
Digital Library
- Hann, J., Low-cost Multi-touch Sensing through Frustrated Total Internal Reflection, ACM UIST'05, pp. 115--118, 2005. Google ScholarDigital Library
- Hodges, S., Izadi, S., Bulter, A., Rrustemi, A., Buxton, B., ThinSight: versatile multi-touch sensing for thin form-factor displays, ACM UIST'07, pp. 259--268, 2007. Google ScholarDigital Library
- Krueger, M. W., Artificial Reality II, Addison-Wesley, 1990.Google Scholar
- Matsushita, M., Rekimoto, J., HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall, Proceedings of UIST'97, 1997. Google ScholarDigital Library
- Microsoft Surface, http://www.surface.comGoogle Scholar
- Toshiba Matsushita, LCD with Finger Shadow Sensing, http://www3.toshiba.co.jp/tm_dsp/press/2005/05-09-29.htmGoogle Scholar
Index Terms
- Brightshadow: shadow sensing with synchronous illuminations for robust gesture recognition
Recommendations
Kinect-based Taiwanese sign-language recognition system
Gesture-recognition is an important component for many intelligent human---computer interaction applications. For example, a realtime sign-language recognition system would detect and interpret hand gestures. Many vision-based sign-language recognition ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
A Method to Recognize Eyeball Movement Gesture using Infrared Distance Sensor Array on Eyewear
iiWAS2021: The 23rd International Conference on Information Integration and Web IntelligenceSensing technology for eyeball movement (i.e., gaze movement) has enabled various applications, e.g., hands-free input interfaces and provided information that helps us understand human beings in various fields. However, the existing method, which ...
Comments