Elsevier

Computers & Graphics

Volume 18, Issue 5, September–October 1994, Pages 633-642
Computers & Graphics

“Finger-Pointer”: Pointing interface by image processing

https://doi.org/10.1016/0097-8493(94)90157-0Get rights and content

Abstract

We have developed an experimental system for the 3D direct pointing interface “Finger-Pointer,” which can recognize finger pointing actions and simple hand forms in real-time by processing the image sequences captured by stereoscopic TV cameras. The operator is not required to attach any peculiar device such as the Data-Glove or a magnetic sensor. Simple and fast image processing algorithms employed in the system enable real-time processing without any special image processing hardware. By introducing the notion of “VPO (Virtual Projection Origin),” the system can recognize pointing actions stably and accurately regardless of the operator's pointing style. The system also synchronizes and integrates the audio and the visual channels by introducing the “Timing Tag” technique.

References (17)

  • M. Vargas

    Louder than words

    (1987)
  • Y. Suenaga et al.

    Human reader: An advanced man-machine interface based on human images and speech

    Trans. IEICE

    (1987)
  • K. Mase et al.

    A real time head motion detection system

  • K. Mase

    An application of optical flow—Extraction of facial expression

  • R.A. Bolt

    Put-that-there: Voice and gesture at the graphics interface

    ACM SIGGRAPH

    (1980)
  • D. Weimer et al.

    A synthetic visual environment with hand gestures and voice input

  • K. Hirose

    Recognition of Japanese manual alphabet using thinning image

    IEICE Tech. Rep.

    (1993)
  • M. Kato et al.

    A gesture interface for 3D shape manipulation

There are more references available in the full text version of this article.

Cited by (49)

  • Relative Pointing Interface: A gesture interaction method based on the ability to divide space

    2020, International Journal of Industrial Ergonomics
    Citation Excerpt :

    Various methods to project the position of the hand onto the screen have been proposed. In one study (Fukumoto et al., 1994), the direction of the pointing gesture was recognized using a virtual reference point in space called Virtual Projection Origin (VPO). The cursor was projected at the point of intersection between the screen and the straight line that connects the VPO to the fingertip.

  • A real-time vision-based hand gesture interaction system for virtual EAST

    2016, Fusion Engineering and Design
    Citation Excerpt :

    Rautaray Siddharth.S [4] proposed a hand gesture interaction system under dynamic environment in 2011, which use image processing technology to complete the detection, segmentation, tracking and recognition of hand, and convert the hand gesture to a significant computer command. Based on the shape feature of hand or fingers, researchers [5,6] have proposed some methods to estimate the point direction of finger or multi-finger. Another method [7–9] uses 3D hand model to analysis gesture with one or more camera to capture image.

  • Physical Browsing and Selection-Easy Interaction with Ambient Services

    2010, Human-Centric Interfaces for Ambient Intelligence
  • A multidimensional dynamic time warping algorithm for efficient multimodal fusion of asynchronous data streams

    2009, Neurocomputing
    Citation Excerpt :

    In contrast to early fusion architectures, mutual information coming from another modality is not considered during the recognition of a single mode, which causes late fusion to perform worse than early fusion if the modalities are correlated like in bimodal emotion recognition [21] or when using lip-reading for enhanced speech recognition. Multimodal fusion at the semantic level has been applied in systems like Bolt's “Put-that-there” [10], ShopTalk [15], finger-pointer [19], and others like in [36,70,62]. Hybrid systems for multimodal integration are an attempt to combine the advantages of late and early fusion.

View all citing articles on Scopus
View full text