Proposal of PC Input Method by Combination of Gaze Detection and Head Movement Detection

Abstract

We propose a PC input methodology combining the gaze detection technology and the PupilMouse technology (head movement detection). Both technologies are based on the remote pupil detection technique using video cameras with near-infrared light sources. In the PupilMouse method, a user can move the cursor on the PC display screen smoothly and accurately, based on the movements of the user’s two pupils in the camera image caused by the user’s smooth head movement. The biggest advantage of PupilMouse is to be able to point a very small area without a scattering of the cursor. However, in order to move the cursor largely on the screen, the user must move the head largely. This is a burden for the user. In contrast, the gaze point moves quickly and largely by just looking. However, at present, there is no remote gaze detection system that can detect the gaze point on the PC screen accurately, as a replacement for computer mouse. Moreover, as the ability of the user, it might be very difficult to continue to direct the line of sight exactly to small areas. In the experiment that subjects type twelve Japanese letter string using a software keyboard, the input speed, number of typing mistakes, and the usability were investigated. The results show that the proposed method is comprehensively superior to both the gaze detection method and the PupilMouse method.