Exploring Methods of Combining Eye Movement and Facial Expression for Object Selection

Abstract

Eye movement has been proved feasible and potential for object selection. However, traditional time-threshold-based method (TT) where the user fixates at a target object for a certain duration called “dwell time” to confirm selection is typically slow and uncomfortable. We present and evaluated the methods of combining eye movement and facial expression for object selection. An experiment with 33 subjects was conducted to estimate the performances of TT, smile-triggered method (ST) and frown-triggered method (FT). The results show that ST and FT save time significantly at the same time reduce the accuracy for every selection. Besides, subjective questionnaire show that ST outperforms TT and FT with respect to the comprehensive subjective feelings while selecting. This paper provides novel eye-movement-based methods for quick object selection and indicates the potential of ST and FT to achieve more accurate selection.