Abstract
In this paper, we propose a new face and eye gaze tracking method that works by attaching gaze tracking devices to stereoscopic shutter glasses. This paper presents six advantages over previous works. First, through using the proposed method with stereoscopic VR systems, users feel more immersed and comfortable. Second, by capturing reflected eye images with a hot mirror, we were able to increase eye gaze accuracy in a vertical direction. Third, by attaching the infrared passing filter and using an IR illuminator, we were able to obtain robust gaze tracking performance irrespective of environmental lighting conditions. Fourth, we used a simple 2D-based eye gaze estimation method based on the detected pupil center and the ‘geometric transform’ process. Fifth, to prevent gaze positions from being unintentionally moved by natural eye blinking, we discriminated between different kinds of eye blinking by measuring pupil sizes. This information was also used for button clicking or mode toggling. Sixth, the final gaze position was calculated by the vector summation of face and eye gaze positions and allowing for natural face and eye movements. Experimental results showed that the face and eye gaze estimation error was less than one degree.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bar-Cohen, Y., Mavroidis, C., Bouzit, M., Dolgin, B., Harm, D., Kopchok, G., White, R.: Virtual Reality Robotic Operation Simulations Using MEMICA Haptic System. In: SmartSystems 2000: The International Conference for Smart Systems and Robotics for Medicine and Space Applications, September 6 to 8, 2000b, Houston, Texas (2000)
Hurmuzlu, Y., Ephanov, A., Stoianovici, D.: Effect of a Pneumatically Driven Haptic Interface on the Perceptional Capabilities of Human Operators. In: Presence, vol. 7(3), pp. 290–307. MIT Press, Cambridge (1998)
Kenaley, G.L., Cutkosky, M.R.: Electrorheological Fluid-Based Robotic Fingers With Tactile Sensing. In: Proceedings of the 1989 IEEE International Conference on Robotics and Automation, Scottsdale AR, pp. 132–136 (1989)
Duchowski, A.T., Vertegaal, R.: Course 05: Eye-Based Interaction in Graphical Systems: Theory and Practice. ACM SIGGRAPH, New York, NY (July 2000)
Gramopadhye, A.K., Melloy, B., Chen, S., Bingham, J.: Use of Computer Based Training for Aircraft Inspectors: Findings and Recommendations. In: Proceedings of the HFES/IEA Annual Meeting, San Diego, CA (August 2000)
Yoo, D.H., Kim, J.H., Lee, B.R., Chung, M.J.: Non-contact Eye Gaze Tracking System by Mapping of Corneal Reflections. In: Proc. Fifth IEEE Int. Conf. on Automatic Face and Gesture Recognition, pp. 101–106 (May 2002)
Shih, S.W., Liu, J.: A Novel Approach to 3-D Gaze Tracking Using Stereo Cameras, IEEE Transactions on Systems, Man and Cybernetics, Part B, vol. 34(1), pp. 234–245 (February 2004)
Accessed on (January 10, 2007), http://www.vrdis.com/eng/eng_pro/etc_60gx.html
CRID=2204,CONTENTID=10556, Accessed on (January 10, 2007), http://www.logitech.com/index.cfm/products/details/KR/KO
Accessed on (January 10, 2007), http://www.ndcinfrared.com/tfodhot.aspx
Accessed on (January 10, 2007), http://polhemus.com/?page=Motion_Fastrak
Lee, S.J. et al.: A Study on Fake Iris Detection based on the Reflectance of the Iris to the Sclera for Iris Recognition, ITC-CSCC 2005, Jeju Island, South Korea, pp. 1555–1556 (July 4-7, 2005)
Accessed on (January 10, 2007), http://www.kodak.com/global/en/professional/support/techPubs/f13/f13.pdf
Daugman, J.: How Iris Recognition Works. IEEE Transaction on Circuits and System for Video Technology, 14(1) (2004)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 2nd edn. pp. 587–591. Prentice-Hall, Inc, Englewood Cliffs (2002)
Lee, E.C., Park, K.R., Kim, J.H.: Fake Iris Detection By Using the Purkinje Image. In: ICB 2006. LNCS, vol. 3832, pp. 397–403. Springer, Heidelberg (2006)
Lee, E.C., Park, K.R.: A Study on Manipulating Method 3D Game in HMD Environment by using Eye Tracking. Journal of the Institute of Electronics Engineers of Korea (submitted)
Lee, E.C., Park, K.R., Whang, M.C., Lim, J.S.: Near Infra-red Vision-based Facial and Eye Gaze Estimation Method for Stereoscopic Display System. In: 10th International Federation of Automatic Control (IFAC), Ritz-Carlton Hotel, Seoul, Korea, September 4-6, 2007 (accepted for publication 2007)
Lee, E.C. et al.: System and Method for Tracking Gaze, US patent pending
Lee, E.C., Park, K.R.: Manipulating character’s view direction of three dimensional first person shooting game by using gaze tracking in HMD environment. In: 2nd Next Generation Computing Conference, KINTEX, Ilsan, Korea (November 16-17, 2006)
Lee, E.C., Park, K.R.: A Study on Eye Gaze Estimation Method Based on Cornea Model of Human Eye. In: Lecture Notes in Computer Science (MIRAGE, INRIA Rocquencourt, France, March, 28–30, 2007 (accepted for publication 2007)
Lee, E.C., Park, K.R.: 3D View Controlling by Using Eye Gaze Tracking in First Person Shooting Game. Journal of Korea Multimedia Society, 8(10) (October 2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, E.C., Park, K.R., Whang, M.C., Park, J. (2007). Robust Gaze Tracking Method for Stereoscopic Virtual Reality Systems. In: Jacko, J.A. (eds) Human-Computer Interaction. HCI Intelligent Multimodal Interaction Environments. HCI 2007. Lecture Notes in Computer Science, vol 4552. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73110-8_76
Download citation
DOI: https://doi.org/10.1007/978-3-540-73110-8_76
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73108-5
Online ISBN: 978-3-540-73110-8
eBook Packages: Computer ScienceComputer Science (R0)