Norman H. Villaroman
Dale C. Rowe
ABSTRACT
Some individuals have difficulty using standard hand-manipulated computer input devices such as a mouse and a keyboard effectively. However, if these users have sufficient control over their face and head movement, a robust face tracking user interface can bring significant usability benefits. Using consumer-grade computer vision devices and signal processing techniques, a robust user interface can be made readily available at low cost, and can provide a number of benefits, including non-intrusive usage. Designing and implementing this type of user interface presents many challenges particularly with regards to accuracy and usability.
Continuing previously published research, we now present results based on an analysis and comparison of different options for face tracking user interfaces. Five different options are evaluated each with different architectural stages of a face tracking user interface -- namely user input, capture technology, feature retrieval, feature processing, and pointer behavior. Usability factors were also included in the evaluation. A prototype system, configured to use different options, was created and compared with existing similar solutions. Tests were designed that ran on an Internet browser and a quantitative evaluation was done. The results show which of the evaluated options performed better than the others and how the best performing prototype compares to currently available solutions. These findings can serve as a precursor to a full-scale usability study, various improvements, and future deployment for public use.
- VILLAROMAN, N. H. and ROWE, D. C. Improving accuracy in face tracking user interfaces using consumer devices. In Proceedings of the 1st Annual conference on Research in information technology (Calgary, Alberta, Canada, 2012). ACM, 57--62. Google Scholar
Digital Library
- VILLAROMAN, N. H. Face tracking user interfaces using vision-based consumer devices. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (Boulder, Colorado, USA, 2012). ACM, 297--298. Google ScholarDigital Library
- HUNKE, M. and WAIBEL, A. Face locating and tracking for human-computer interaction. In Signals, Systems and Computers, 1994. 1994 Conference Record of the Twenty-Eighth Asilomar Conference on, 1994). 1277--1281 vol. 1272.Google Scholar
- VARONA, J., MANRESA-YEE, C. and PERALES, F. J. Hands-free vision-based interface for computer accessibility. Journal of Network and Computer Applications, 31, 42008), 357--374. Google ScholarDigital Library
- GORODNICHY, D. O. and ROTH, G. Nouse "use your nose as a mouse" perceptual vision technology for hands-free games and interfaces. Image and Vision Computing, 22, 122004), 931--942.Google ScholarCross Ref
- GORODNICHY, D. Perceptual Cursor - A Solution to the Broken Loop Problem in Vision-Based Hands-Free Computer Control Devices. 2006.Google Scholar
- MORRIS, T. and CHAUHAN, V. Facial feature tracking for cursor control. Journal of Network and Computer Applications, 29, 12006), 62--80. Google ScholarDigital Library
- CHATHURANGA, S. K., SAMARAWICKRAMA, K. C., CHANDIMA, H. M. L., et al. Hands free interface for Human Computer Interaction. In Information and Automation for Sustainability (ICIAFs), 2010 5th International Conference on, 2010). 359--364.Google ScholarCross Ref
- BETKE, M., GIPS, J. and FLEMING, P. The Camera Mouse: visual tracking of body features to provide computer access for people with severe disabilities. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 10, 12002), 1--10.Google Scholar
- TU, J., TAO, H. and HUANG, T. Face as mouse through visual face tracking. Computer Vision and Image Understanding, 108, 1-22007), 35--40. Google ScholarDigital Library
- FANELLI, G., WEISE, T., GALL, J., et al. Real Time Head Pose Estimation from Consumer Depth Cameras. In DAGM'11 (Frankfurt, Germany, 2011). Google ScholarDigital Library
- VIOLA, P. and JONES, M. Rapid object detection using a boosted cascade of simple features. In Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, 2001). I-511--I-518 vol. 511.Google ScholarCross Ref
- LOWE, D. G. Object recognition from local scale-invariant features. In Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, 1999). 1150--1157 vol. 1152. Google ScholarDigital Library
- WEISE, T., BOUAZIZ, S., LI, H., et al. Realtime performance-based facial animation. ACM Trans. Graph., 30, 42011), 1--10. Google ScholarDigital Library
- SMOLYANSKIY, N. Face Tracking SDK in Kinect For Windows 1.5. http://nsmoly.wordpress.com/2012/05/21/face-tracking-sdk-in-kinect-for-windows-1-5/ (Last Accessed: Jun 2013).Google Scholar
Index Terms
- Design and evaluation of face tracking user interfaces for accessibility
Recommendations
Improving accuracy in face tracking user interfaces using consumer devices
RIIT '12: Proceedings of the 1st Annual conference on Research in information technologyUsing face and head movements to control a computer can be especially helpful for users who, for various reasons, cannot effectively use common input devices with their hands. Using vision-based consumer devices makes such a user interface readily ...
Face tracking user interfaces using vision-based consumer devices
ASSETS '12: Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibilityOne form of natural user interaction with a personal computer is based on natural face movements. This is especially helpful for users who cannot effectively use common input devices with their hands but have sufficient control of their heads. Using ...
Tracking a detected face with dynamic programming
In this paper, we consider the problem of tracking a moving human face in front of a video camera in real-time for a model-based coding application. The 3D head tracking in a MBC system could be implemented sequentially as 2D location tracking, coarse ...
Comments