Abstract
This paper presents the software implementation for the detection of facial landmarks with the data trained on iBUG 300 – W dataset by dlib library in python and implementing them for controlling mouse operations. The proposed method aims at catering to the needs of differently – abled people (for example, people with locked – in syndrome), who are not able to operate a computer. Blinking of the left eye will result in a left click, the blinking of the right eye will result in right-click and scroll mode is enabled by opening the mouth. The same is done for disabling the scroll mode. Concept of Eye Aspect Ratio in the case of eyes and mouth aspect ratio in the case of mouth has been used for checking whether that particular mouse operation is performed or not. Image enhancement has been done primarily by Contrast Limited Adaptive Histogram Equalization (CLAHE) and Gaussian Filtering.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Soukupova, T., Cech, J.: Real-time eye blink detection using facial landmarks. In: Luka, C., Rok, M., Vitomir, S. (eds.) 21st Computer Vision Winter Workshop Rimske Toplice, Slovenia, 3–5 February, pp. 1–3 (2016)
Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regressing local binary features. In: Proceedings CVPR, pp. 1685–1692 (2014)
Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: CVPR, pp. 1–2 (2014)
Arai, K., Mardiyanto, R.: Comparative study on blink detection and gaze estimation methods for HCI, in particular, gabor filter utilized blink detection method. In: Proceedings of 8th, International Conference on Information Technology: New Generations, Las Vegas, USA, pp. 442–443 (2011)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001, vol. 1, pp. I–511–I–518, p. 3 (2001)
Hickson, S., Dufour, N., Sud, A., Kwatra, V., Essa, I.: Eyemotion: classifying facial expressions in VR using eye-tracking cameras. In: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1626–1627 (2019)
Behera, A., Gidney, A., Wharton, Z., Robinson, D., Quinn, K.: A CNN model for head pose recognition using wholes and regions. In: IEEE International Conference on Automatic Face and Gesture Recognition (Accepted/in press)
Rahul, M., Shukla, R., Yadav, D.K., Yadav, V.: Zernike moment-based facial expression recognition using two-staged hidden markov model. Adv. Comput. Commun. Comput. Sci. 924, 664 (2019)
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: A semi-automatic methodology for facial landmark annotation. In: Proceedings of IEEE International Conference Computer Vision and Pattern Recognition (CVPR-W), 5th Workshop on Analysis and Modeling of Faces and Gestures (AMFG 2013), Oregon, USA, June 2013
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the-wild challenge: the first facial landmark localization challenge. In: Proceedings of IEEE International Conference on Computer Vision (ICCV-W), 300 Faces in-the-Wild Challenge (300-W), Sydney, Australia, December 2013
Rosebrock, A.: Imutils. https://github.com/jrosebr1/imutils
Pisano, E.D., Zong, S., Jhonston, R. E.: Contrast limited adaptive histogram equalization image processing to improve the detection of simulated speculation in dense mammograms. J. Digit. Imaging 11(4), 193–200 (1998)
Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S., Pantic, M.: 300 faces in-the- wild challenge: database and results, special issue on facial landmark localisation "in-the-wild". Image Vis. Comput. (IMAVIS) 47, 3–18 (2016)
Sharma, S., Jain, S., Khushboo.: A static hand gesture and face recognition system for blind people. In: 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN), pp. 536–537 (2019)
Manu, B.N.: Facial features monitoring for real time drowsiness detection. In: 2016 12th International Conference on Innovations in Information Technology (IIT), pp. 79-80 (2016)
Alshaqaqi, B., Baquhaizel, A.S., Amine Ouis, M.E., Boumehed, M., Ouamri, A., Keche, M.: Driver drowsiness detection system. In: 2013 8th International Workshop on Systems, Signal Processing and Their Applications (WoSSPA), pp. 152-153 (2013)
Sandikci, E.N., Erdem, C.E., Ulukaya, S.: A comparison of facial landmark detection methods. In: 2018 26th Signal Processing and Communications Applications Conference (SIU) (2018)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Gaur, A., Kinage, A., Rekhawar, N., Rukmangad, S., Lal, R., Chiddarwar, S. (2021). Cursor Control Using Face Gestures. In: Abraham, A., Jabbar, M., Tiwari, S., Jesus, I. (eds) Proceedings of the 11th International Conference on Soft Computing and Pattern Recognition (SoCPaR 2019). SoCPaR 2019. Advances in Intelligent Systems and Computing, vol 1182. Springer, Cham. https://doi.org/10.1007/978-3-030-49345-5_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-49345-5_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49344-8
Online ISBN: 978-3-030-49345-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)