Skip to main content

Real-Time Intentional Eye Blink Detection Using Rhombus Identification

  • Conference paper
  • First Online:
New Trends in Computer Technologies and Applications (ICS 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1723))

Included in the following conference series:

Abstract

Eye blinking is an indicator for various applications such as face recognition, drowsiness detection, phone unlocking, etc. Existing work on blink recognition typically considers the normal expressions that the two eyes are unintentionally opened and closed simultaneously. There is no literature on detecting intentional eye blink with simultaneous one eye open and one eye closed. Such intentional eye blinks can serve as a customized signal for various applications, such as activating an intelligent security system by a member in danger. Further, the existing work uses the outline of an eye (called the Eye Aspect Ratio (EAR) method) to judge whether to blink or not. However, the sizes of people’s eyes could be different, and this method is thus prone to misjudgment. To remedy these loopholes, we propose the following two methods: (1) An intentional eye blinking mechanism with simultaneous one eye open and one eye closed as a signal to activate an intelligent security system; (2) A novel, fast, and accurate Rhombus Identification Method (RIM), considering the eye contour and normalized area, which can accurately identify expressions with eyes open and closed simultaneously, as a signal to activate security alarms. Compared with the EAR method, our RIM has significantly higher accuracy rates under different situations. Based on machine learning, we incorporate our RIM into an intelligent security system and justify the practicability of our RIM.

This Projet is Partially Sponsored by the MediaTek Foundation.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Aung, H., Bobkov, A.V., Tun, N.L.: Face detection in real time live video using yolo algorithm based on Vgg16 convolutional neural network. In: Proceedings of International Conference on Industrial Engineering, Applications and Manufacturing (ICIEAM), Sochi, Russia, May 2021

    Google Scholar 

  2. Baskin, C.: Image Convolution with an input Image of Size 7 \(\times \) 7 and a Filter Kernel of Size 3 \(\times \) 3, October 2020

    Google Scholar 

  3. Boyko, N., Basystiuk, O., Shakhovska, N.: Performance evaluation and comparison of software for face recognition, based on Dlib and Opencv library. In: Proceedings of the IEEE 2nd International Conference on Data Stream Mining & Processing (DSMP), Lviv, Ukraine (2018)

    Google Scholar 

  4. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 886–893 (2005)

    Google Scholar 

  5. Neurohive: VGG16-Convolutional Network for Classification and Detection, November 2018. https://neurohive.io/en/popular-networks/vgg16/

  6. Rosebrock, A.: Facial Landmarks with dlib, OpenCV, and Python, 3 July 2021

    Google Scholar 

  7. Schmidt-Hieber, J.: Nonparametric regression using deep neural networks with ReLU activation function. Ann. Stat. 48(4), 1875–1897 (2020)

    MathSciNet  MATH  Google Scholar 

  8. Javed Mehedi Shamrat, F.M.: A deep learning approach for face detection using max pooling. In: Proceedings of the International Conference on Trends in Electronics and Informatics (2021)

    Google Scholar 

  9. Simonyan, K., Zisserman, A: Very Deep Convolutional Networks for Large-scale Image Recognition arXiv:1409.1556 (2014)

  10. Soukupova, T., Cech, J.: Real-time eye blink detection using facial landmarks. In: Proceedings of the 21st Computer Vision Winter Workshop, Rimske Toplice, Slovenia, February 2016

    Google Scholar 

Download references

Acknowledgements

The author would like to thank Professor Hung-Yun Hsieh of Department of Electrical Engineering, National Taiwan University for his valuable suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alan Shu-Luen Chang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chang, A.SL. (2022). Real-Time Intentional Eye Blink Detection Using Rhombus Identification. In: Hsieh, SY., Hung, LJ., Klasing, R., Lee, CW., Peng, SL. (eds) New Trends in Computer Technologies and Applications. ICS 2022. Communications in Computer and Information Science, vol 1723. Springer, Singapore. https://doi.org/10.1007/978-981-19-9582-8_26

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-9582-8_26

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-9581-1

  • Online ISBN: 978-981-19-9582-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics