Skip to main content
Log in

Eyeglasses detection, location and frame discriminant based on edge information projection

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Eyeglasses have a significant effect on the accuracy of face feature extraction and face recognition. In order to improve the performance of face feature extraction and face recognition, a method that achieves eyeglasses detection, location and frame discriminant, based on edge information is proposed in this paper. First, the horizontal nose bridge area is determined by the location of the mouth, and the vertical nose bridge area is determined by the edge information projection method. Next, the spectacle beam is searched in the nose bridge area to determine the existence of eyeglasses. Subsequently, the eyeglasses areas are located according to the bidirectional edge information projection method and the existence of frames is determined. Finally, the frame width of the eyeglasses is measured based on the location of the left and the right glasses. Experimental results show that detection rate of eyeglasses using the proposed method is higher than the traditional methods and it can make a distinction between rimmed and rimless eyeglasses accurately. In addition, the proposed method can locate the eyeglasses areas and measure the frame width effectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:389–396

    Article  Google Scholar 

  2. Chen WQ, Wang BL (2016) Methods of eyeglasses detection and frame removal for face image. Comput Eng Appl 52:178–182

    Google Scholar 

  3. Dalal N, Triggs B. (2005) Histograms of Oriented Gradients for Human Detection, in: Computer Vision and Pattern Recognition, San Diego, pp. 886–893

  4. Fan HQ, Cao ZM, Jiang YN, Yin Q, Doudou CC. (2014) Learning deep face representation, in: IEEE Conference on Computer Vision and Pattern Recognition, Columbus, pp. 1–10

  5. Guo P. (2014) Glasses removal and region restoration in face images, Beijing University of Posts and Telecommunications

  6. Guo P, Su F. (2014) Enhanced PCA reconstruction method for eyeglass frame auto-removal, in: Proceedings of International Conference on Network Infrastructure and Digital Content, Beijing, pp. 359–363

  7. Hossain MF, Shamsi M, Alsharif MR, Yamashita K (2012) Automatic facial skin detection using Gaussian mixture model under varying illumination. Int J Innov Comput I 8:1135–1144

    Google Scholar 

  8. Jiang X, Binkert M, Achermann B, Bunke H (2000) Towards detection of glasses on facial images. Pattern Anal Applic 2:13–29

    Google Scholar 

  9. Jing Z, Mariani R, Wu JK. (2000) Glasses detection for face recognition using Bayes rules, in: Third International Conference on advances in Multimodal Interfaces, Beijing, pp. 127–134

  10. Li ZM, Zhao Y, Hu WJ (2014) A method for removing eyeglasses from frontal facial images. Industrial instrumentation and automation 3:51–53

    Google Scholar 

  11. Liu ZM, Li ZM, Wang YY et al (2014) Research on removing glasses based on PCA/ICA and error compensation algorithm. Opt Technol 40:429–433

    Article  Google Scholar 

  12. Pan J, Wang XS, Cheng YH (2016) Single-sample face recognition based on LPP feature transfer. IEEE Access 4:2873–2883

    Article  Google Scholar 

  13. Park JS, Oh YH, Ahn SC et al (2005) Glasses removal from facial image using recursive error compensation. IEEE Trans Pattern Anal Mach Intell 27:805–811

    Article  Google Scholar 

  14. Premal CE, Vinsley SS. (2014) Image processing based forest fire detection using YCbCr color model, in: International Conference on Circuit, Power and Computing Technologies, Nagercoil, pp. 1229–1237

  15. Ren MG, Chen YL, Cai XD, Yang C (2014) Glasses detection based on the edge information of face image. Software Guide 13:141–143

    Google Scholar 

  16. Sun Y, Wang XG, Tang XO. (2013) Hybrid Deep Learning for Computing Face Verification, in: IEEE International Conference on Computer Vision, Sydney, pp. 1489–1496

  17. Sun Y, Wang XG, Tang XO. (2014) Deep learning face representation from predicting 10,000 classes, in: IEEE Conference on Computer Vision and Pattern Recognition, Columbus, pp. 1891–1898

  18. Taigman Y, Yang M, Ranzato MA, Wolf L. (2014) DeepFace: Closing the gap to human-level performance in face verification, in: IEEE Conference on Computer Vision and Pattern Recognition, Columbus, pp. 1701–1708

  19. Wang L, Tang J, Xu HZ (2008) Fast pupils localization method based on Harris corner detection. Chinese Journal of Liquid Crystals and Displays 23:87–90

    Google Scholar 

  20. Wang YK, Jang J, Tsai LW, et al. (2010) Improvement of face recognition by eyeglasses removal, in: Proceedings of the Sixth Conference on Intelligent Information Hiding and Multimedia Signal Processing, Harbin, pp. 228–231

  21. Wu HY, Yoshikawa G, Shioyama T, et al. (2002) Glasses frame detection with 3D Hough transform, in: International Conference on Pattern Recognition, Québec City, pp.346–349

  22. Wu CY, Liu C, Shum HY et al (2004) Automatic eyeglasses removal from face images. IEEE Trans Pattern Anal Mach Intell 26:322–336

    Article  Google Scholar 

  23. Xu CY, Prince JL. (1997) Gradient vector flow: a new external force for snakes, in: Computer Vision and Pattern Recognition, Puerto Rico, pp. 66–71

  24. Yamauchi T (2013) Mouse trajectories and state anxiety: feature selection with random Forest. Proceedings of the Humaine Association Conference on the Affective Computing and Intelligent Interaction 7971:399–404

    Google Scholar 

  25. Zhang XL, Zhan K, Zhou HL, Shen YJ. (2015) A Fast Eye State Computing Algorithm, in: 2015 6th IEEE International Conference on Software Engineering and Service Science, Beijing, pp. 587–590

Download references

Acknowledgements

This work was partially supported by a grant from the National Natural Science Foundation of China (No.61401355, No.61502382, No.61472319), a grant from the Key Laboratory Foundation of Shaanxi Education Department, China (No.14JS072) and a grant from Science and Technology Project Foundation of Beilin District, Xi’an City, China (No.GX1621). The authors also thank anonymous reviewers for their valuable comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Minghua Zhao.

Ethics declarations

Conflict of interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhao, M., Zhang, X., Shi, Z. et al. Eyeglasses detection, location and frame discriminant based on edge information projection. Multimed Tools Appl 77, 14931–14949 (2018). https://doi.org/10.1007/s11042-017-5080-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-5080-4

Keywords

Navigation