Skip to main content

Online Face Recognition System Based on Local Binary Patterns and Facial Landmark Tracking

  • Conference paper
  • First Online:
Advanced Concepts for Intelligent Vision Systems (ACIVS 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9386))

Abstract

This paper presents a system for real-time face recognition. The system learns and recognizes faces from a video on the fly and it doesn’t need already trained database. The system consists of the following sub-methods: face detection and tracking, face alignment, key frame selection, face description and face matching. The system detects face tracks from a video, which are used in learning and recognition. Facial landmark tracking is utilized to detect changes in facial pose and expression in order to select key frames from a face track. Faces in key frames are represented using local binary patterns (LBP) histograms. These histograms are stored into the database. Nearest neighbor classifier is used in face matching. The system achieved recognition rate of 98.6% in offline test and 95.9% in online test.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (2006)

    Article  Google Scholar 

  2. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.: Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)

    Article  Google Scholar 

  3. Ahonen, T., Hadid, A., Pietikäinen, M.: Face Description with Local Binary Patterns: Application to Face Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(12), 2037–2041 (2006)

    Article  MATH  Google Scholar 

  4. Gaisser, F., Rudinac, M., Jonker, P.P., Tax, D.: Online face recognition and learning for cognitive robots. In: 2013 16th International Conference on Advanced Robotics (ICAR), pp. 1–9 (2013)

    Google Scholar 

  5. Taigman, Y., Yang, M., Ranzato, M.A., Wolf, L.: DeepFace: closing the gap to human-level performance in face verification. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1701–1708 (2014)

    Google Scholar 

  6. Sun, Y., Wang, X., Tang, X.: Deeply learned face representations are sparse, selective, and robust. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2892–2900 (2015)

    Google Scholar 

  7. Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a Unied embedding for face recognition and clustering. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 815–823 (2015)

    Google Scholar 

  8. Lu, C., Tang, X.: Surpassing human-level face verification performance on LFW with GaussianFace. In: Proc. 29th AAAI Conference on Artificial Intelligence (AAAI), pp. 3811–3819 (2015)

    Google Scholar 

  9. Wagner, A., Wright, J., Ganesh, A., Zhou, Z., Mobahi, H., Ma, Y.: Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation. IEEE Transactions on Pattern Analysis and Machine Intelligence 34(2), 372–386 (2012)

    Article  Google Scholar 

  10. Chen, J., Kellokumpu, V., Zhao, G., Pietikäinen, M.: RLBP: Robust Local Binary Pattern. In: Proc. British Machine Vision Conference (BMVC), pp. 1–10 (2013)

    Google Scholar 

  11. Dantone, M., Gall, J., Fanelli, G., Van Gool, L.: Real-time facial feature detection using conditional regression forests. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2578–2585 (2012)

    Google Scholar 

  12. Dantone, M., Gall, J., Fanelli, G., van Gool, L.: Facial Feature Detection. http://www.dantone.me/projects-2/facial-feature-detection/

  13. Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M.: Incremental face alignment in the wild. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1859–1866 (2014)

    Google Scholar 

  14. Asthana, A., Zafeiriou, S.: Chehra. https://sites.google.com/site/chehrahome/home/

  15. Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1867–1874 (2014)

    Google Scholar 

  16. Lee, K.C., Ho, J., Yang, M.H., Kriegman, D.: Visual Tracking and Recognition Using Probabilistic Appearance Manifolds. Computer Vision and Image Understanding 99(3), 303–331 (2005)

    Article  Google Scholar 

  17. Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 511–518 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marko Linna .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Linna, M., Kannala, J., Rahtu, E. (2015). Online Face Recognition System Based on Local Binary Patterns and Facial Landmark Tracking. In: Battiato, S., Blanc-Talon, J., Gallo, G., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2015. Lecture Notes in Computer Science(), vol 9386. Springer, Cham. https://doi.org/10.1007/978-3-319-25903-1_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-25903-1_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-25902-4

  • Online ISBN: 978-3-319-25903-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics