Skip to main content

Digital Paparazzi: Spotting Celebrities in Professional Photo Libraries

  • Conference paper
Computer Vision – ACCV 2012 (ACCV 2012)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7725))

Included in the following conference series:

  • 3863 Accesses

Abstract

We propose a scalable solution to the problem of real-world face recognition when both training and test faces are under varying pose and illumination. Our proposed classifier solves a sparse approximation problem in a learned transform domain. Our algorithm uses a cascaded solution to significantly reduce the computational cost of the classification process. The cascaded solution first applies a more efficient Subspace Pursuit Algorithm on the test image, and only runs a more accurate ℓ1-minimization algorithm on those face images for which the Subspace Pursuit does not have enough confidence in prediction. We also show the application of our algorithm in automatic face annotation of media objects, and show that on average our algorithm achieves about 94% annotation accuracy over the celebrity benchmark dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Berg, T.L., Berg, A.C., Edwards, J., Maire, M., White, R., Teh, Y.W., Learned-Miller, E., Forsyth, D.A.: Names and Faces in the News. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 848–854. IEEE (2004)

    Google Scholar 

  2. Huang, G.B., Mattar, M., Berg, T., Learned-Miller, E., et al.: Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments. In: The Workshop on Faces in Real-Life Images at European Conference on Computer Vision, ECCV (2008)

    Google Scholar 

  3. Wright, J., Allen, Y., Ganesh, A., Sastry, S., Ma, Y.: Robust Face Recognition via Sparse Representation. IEEE Trans. Pattern Anal. Mach. Intell. 31, 210–227 (2009)

    Article  Google Scholar 

  4. Weinberger, K., Saul, L.: Distance Metric Learning for Large Margin Nearest Neighbor Classification. J. Mach. Learn. Res. 10, 207–244 (2009)

    MATH  Google Scholar 

  5. Weinberger, K., Saul, L.: Fast solvers and efficient implementations for distance metric learning. In: Proceedings of the 25th International Conference on Machine Learning, pp. 1160–1167. ACM (2008)

    Google Scholar 

  6. Belhumeur, P.N., Hespanha, J.P., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 711–720 (1996)

    Article  Google Scholar 

  7. Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Anal. Mach. Intell. 25, 218–233 (2003)

    Article  Google Scholar 

  8. Wang, H., Yan, S., Huang, T., Liu, J., Tan, X.: Misalignment-robust face recognition. In: CVPR, pp. 1–6 (2008)

    Google Scholar 

  9. Donoho, D.L.: Compressed sensing. IEEE Transactions on Information Theory 52, 1289–1306 (2006)

    Article  MathSciNet  Google Scholar 

  10. Jafarpour, S.: Deterministic Compressed Sensing. PhD thesis, Princeton University (2011)

    Google Scholar 

  11. Weinberger, K.Q., Sha, F., Saul, L.K.: Convex optimizations for distance metric learning and pattern classification. IEEE Signal Processing Magazine 27, 146–158 (2009)

    Article  Google Scholar 

  12. Ho, J., Yang, M., Lim, J., Lee, K., Kriegman, D.: Clustering appearances of objects under varying illumination conditions. In: CVPR, pp. 11–18 (2003)

    Google Scholar 

  13. Crammer, K., Singer, Y.: On the algorithmic implementation of multiclass kernel-based vector machines. J. Mach. Learn. Res. 2, 265–292 (2002)

    MATH  Google Scholar 

  14. Jiao, F., Li, S., Shum, H., Schuurmans, D.: Face alignment using statistical models and wavelet features. In: Proceedings of CVPR, pp. 321–327 (2003)

    Google Scholar 

  15. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active Appearance Models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484–498. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  16. Hu, C., Feris, R., Turk, M.: Real-time view-based face alignment using active wavelet networks. In: Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures. IEEE Computer Society (2003)

    Google Scholar 

  17. Li, S.Z., ShuiCheng, Y., Zhang, H., Cheng, Q.: Multi-view face alignment using direct appearance models. In: International Conference on Automatic Face and Gesture Recognition. IEEE Computer Society (2002)

    Google Scholar 

  18. Matthews, I., Baker, S.: Active appearance models revisited. Int. J. Comput. Vision 60, 135–164 (2004)

    Article  Google Scholar 

  19. Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1999, pp. 187–194 (1999)

    Google Scholar 

  20. Zhou, Y., Gu, L., Zhang, H.: Bayesian tangent shape model: Estimating shape and pose parameters via bayesian inference. In: Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2003 (2003)

    Google Scholar 

  21. Zhou, Y., Zhang, W., Tang, X., Shum, H.: A bayesian mixture model for multi-view face alignment. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), pp. 741–746 (2005)

    Google Scholar 

  22. Everingham, M., Zisserman, A.: Regression and classification approaches to eye localization in face images. In: International Conference on Automatic Face and Gesture Recognition (2006)

    Google Scholar 

  23. Taigman, Y., Wolf, L., Hassner, T.: Multiple One-Shots for Utilizing Class Label Information. In: British Machine Vision Conference (2009)

    Google Scholar 

  24. Wolf, L., Hassner, T., Taigman, Y.: Similarity Scores Based on Background Samples. In: Zha, H., Taniguchi, R.-i., Maybank, S. (eds.) ACCV 2009, Part II. LNCS, vol. 5995, pp. 88–97. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  25. Zhang, X., Gao, Y.: Face recognition across pose: A review. Pattern Recognition 42, 2876–2896 (2009)

    Article  Google Scholar 

  26. Wagner, A., Wright, J., Ganesh, A., Zhou, Z., Mobahi, H., Ma, Y.: Towards a practical face recognition system: Robust alignment and illumination via sparse representation. To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) (2011)

    Google Scholar 

  27. Peng, Y., Ganesh, A., Wright, J., Xu, W., Ma, Y.: Rasl: Robust alignment by sparse and low-rank decomposition for linearly correlated images. To appear in IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) (2011)

    Google Scholar 

  28. Huang, G.B., Jain, V., Learned-Miller, E.: Unsupervised Joint Alignment of Complex Images. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8 (2007)

    Google Scholar 

  29. Ho, J., Yang, M., Lim, J., Lee, K., Kriegman, D.: Joint face alignment with a generic deformable face model. In: CVPR, pp. 561–568 (2011)

    Google Scholar 

  30. The world’s most powerful celebrities. Forbes Magazine (2011)

    Google Scholar 

  31. Viola, P., Jones, M.: Robust Real-Time Face Detection. Int. J. Comput. Vision 57, 137–154 (2004)

    Article  Google Scholar 

  32. van den Berg, E., Friedlander, M.P.: Probing the pareto frontier for basis pursuit solutions. SIAM Journal on Scientific Computing 31, 890–912 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  33. Yang, A.Y., Ganesh, A., Zhou, Z., Sastry, S., Ma, Y.: A Review of Fast ℓ1-Minimization Algorithms for Robust Face Recognition. CoRR abs/1007.3753 (2010)

    Google Scholar 

  34. Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 71–86 (1991)

    Article  Google Scholar 

  35. Wolf, L., Hassner, T., Taigman, Y.: Descriptor based methods in the wild. In: Real-Life Images Workshop at the European Conference on Computer Vision, ECCV (2008)

    Google Scholar 

  36. Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intelligence 23, 643–660 (2001)

    Article  Google Scholar 

  37. Samaria, F.S., Harter, A.: Parameterisation of a stochastic model for human face identification (1994)

    Google Scholar 

  38. Voorhees, E.M.: The trec-8 question answering track report. In: Proceedings of TREC-8, pp. 77–82 (1999)

    Google Scholar 

  39. Dai, W., Milenkovic, O.: Subspace Pursuit for Compressive Sensing Signal Reconstruction. IEEE Trans. Inf. Theor. 55, 2230–2249 (2009)

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Jafarpour, S., Li, LJ., van Zwol, R. (2013). Digital Paparazzi: Spotting Celebrities in Professional Photo Libraries. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. ACCV 2012. Lecture Notes in Computer Science, vol 7725. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37444-9_54

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37444-9_54

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37443-2

  • Online ISBN: 978-3-642-37444-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics