Abstract
In this paper, we propose a novel approach to automatically index digital home photos based on person identity. A person is identified by his/her face and clothes. The proposed method consists of two parts: clustering and indexing. In the clustering, a series of unlabeled photos is aligned in taken-time order, and is divided into several sub-groups by situation. The situation groups are decided by time and visual differences. In the indexing, SVMs are trained with features of pre-indexed faces to model target persons. The representative feature vector of the person group from the clustering is queried to the trained SVMs. Each SVM outputs a numeric confidence value about the query person group. The query person group is determined to the target person by the most confident SVM. The experimental results showed that the proposed method outperformed traditional person indexing method using only face feature and its performance increased to 93.56% from 72.31%.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Yagawa, Y., Iwai, N., Yanagi, K., Kojima, K., Matsumoto, K.: The Digital Album: a personal file-tainment system. In: Proc. of IEEE Intl’ Conference on MCS, pp. 433–439 (1996)
Yang, M.H., Kriegman, D., Ahuja, N.: Detection Faces in Images: A Survey. IEEE Trans. on PAMI, 34–58 (2002)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face Recognition: A Literature Survey. ACM Computing Surveys, 399–458 (2003)
Ahang, L., Chen, L., Li, M., Zhang, H.: Automated Annotation of Human Faces in Family Albums. In: Proc. of the 11th ACM intl. conf. on Multimedia, pp. 355–358 (2003)
Yang, S., Kim, S.K., Seo, K.S., Ro, Y.M.: Automated Situation Clustering of Home Photos for Digital Albuming. SPIE (2005)
Manjunath, B.S., Salembier, P., Sikora, T.: Introduction to MPEG-7. John Wiley & Sons, Ltd, Chichester (2002)
Viola, P., Jones, M.: Rapid Object Detection using a Boosted Cascade of Simple Features. In: CVPR, pp. 511–518 (2001)
Wu, B., Ai, H., Huang, C., Lao, S.: Fast Rotation Invariant Multi-View Face Detection Based on Real Adaboost. In: AFGR, pp. 79–84 (2004)
Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. In: Computational Learning Theory: Eurocolt 1995, pp. 23–37 (1995)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons, Ltd, Chichester (2001)
Vapnik, V.N.: The Nature of Statistical Learning Theory, 2nd edn. Springer, Heidelberg (1999)
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines and other kernel-based learning methods. Cambridge University Press, Cambridge (2000)
Moody, J., Darken, C.J.: Fast learning in networks of locally tuned processing units. Neural Computation, 281–294 (1989)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons, Ltd, Chichester (2001)
NIST Database, /M7photo/Photo_DB/Face-CE_testset_org, MPEG-7 Visual Group, ISO/IEC JTC1/SX29/WG11 (2005)
Bober, M., Kim, S.K.: Description of MPEG-7 Visual Core Experiments, MPEG-7 Visual Group ISO/IEC JTC1/SC29/WG11 N6905 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, S., Seo, K.S., Kim, S.K., Ro, Y.M., Kim, JY., Seo, Y.S. (2005). Automatic Photo Indexing Based on Person Identity. In: Ho, YS., Kim, HJ. (eds) Advances in Multimedia Information Processing - PCM 2005. PCM 2005. Lecture Notes in Computer Science, vol 3768. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11582267_76
Download citation
DOI: https://doi.org/10.1007/11582267_76
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30040-3
Online ISBN: 978-3-540-32131-6
eBook Packages: Computer ScienceComputer Science (R0)