Skip to main content
SpringerLink
Log in

Automatic Extraction of Eye and Mouth Fields from a Face Image Using Eigenfeatures and Ensemble Networks

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

This paper presents a novel algorithm for the extraction of the eye and mouth (facial features) fields from 2D gray level images. Eigenfeatures are derived from the eigenvalues and eigenvectors of the binary edge data set constructed from eye and mouth fields. Such eigenfeatures are ideal features for finely locating fields efficiently. The eigenfeatures are extracted from a set of the positive and negative training samples for facial features and are used to train a multilayer perceptron (MLP) whose output indicates the degree to which a particular image window contains the eyes or the mouth within itself. An ensemble network consisting of a multitude of independent MLPs was used to enhance the generalization performance of a single MLP. It was experimentally verified that the proposed algorithm is robust against facial size and even slight variations of the pose.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Yankang Wang, H. Kuroda, M. Fujumura, and A. Nakamura, “Automatic extraction of eye and mouth fields from monochrome face image using fuzzy technique,” in Proceedings of the 1995 4th IEEE International Conference on Universal Personal Communications Record, 1995, pp. 778–782.

  2. R. Pinto-Elias and J.H. Sossa-Azuela, “Automatic facial feature detection and location,” in Proceedings of the 14th International Conference on Pattern Recognition, 1998, vol. 2, pp. 1360–1364.

    Google Scholar 

  3. K. Fukui and O. Yamaguchi, “Facial feature point extraction method based on combination of shape extraction and pattern matching,” Systems and Computers in Japan, vol. 29, no. 6, pp. 49–58, 1998.

    Google Scholar 

  4. T. Kanade, “Picture processing by computer complex and recognition of human faces,” Dept. of Information Science, Kyoto University, Technical Report, 1973.

  5. R. Brunelli and T. Poggio, “Face recognition: Features versus templates,” IEEE Transaction on PAMI, vol. 15, no. 10, pp. 1042–1052, 1993.

    Google Scholar 

  6. D.J. Beymer, “Face recognition under varying pose,” MIT A.I Memo No. 1461, 1993.

  7. P. Juell and R. Marsh, “A hierarchical neural network for human face detection,” Pattern Recognition, vol. 29, no. 5, pp. 781–787, 1996.

    Google Scholar 

  8. Fenghao Mu, Haibo Li, and R. Forchheimer, “Automatic extraction of human facial features,” Signal Processing: Image Communication, vol. 8, pp. 309–326, 1996.

    Google Scholar 

  9. T. Shakunaga, K. Ogawa, and S. Oki, “Integration of eigentemplate and structure matching for automatic facial feature detection,” in Proceeding of the 2nd International Conference on Automatic Face and Gesture Recognition, 1998, pp. 94–99.

  10. Ying-li Tian, T. Kanade, and J.F. Cohn, “Recognizing lower face action units for facial expression analysis,” in Proceeding of the 4th International Conference on Automatic Face and Gesture Recognition, 2000, pp. 484–490.

  11. Ying-li Tian, T. Kanade, and J.F. Cohn, “Dual-state parametric eye tracking,” in Proceeding of the 4th International Conference on Automatic Face and Gesture Recognition, 2000, pp. 110–115.

  12. R. Battiti and A.M. Colla, “Democracy in neural nets: Voting schemes for classification,” Neural Networks, vol. 7, no. 4, pp. 691–707, 1994.

    Google Scholar 

  13. D.F. McCoy and V. Devarajan, “Artificial immume systems and aerial image segmentation,” IEEE International Conference on Systems, Man, and Cybernetics, 1997.

  14. M. Riedmiller and H. Braun, “Adirect adaptive method for faster backpropagation learning: The RPROP algorithm,” IEEE International Conference on Neural Networks, 1993, vol. 1, pp. 586–591.

    Google Scholar 

  15. E. Fiesler and R. Beale, Handbook of Neural Computation, Oxford University Press, 1997.

  16. S. Romdhani, “ Face recognition using principal components analysis, ” MS Thesis, 1996, Available at http://www.elec.gla.ac.uk/(romdhani)/pca.htm.

Download references

Author information

Authors and Affiliations

  1. Department of Electrical Engineering, Pohang University of Science and Technology (POSTECH), KyungBuk, 790-784, Korea

    Yeon-Sik Ryu & Se-Young Oh

Authors
  1. Yeon-Sik Ryu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Se-Young Oh
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ryu, YS., Oh, SY. Automatic Extraction of Eye and Mouth Fields from a Face Image Using Eigenfeatures and Ensemble Networks. Applied Intelligence 17, 171–185 (2002). https://doi.org/10.1023/A:1016160814604

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1016160814604

Search

Navigation