Skip to main content
SpringerLink
Log in

Construction of human faces from textual descriptions

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

The FAce SYnthesis (FASY) system described in this paper, presents a novel face construction approach based on textual description with the stored facial components extracted from different face databases. The system has two types of databases: (a) Full Face Database (DB-F) consisting of frontal face images collected from different face databases (b) Facial Component Database (DB-C) consisting of facial components extracted from the faces of DB-F. Both the databases also contain the textual description of the face images/facial component images. If the desired face as per the description of the user is not available in DB-F, then new face is constructed with the help of DB-C. The experiment has been conducted with 200 male and female face images from different face databases. The successful extraction of the facial components from the face images as mentioned above has been found to be 93% on an average and face construction satisfies the user’s textual query in 80% cases on an average. The work has been done using Visual Basic 6.0 and Matlab 6.5. The face construction method is implemented in VHDL, simulated by Modelsim SE/PE, and synthesized with Xilinx Webpack 4.1 followed by loading into the FPGA device.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31
Fig. 32
Fig. 33
Fig. 34
Fig. 35
Fig. 36
Fig. 37
Fig. 38
Fig. 39
Fig. 40
Fig. 41

Similar content being viewed by others

References

  • Bhatia N, Kumar R, Menon S (2007) FIDA: face recognition using descriptive input semantics, December 14. http://www.stanford.edu/class/cs229/proj2007/BhatiaKumarMenon-FIDAFaceRecognitionusingDescriptiveInputSemantics.pdf

  • Brunelli R, Poggio T (1993) Face recognition: features versus templates. IEEE Trans Pattern Anal Mach Intell 15(10):1042–1052

    Article  Google Scholar 

  • Chai D, Nghan KN (1999) Face segmentation using skin color map in videophone applications. IEEE Trans Circuits Syst Video Technol 9(4):551–564

    Google Scholar 

  • Choi HC, Oh SY (2005) Face detection in static images using Bayesian discriminating feature and particle attractive genetic algorithm. In: Intelligent robots and systems (IROS2005), pp 1072–1077

  • Gilbert JM (1993) A real time face recognition system using custom VLSI hardware. Harvard Undergraduate Honors Thesis in Computer Science

  • Gu H, Su G, Du C (2003) Feature points extraction from faces. In: Image and vision computing (IVCNZ’03), pp 154–158

  • Hadid A, Pietikinen M, Martinkauppi B (2002) Color-based face detection using skin locus model and hierarchical filtering. In: Proceedings of the 16th international conference on pattern recognition, pp 196–200

  • Halder S, Bhattacharjee D, Nasipuri M, Basu DK, Kundu M (2008) Face synthesis (FASY) system for generation of a face image from human description. In: Third international conference on industrial and information systems, Kharagpur, India

  • Heisele B, Koshizen T (2004) Components for face recognition. In: Sixth IEEE international conference on automatic face and gesture recognition (FGR’04)

  • Hsu RL, Jain AK (2002) Semantic face matching. http://biometrics.cse.msu.edu/Publications/Face/HsuJain_SemanticFaceMatching_ICME02.pdf

  • Hsu RL et al (2002) Face detection on colored images. IEEE Trans Pattern Anal Mach Intell 24(5):696–718

    Google Scholar 

  • Huang W, Sun Q, Lam CP, Wu JK (1998) A robust approach to face and eyes detection from images with cluttered background. In: Proceedings of the 14th international conference on pattern recognition, vol 1, pp 110–113

  • Jenkins JH (1994) Designing with FPGAs and CPLDs. Prentice-Hall, Englewood Cliffs

  • Juell P, Marsh R (1996) A hierarchical neural network for human face detection. Pattern Recognit 29(5):781–787

    Article  Google Scholar 

  • Kanade T (1973) Picture processing by computer complex and recognition of human faces. Technical Report, Department of Information Science, Kyoto University

  • Lemieus A, Parizeau M (2002) Experiment on eigen faces robustness. In: Proceedings of IEEE international conference on pattern recognition, pp 421–424

  • Mahoor MH, Abdel MM, Ansari AN (2006) Improved active shape model for facial feature extraction in color images. Department of Electrical and Computer Engineering, University of Miami, Florida, Journal of Multimedia, vol. 1, no 4

  • Perry DL (2002) VHDL programming by example. McGraw-Hill, New York

  • Phung SL, Bouzerdoum A, Chai D (2003) Skin Segmentation using color and edge information. School of Engineering and Mathematics, Edith Cowan University Perth, Australia. http://durendal.uplb.edu.ph:8080/dspace/bitstream/123456789/36/1/journal_sp.pdf

  • Manglik PK, Mishra U, Maringanti HB (2004) Facial expression recognition. In: IEEE international conference on systems, man and cybernetics, pp 2220–2224

  • Rowley HA, Baluja S, Kanade (1998) Neural network-based face detection. IEEE Trans Pattern Anal Mach Intell 20(1):23–38

  • Ryu YS, Oh SY (2002) Automatic extraction of eye and mouth fields from a face images using eigenfeatures and ensemble networks. Appl Intell 17(2):171–185

    Article  MATH  Google Scholar 

  • Sandeep K, Rajagopalan AN (2002) Human face detection in cluttered color images using skin color and edge information. Department of Electrical Engineering Indian Institute of Technology, India. http://www.ee.iitb.ac.in/~icvgip/PAPERS/166.pdf

  • Shih F, Chuang CF (2002) Automatic extraction of head and face boundaries and facial features. Department of Computer Science, Computer Vision Laboratory, College of Computing Sciences, New Jersey Institute of Technology, USA. http://www.elsevier.com/locate/ins

  • Sridharan K (2006) Semantic face retrieval. http://www.cse.buffalo.edu/tech-reports/2006-25.pdf

  • Turk M, Pentland A (1991a) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86

    Google Scholar 

  • Turk M, Pentland A (1991b) Face recognition using eigen-faces. In: Proceedings of IEEE conference on computer vision and pattern recognition, June 1991, pp 586–591

  • Vezhnevets V, Sazonov V, Andreeva A (2003) A survey on pixel-based skin color detection techniques. Graphics and Media Laboratory, Faculty of Computational Mathematics and Cybernetics, Moscow State University, Russia. http://graphics.cs.msu.ru/en/publications/text/gc2003vsa.pdf

  • Wakerly JF (2002) Digital design: principles and practices. Pearson Education Asia, New Delhi

  • Wu JK, Narasimhalu AD (1994) Identifying faces using multiple retrieval. In: IEEE multimedia (ISSN 1070-986X), pp 27–38

  • Wu H, Chen Q, Yachida M (1995) An application of fuzzy theory: face detection. In: Proceedings of IWAFGR’95, pp 314–319

  • Xi D, Podolak IT, Lee SW (2002) Facial component extraction and face recognition with support vector machines. In: Proceedings of the fifth international conference on automatic face and gesture recognition. IEEE Computer Society, New York, pp 76–81

  • Yang MH, Kriegman, DJ, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24(1):34–58

    Google Scholar 

  • Yow KC, Cipolla R (1997) Feature-based human face detection. Image Visi Comput 15(9):713–735

    Article  Google Scholar 

  • Yuille AL, Cohen DS, Hallinan PW (1989) Feature extraction using deformable templates. In: Proceedings of IEEE international conference on pattern recognition, pp 484–488

  • Zhim Q, Cheng KT, Wir CT (2004) A unified adaptive approach to accurate skin detection. In: International conference on image processing, ICIP, vol 2, pp 1189–1192

Download references

Acknowledgments

The authors are thankful to the “Center for Microprocessor Application for Training Education and Research”, “Project on Storage Retrieval and Understanding of Video for Multimedia” of Computer Science and Engineering Department, Jadavpur University, for providing infrastructural facilities during progress of the work. One of the authors, Mr. Santanu Halder, is thankful to RCC Institute of Information Technology and Guru Nanak Institute of Technology for kindly permitting him to carry on the research work and Dr. D. K. Basu thankfully acknowledges AICTE, New Delhi, for providing an Emeritus fellowship.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India

    Debotosh Bhattacharjee, Mita Nasipuri, Dipak Kumar Basu & Mahantapas Kundu

  2. Department of Computer Science and Engineering, RCC Institute of Information Technology, Kolkata, 700015, India

    Santanu Halder

Authors
  1. Debotosh Bhattacharjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Santanu Halder
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mita Nasipuri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dipak Kumar Basu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mahantapas Kundu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Santanu Halder.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Bhattacharjee, D., Halder, S., Nasipuri, M. et al. Construction of human faces from textual descriptions. Soft Comput 15, 429–447 (2011). https://doi.org/10.1007/s00500-009-0524-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-009-0524-z

Keywords

Search

Navigation