Skip to main content
SpringerLink
Log in

Face Image Retrieval Using Discriminative Ternary Census Transform and Spatial Pyramid Matching

  • Conference paper
  • First Online:
Computational Intelligence, Communications, and Business Analytics (CICBA 2018)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1031))

Abstract

Face image retrieval is a process to efficiently select one or more faces from face databases which are similar to the query face image. This study proposes a new face image retrieval method where images are indexed using Discriminative Ternary Census Transform Histogram (DTCTH) which captures the discriminative structural properties of an image by avoiding unwanted background information. It encodes local micro structures of an image such as line, edge, corners etc. and uses a dynamic threshold during image transformation thus makes it more stable against intensity fluctuation. Global structure of the Discriminative Transformed image is captured using Spatial Pyramid representation during histogram index computation. The computed histogram index is used as face image descriptor. The computed histogram index along with the face image is stored in the database. In this way face image database is built. In the retrieval phase, when a query image is given, the histogram index is computed using the same process and then distance between the feature vectors of query images and feature vectors of the database images are computed. Images with less distance are registered as output. The proposed solutions are experimentally evaluated on the standard constrained FRAV2D, JAFFE and FERET face image databases. Experimental result shows that the face retrieval method is very effective on databases containing face images with facial expression and intensity variations.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Sedmidubsky, J., Mic, V., Zezula, P.: Face image retrieval revisited. In: Amato, G., Connor, R., Falchi, F., Gennaro, C. (eds.) SISAP 2015. LNCS, vol. 9371, pp. 204–216. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25087-8_19

    Chapter  Google Scholar 

  2. Smith, B.M., Zhu, S., Zhang, L.: Face image retrieval by shape manipulation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), pp. 769–776, June 2011

    Google Scholar 

  3. Chen, B.C., Chen, Y.Y., Kuo, Y.H., Hsu, W.H.: Scalable face image retrieval using attribute-enhanced sparse codewords. IEEE Trans. Multimedia 15(5), 1163–1173 (2013)

    Article  Google Scholar 

  4. Wu, Z., Ke, Q., Sun, J., Shum, H.Y.: Scalable face image retrieval with identity-based quantization and multireference re-ranking. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2010), pp. 3469–3476 (2010)

    Google Scholar 

  5. Chen, B.C., Kuo, Y.H., Chen, Y.Y., Chu, K.Y. Hsu, W.: Semisupervised face image retrieval using sparse coding with identity constraint. In: Proceedings of 19th ACM International Conference on Multimedia, pp. 1369–1372 (2011)

    Google Scholar 

  6. Douze, M., Ramisa, A., Schmid, C.: Combining attributes and fisher vectors for efficient image retrieval. In: IEEE Conference on Computer Vision and Pattern Recognition (2011)

    Google Scholar 

  7. Kumar, N., Berg, A., Belhumeur, P.N., Nayar, S.: Describable visual attributes for face verification and image search. IEEE Trans. Pattern Anal. Mach. Intell. 33(10), 1962–1977 (2011)

    Article  Google Scholar 

  8. Siddiquie, B., Feris, R.S., Davis, L.S.: Image ranking and retrieval based on multi-attribute queries. In: IEEE Conference on Computer Vision and Pattern Recognition (2011)

    Google Scholar 

  9. Halder, S., Hasnat, A., Bhattacharjee, D., Nasipuri M.: A novel approach for searching of a color facial image based on the similarity of complexion. In: 3rd International Conference on Computational Intelligence and Information Technology, CIIT 2013, India (2013). https://doi.org/10.1049/cp.2013.2581

  10. Ewald, M.: Content-based image indexing and retrieval in an image database for technical domains. Trans. MLDM 2(1), 3–22 (2009). ISSN 1865-6781

    Google Scholar 

  11. Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: CVPR 2006 (2006)

    Google Scholar 

  12. Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object retrieval with large vocabularies and fast spatial matching. In: CVPR (2007)

    Google Scholar 

  13. Roy, H., Bhattacharjee, D.: Local-gravity-face (LG-face) for illumination-invariant and heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 11(7), 1412–1423 (2016)

    Article  Google Scholar 

  14. Rahman, M., Rahman, S., Rahman, R., Hossain, B.M.M., Shoyaib, M.: DTCTH: a discriminative local pattern descriptor for image classification. EURASIP J. Image Video Process. 2017(1), 30 (2017)

    Article  Google Scholar 

  15. Wu, J., Rehg, J.M.: CENTRIST a visual descriptor for scene. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1489–1501 (2011)

    Article  Google Scholar 

  16. Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2006). https://doi.org/10.1109/cvpr.2006.68

  17. Shahiduzzaman, M., Zhang, D., Lu, G.: Improved spatial pyramid matching for image classification. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010. LNCS, vol. 6495, pp. 449–459. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-19282-1_36

    Chapter  Google Scholar 

  18. Yang, J., Yu, K., Gong, Y.: Linear spatial pyramid matching using sparse coding for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, USA (2009). https://doi.org/10.1109/cvpr.2009.5206757

  19. Chen, C., Dantcheva, A., Ross, A.: An ensemble of patch-based subspaces for makeup-robust face recognition. Inf. Fusion 32, 80–92 (2016)

    Article  Google Scholar 

  20. Girish, G.N., Naika, C.L.S., Das, P.K.: Face recognition using MB-LBP and PCA: a comparative study. In: International Conference on Computer Communication and Informatics (ICCCI 2014), India (2014). https://doi.org/10.1109/iccci.2014.6921773

  21. Neeru, N., Kaur, L.: Face recognition based on LBP and CS-LBP technique under different emotions. In: IEEE International Conference on Computational Intelligence and Computing Research (2015). https://doi.org/10.1109/iccic.2015.7435803

  22. Meena, K., Suruliandi, A.: Local binary patterns and its variants for face recognition. In: IEEE-International Conference on Recent Trends in Information Technology, pp. 782–786 (2011)

    Google Scholar 

  23. Shan, C., Gong, S., McOwan, P.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27, 803–816 (2009)

    Article  Google Scholar 

  24. Huang, D., Shan, C., Ardabilian, M., Wang, Y., Chen, L.: Local binary patterns and its application to facial image analysis: a survey. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 41(6), 765–781 (2011)

    Google Scholar 

  25. FRAV2D Database (2004). http://www.frav.es/databases/frav2d/

  26. Lyons, M.J., Akemastu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: 3rd IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205 (1998)

    Google Scholar 

  27. Phillips, P.J., Wechsler, H., Huang, J., Rauss, P.: The FERET database and evaluation procedure for face recognition algorithms. Image Vis. Comput. J. 16(5), 295–306 (1998)

    Article  Google Scholar 

  28. Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET evaluation methodology for face recognition algorithms. IEEE Trans. Pattern Anal. Mac. Intell. 22, 1090–1104 (2000)

    Article  Google Scholar 

  29. Pinto, N., Stone, Z., Zickler, T., Cox, D.D.: Scaling up biologically-inspired computer vision: a case study in unconstrained face recognition on Facebook. In: Proceedings of Workshop on Biologically Consistent Vision (in conjunction with CVPR) (2011)

    Google Scholar 

  30. Kumar, N., Berg, A.C., Belhumeur, P.N., Nayar, S.K.: Attribute and simile classifiers for face verification. In: International Conference on Computer Vision (ICCV) (2009)

    Google Scholar 

  31. Suchitra, S.: Face image retrieval of efficient sparse code words and multiple attribute in binning image. Braz. Arch. Biol. Technol. 60, 1–15 (2017). https://doi.org/10.1590/1678-4324-2017160480

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Government College of Engineering and Textile Technology, Berhampore, West Bengal, India

    Abul Hasnat

  2. Government College of Engineering and Leather Technology, Kolkata, India

    Santanu Halder

  3. Jadavpur University, Kolkata, West Bengal, India

    Debotosh Bhattacharjee & Mita Nasipuri

Authors
  1. Abul Hasnat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Santanu Halder
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Debotosh Bhattacharjee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mita Nasipuri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abul Hasnat .

Editor information

Editors and Affiliations

  1. Department of Computer Science and Engineering, University of Kalyani, Kalyani, West Bengal, India

    Jyotsna Kumar Mandal

  2. Department of Computer Science and Engineering, Assam University, Silchar, Assam, India

    Somnath Mukhopadhyay

  3. Department of Computer and Systems Sciences, Visva Bharati University, Santiniketan, West Bengal, India

    Paramartha Dutta

  4. Department of Computer Science and Engineering, Kalyani Government Engineering College, Kalyani, West Bengal, India

    Kousik Dasgupta

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hasnat, A., Halder, S., Bhattacharjee, D., Nasipuri, M. (2019). Face Image Retrieval Using Discriminative Ternary Census Transform and Spatial Pyramid Matching. In: Mandal, J., Mukhopadhyay, S., Dutta, P., Dasgupta, K. (eds) Computational Intelligence, Communications, and Business Analytics. CICBA 2018. Communications in Computer and Information Science, vol 1031. Springer, Singapore. https://doi.org/10.1007/978-981-13-8581-0_26

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-8581-0_26

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-8580-3

  • Online ISBN: 978-981-13-8581-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation