Skip to main content
SpringerLink
Log in

Dynamic multi-attribute priority based face attribute detection for robust face image retrieval system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The increase in the popularity of social websites and smartphones has helped people to easily click photos and upload them on the internet. Almost 60% of the photos are human faces. There might be an increase in face search in future because human faces are closely associated with social media where people show special interest on specific personalities. The main issue raised in the face retrieval system is the various intra-class variances like expression, pose and illumination. Most of the conventional approaches lack the accuracy to meet the human intuition for retrieving images. The proposed approach develops a Dynamic Multi-Attribute Priority-based Face Attribute Detection (DMAP-FAD) method based on contextual information of the face (Race and Gender) by detecting the attributes dynamically. This approach can provide better discrimination of the face image retrieval system by detecting the attributes dynamically. The digital binning technique is applied for improving the lighting differences for illumination. The proposed method effectively minimized the semantic gap and achieved high accuracy by focusing on the variations involved in the pose, illumination, and expression with dynamically detected an optimal set of attributes from the original set of attributes by using contextual relationship. In the experimental results, the proposed method has been tested efficiently by the metrics such as F-Score, Precision and Recall with help of Pubfig and LFW datasets and it is observed that the proposed method obtained an overall accuracy of 95.63% for higher discrimination of face image retrieval system. The results are comparable with those of the state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Cao Z, Yin Q, Sun J, Tang X (2010) Face recognition with learningbased descriptor, in Proc. IEEE Conf. Computer Vision and Pattern Recognit

  2. Chakraborty S, Singh SK, Chakraborty P (2018) Local Gradient Hexa Pattern: A Descriptor for Face Recognition and Retrieval”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 28, No. 1

  3. Chen B-C,Kuo Y-H, Chen Y-Y, Chu K-Y, Hsu W (2011) Semi-supervised face image retrieval using sparse coding with identity constraint, in Proc. ACM Multimedia

  4. Chen B-C, Chen Y-Y, Kuo Y-H, Hsu WH (August 2013) Scalable face image retrieval using attribute-enhanced sparse Codewords. IEEE Transactions on Multimedia 15(5):1163–1173

    Article  Google Scholar 

  5. Chitrakar R, Chuanhe H (2012) Anomaly based intrusion detection using hybrid learning approach of combining k-Medoids clustering and Naïve Bayes classification, the 8th InternationalConference on wireless communication, Networking and Moblie Computing, Shanghai, China

  6. Chum O, Philbin J, Sivic J, Isard M, Zisserman A (2007) Total recall: Automatic query expansion with a generative feature model for object retrieval,” in Proc. IEEE Int. Conf. Computer Vision

  7. Dubey SR (2019) Local directional relation pattern for unconstrained and robust face retrieval”, Multimedia Tools and Applications, https://doi.org/10.1007/s11042-019-07908-3

  8. Fang Y and Yuan Q (2018) Attribute-enhanced metric learning for face retrieval, EURASIP Journal on Image and Video Processing, https://doi.org/10.1186/s13640-018-0282-x

  9. Gionis A, Indyk P, Motwani R (1999) Similarity search in high dimensions via hashing, in Proc. VLDB

  10. Greco S, Matarazzo B, Slowinski R, Tsoukias A (1998) Exploitation of a rough approximation of the outranking relation in multicriteria choice and ranking”, In T.J. Stewart and R.C. van den Honert, editors, Trends in Multicriteria Decision Making, Springer-Verlag, Berlin, pp. 45–60

  11. Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, Univ. Massachusetts, Amherst, MA, USA, Tech. Rep. 07–49

  12. Kumar N, Berg AC, Belhumeur PN, Nayar SK (2009) Attribute and simile classifiers for face verification,” in Proc. Int. Conf. Computer Vision

  13. Kumar N, Berg AC, Belhumeur PN, Nayar SK (Oct. 2011) Describable visual attributes for face verification and image search. IEEE TransPattern Anal Mach Intell, Special Issue on Real-World Face Recognition 33(10):1962–1977

    Article  Google Scholar 

  14. Kuo Y-H, Lin H-T, Cheng W-H, Yang Y-H, Hsu WH (2011) Unsupervised auxiliary visual words discovery for large-scale image object retrieval, in Proc. IEEE Conf. Computer Vision and Pattern Recognit

  15. Laskey K, Alghamdi G, Wang X, Barbara D, Shackelford T, Right EW, Fitzgerald J (2004) Detecting threatening behavior using Bayesian networks, In Proc. of the Conference on Behavioral Representation in Modeling and Simulation

  16. Lowe D (2003) Distinctive image features from scale-invariant keypoints, Int J Comput Vis

  17. Milborrow S, Nicolls F (2008) Locating facial features with an extended active shape model, in Proc. Eur. Conf. Computer Vision

  18. Parikh D, Grauman K (2011) Relative attributes,” in Proc. IEEE Int. Conf. Computer Vision

  19. Park U, Jain AK (Sep 2010) Face matching and retrieval using soft biometrics. IEEE Trans Inf Forensics Security 5(3):406–415

    Article  Google Scholar 

  20. Scheirer W, Kumar N, Ricanek K, Boult TE, Belhumeur PN (2011) Fusing with context: A Bayesian approach to combining descriptive attributes, in Proc. Int. Joint Conf. Biometrics

  21. Scheirer W, Kumar N, Belhumeur P, Boult T (2012) Multi-attribute spaces: Calibration for attribute fusion and similarity search, in Proc. IEEE Conf. Computer Vision and Pattern Recognit

  22. Siddiquie B, Feris RS, Davis LS (2011) Image ranking and retrieval based onmulti-attribute queries, in Proc. IEEE Conf. Computer Vision and Pattern Recognit

  23. Suchitra S and Chitrakala S (2013) A survey on scalable image indexing and searching, 4th IEEE ICCCNT 2013, July 4–6

  24. Suchitra S, Chitrakala S (2017) Face image retrieval of efficient sparse code words and multiple attribute in binning image”, International Journal of Brazilian Archives of Biology and Technology, Vol.60: e17160480, January-December

  25. Suchitra S, Chitrakala S, Nithya J (2014) A robust face recognition using automatically detected facial attributes,” 2014 Int. Conf Sci Eng Manag Res ICSEMR 2014

  26. Suchitra S, Chitrakala S, Sivaranjani R (2015) An enhanced face image retrieval using relevance feedback, International Journal of Applied Engineering Research ISSN 0973-4562 Volume 10, Number 17

  27. Vaquero DA, Feris RS, Tran D, Brown L, Hampapur A, Turk M (2009) Attribute-based people search in surveillance environments, WACV

  28. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features, in Proc. IEEE Conf. Computer Vision and Pattern Recognit

  29. Wang D, Hoi SC, He Y, Zhu J (2011) Retrieval-based face annotation by weak label regularized local coordinate coding, in Proc. ACM, Multimedia

  30. Wright E, Mahoney S, Laskey K, Takikawa M, Levitt T (2002) Multi-entity Bayesian networks for situation assessment”, In Proc. of the 5th international conference on information fusion

  31. Wu Z, Ke Q, Sun J, Shum H-Y (2010) Scalable face image retrieval with identity-based quantization and multi-reference re-ranking, in Proc. IEEE Conf. Computer Vision and Pattern Recognit

  32. Wu L, Hoi SCH, Yu N (Jul. 2010) Semantics-preserving bag-of-words models and applications. IEEE Trans Image Process 19(7):1908–1920

    Article  MathSciNet  Google Scholar 

  33. Yoonjong Yoo, Jaehyun Im, Joonki Paik,” Low-Light Image Enhancement Using Adaptive Digital Pixel Binning, 2015.

  34. Zobel J, Moffat A (2006) Inverted files for text search engines, ACM Comput. Surveys

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Hindustan Institute of Technology and Science, Chennai, India

    S. Suchitra

  2. Department of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India

    R. J. Poovaraghan

Authors
  1. S. Suchitra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. R. J. Poovaraghan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Suchitra.

Ethics declarations

Conflict of interest

Suchitra S and Poovaraghan R J have no conflict of interest in their research work.

Ethical approval

(i) This article does not contain any studies with animals performed by any of the authors.

(ii) The datasets of Pubfig and LFW human faces are involved, but not involved the humans directly.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Suchitra, S., Poovaraghan, R.J. Dynamic multi-attribute priority based face attribute detection for robust face image retrieval system. Multimed Tools Appl 79, 24825–24849 (2020). https://doi.org/10.1007/s11042-020-09219-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09219-4

Keywords

Search

Navigation