Skip to main content

Advertisement

SpringerLink
Log in

Toward semantic content-based image retrieval using Dempster–Shafer theory in multi-label classification framework

  • Regular Paper
  • Published:
International Journal of Multimedia Information Retrieval Aims and scope Submit manuscript

Abstract

The gap between human semantic perception of an image and its abstraction by some low-level features is one of the main shortcomings of the actual content-based image retrieval (CBIR) systems. This paper presents an effort to overcome this drawback and proposes a CBIR approach in which retrieved images are more likely to satisfy the user expectations. Multi-label classification, in which an instance is assigned to different classes, provides a general framework to establish semantic correspondence between images in a database and a query image. Accordingly, in the framework of multi-label classification, a new feature fusion strategy is developed based on Dempster–Shafer evidence theory to allow handling lack of prior probabilities and uncertain information provided by low-level features. In this study, texture features are extracted through wavelet correlogram and color features are obtained using correlogram of vector quantized image colors. These features are subsequently fused via a possibility approach for being used in multi-label classification to retrieve images relevant to a query image. Experimental results on three well-known public and international image datasets demonstrate the superiority of the proposed algorithm over its close counterparts in terms of average precision and F1 measure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Parameshwari V, Kavitha S (2013) Retrieval of images based on texture and color features. Int J Innov Res Dev 2(3):51–69 ISSN 2278–0211

    Google Scholar 

  2. Singh N, Dubey SR, Dixit P, Gupta JP (2012) Semantic image retrieval by combining color, texture and shape features. In: computing sciences international conference on IEEE, pp. 116–120

  3. Yue J, Li Z, Liu L, Fu Z (2011) Content-based image retrieval using color and texture fused features. Math Comput Modell 54(3):1121–1127

    Article  Google Scholar 

  4. Wei Y, Xia W, Huang J, Ni B, Dong J, Zhao Y, Yan S (2014) CNN: single-label to multi-label. arXiv preprint arXiv:1406.5726

  5. Yu Y, Pedrycz W, Miao D (2014) Multi-label classification by exploiting label correlations. Exp Syst Appl 41(6):2989–3004

    Article  Google Scholar 

  6. Jin Y, Song P, Zheng W, Zhao L (2014) A feature selection and feature fusion combination method for speaker-independent speech emotion recognition. In: 2014 IEEE international conference on acoustics, speech and signal processing (ICASSP) IEEE, pp. 4808–4812

  7. Fontani M, Bianchi T, De Rosa A, Piva A, Barni M (2013) A framework for decision fusion in image forensics based on Dempster–Shafer theory of evidence. IEEE Trans Inform Forens Sec 8(4):593–607

    Article  Google Scholar 

  8. Mangai UG, Samanta S, Das S, Chowdhury PR (2010) A survey of decision fusion and feature fusion strategies for pattern classification. IETE Tech Rev 27(4):293–307

    Article  Google Scholar 

  9. Abdolahi M, Mohamadi M, Jafari M (2013) Multimodal biometric system fusion using fingerprint and iris with fuzzy logic. Int J Soft Comput Eng 2(6):504–510

    Google Scholar 

  10. Shafer G (1976) A mathematical theory of evidence. Princeton: Princeton university press vol. 1, pp. xiii+–297

  11. Dempster A P (1967) Upper and lower probabilities induced by a multivalued mapping. The Ann Math Stat, 325–339

  12. Moghaddam HA, Dehaji MN (2013) Enhanced Gabor wavelet correlogram feature for image indexing and retrieval. Pattern Anal Appl 16(2):163–177

    Article  MathSciNet  Google Scholar 

  13. Shad SM (2011) Color image indexing and retrieval using wavelet correlogram. MSc Thesis in Artificial Intelligence and Robotics, Faculty of Computer Engineering, K.N. Toosi University of Technology, Tehran, Iran

  14. Tsoumakas G, Katakis I, Vlahavas I (2011) Random k-labelsets for multilabel classification. IEEE Trans Knowl Data Eng 23(7):1079–1089

    Article  Google Scholar 

  15. Sucar LE, Bielza C, Morales EF, Hernandez-Leal P, Zaragoza JH, Larrañaga P (2014) Multi-label classification with Bayesian network-based chain classifiers. Pattern Recognit Lett 41:14–22

    Article  Google Scholar 

  16. Zhou ZH, Zhang ML, Huang SJ, Li YF (2012) Multi-instance multi-label learning. Artif Intell 176(1):2291–2320

    Article  MATH  MathSciNet  Google Scholar 

  17. Lin Z, Ding G, Hu M, Wang J (2014) Multi-label classification via feature-aware implicit label space encoding. In ICML, pp. 325–333

  18. Jiang JY, Tsai SC, Lee SJ (2012) FSKNN: multi-label text categorization based on fuzzy similarity and k nearest neighbors. Exp Syst Appl 39(3):2813–2821

    Article  Google Scholar 

  19. Snoek C G, Worring M, Van Gemert J C, Geusebroek J M, Smeulders A W (2006) The challenge problem for automated detection of 101 semantic concepts in multimedia. In: Proceedings of the 14th ACM international conference on multimedia ACM, pp. 421–430

  20. Vens C, Struyf J, Schietgat L, Džeroski S, Blockeel H (2008) Decision trees for hierarchical multi-label classification. Mach Learning 73(2):185–214

    Article  Google Scholar 

  21. Nithya S, ShineLet G (2012) Bio-Medical Image Retrieval Using SVM. Int J Adv Res Comput Eng Technol (IJARCET) 1(10):14–18

    Google Scholar 

  22. Mandal MK, Aboulnasr T, Panchanathan S (1998) Fast wavelet histogram techniques for image indexing. In: Proceedings content-based access of image and video libraries, 1998 IEEE, pp. 68–72

  23. Puviarasan N, Bhavani R, Vasanthi A (2014) Image retrieval using combination of texture and shape features. Image 3(3):39–62

    Google Scholar 

  24. Boutell MR, Luo J, Shen X, Brown CM (2004) Learning multi-label scene classification. Pattern Recognit 37(9):1757–1771

    Article  Google Scholar 

  25. Younes Z, Abdallah F, & Denœux T (2009) An evidence-theoretic k-nearest neighbor rule for multi-label classification. In: International conference on scalable uncertainty management Springer Berlin, Heidelberg, pp. 297–308

  26. Tsoumakas G, Katakis I (2006) Multi-label classification: an overview. Department of Informatics. Aristotle University of Thessaloniki, Greece

    Google Scholar 

  27. Yang Y (1999) An evaluation of statistical approaches to text categorization. Inf Retr 1(1–2):69–90

    Article  Google Scholar 

  28. Huang ZC, Chan PP, Ng WW, Yeung DS (2010) Content-based image retrieval using color moment and Gabor texture feature. In: IEEE 2010 international conference on machine learning and cybernetics vol. 2, pp. 719–724

  29. Singha M, Hemachandran K (2012) Content based image retrieval using color and texture. Signal Image Proc An Int J (SIPIJ) 3(1):39–57

    Article  Google Scholar 

  30. Lin CH, Chen RT, Chan YK (2009) A smart content-based image retrieval system based on color and texture feature. Image and Vision Comput 27(6):658–665

    Article  Google Scholar 

  31. Raghupathi G, Anand RS, Dewal ML (2010). Color and texture features for content based image retrieval. In: Second international conference on multimedia and content based image retrieval

  32. Pujari J, Hiremath P (2007) Content based image retrieval based on color texture and shape features using image and its complement. Int J Comput Sci Sec 1(4):25–35

    Google Scholar 

  33. Rao MB, Rao BP, Govardhan A (2011) CTDCIRS: content based image retrieval system based on dominant color and texture features. Int J Comput Appl 18(6):40–46

    Google Scholar 

  34. Li L, Feng L, Yu L, Wu J, Liu S (2016) Fusion framework for color image retrieval based on bag-of-words model and color local Haar binary patterns. J Electron Imaging 25(2):023022–023022

    Article  Google Scholar 

  35. Ali N, Mazhar DA, Iqbal Z, Ashraf R, Ahmed J, Khan FZ (2017) Content-based image retrieval based on late fusion of binary and local descriptors.  arXiv preprint arXiv:1703.08492

  36. Ali N, Bajwa KB, Sablatnig R, Chatzichristofis SA, Iqbal Z, Rashid M, Habib HA (2016) A novel image retrieval based on visual words integration of sift and surf. PloS one 11(6):e0157428

    Article  Google Scholar 

  37. Montazer GA, Giveki D (2015) An improved radial basis function neural network for object image retrieval. Neurocomputing 168:221–233

    Article  Google Scholar 

  38. Tian X, Jiao L, Liu X, Zhang X (2014) Feature integration of EODH and Color-SIFT: Application to image retrieval based on codebook. Signal Proc Image Commun 29(4):530–545

    Article  Google Scholar 

  39. Wu B, Lyu S, Ghanem B (2016) Constrained submodular minimization for missing labels and class imbalance in multi-label learning. In: AAAI, pp. 2229–2236

Download references

Author information

Authors and Affiliations

  1. Faculty of Electrical and Computer Engineering, K. N. Toosi, University of Technology, Tehran, Iran

    Hamid Abrishami Moghaddam

  2. Department of Computer Engineering, Science and Research Branch, Islamic Azad university, Tehran, Iran

    Hamid Abrishami Moghaddam & Samaneh Ghodratnama

Authors
  1. Hamid Abrishami Moghaddam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Samaneh Ghodratnama
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hamid Abrishami Moghaddam.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Abrishami Moghaddam, H., Ghodratnama, S. Toward semantic content-based image retrieval using Dempster–Shafer theory in multi-label classification framework. Int J Multimed Info Retr 6, 317–326 (2017). https://doi.org/10.1007/s13735-017-0134-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s13735-017-0134-y

Keywords

Search

Navigation