Abstract
In this paper, we propose a novel color image retrieval approach by using an effective fusion of two types of histograms extracted from color and local directional pattern (LDP), respectively. First, we describe the extraction process of color histogram and LDP. Secondly we present these two features and then develop an effective fusion procedure including feature normalization and a new similarity metric. Thirdly, this new approach is validated after extensive comparisons with several existing state of the art approaches on two benchmark datasets including the Wang’s dataset and large size of the Corel-10000 dataset. Finally, a friendly interface for this proposed retrieval system is designed and used to show some retrieval results.
Similar content being viewed by others
References
Liu Y, Zhang D, Guojun L, Ma WY (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recogn 40:262–282
Rui Y, Huang TS (1999) Image retrieval: current techniques, promising directions, and open issues. J Vis Commun Image Repres 10(4):39–62
Sethi IK, Coman IL, Stan D (2001) Mining association rules between low-level image features and high-level concepts. In: Proceedings of the SPIE 4384, data mining and knowledge discovery: theory, tools, and technology III, vol 279, pp 279–290
Surya SR, Sasikala G (2011) Survey on content based image retrieval. Indian J Comput Sci Eng (IJCSE) 2(5):691–696
Singhai N, Shandilya SK (2010) A survey on: content based image retrieval systems. Int J Comput Appl 4(2):22–26
Chang SK, Liu SH (1984) Picture indexing and abstraction techniques for pictorial databases. IEEE Trans Pattern Anal Mach Intell 6(4):475–483
Faloutsos C, Barber R, Flickner M, Hafner J, Niblack W, Petkovic D, Equitz W (1994) Efficient and effective querying by image content. J Intell Inf Syst 3(3–4):231–262
Pentland A, Picard RW, Scaroff S (1996) Photobook: content-based manipulation for image databases. Int J Comput Vis 18(3):233–254
Gupta A, Jain R (1997) Visual information retrieval. Commun ACM 40(5):70–79
Smith JR, Chang SF (1996) VisualSeek: a fully automatic content based query system. In: Proceedings of the fourth ACM international conference on multimedia, pp 87–98
Ma WY, Manjunath B (1997) Netra: a toolbox for navigating large image databases. In: Proceedings of the IEEE international conference on image processing, pp 568–571
Laaksonen J, Koskela M, Laakso S, Oja E (2000) PicSOM-content-based image retrieval with self-organizing maps. Pattern Recogn Lett 21:1199–1207
Wang JZ, Li J, Wiederhold G (2001) SIMPLIcity: semantics-sensitive integrated matching for picture libraries. IEEE Trans Pattern Anal Mach Intell 23(9):947–963
Iqbal Q, Aggarwal JK (2002) CIRES: a system for content-based retrieval in digital image libraries. In: Proceedings of the international conference on control, automation, robotics and vision (ICARCV), pp 205–210
Deselaers T, Keysers D, Ney H (2004) FIRE—flexible image retrieval engine: ImageCLEFEvaluation. LNCS 3491(2004):688–698
Lux M (2011) Content based image retrieval with LIRE. In: Proceedings of the 19th ACM international conference on multimedia, Scottsdale, pp 735–738
Lux M, Marques O (2013) Visual information retrieval using java and LIRE. Syn Lect Inf Concep Retriev Serv 5(12):1–112
Mojsilovic A, Rogowitz B (2001) Capturing image semantics with low-level descriptors. In: Proceedings of the ICIP, pp 18–21
Smeulders AWM, Worring M, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380
Tong S, Chang E (2001) Support vector machine active learning for image retrieval. In: Proceedings of the ACM international conference on multimedia, Ottawa, pp 107–118
Zhang L, Liu F, Zhang B (2001) Support vector machine learning for image retrieval. In: International conference on image processing, pp 721–724
Eamani RR, Hari Prasad GV (2012) Content-based image retrieval using support vector machine in digital image processing techniques. Int J Eng Sci Technol (IJEST) 4(4):1512–1519
Guo G-D, Jain AK, Ma W-Y, Zhang H-J (2002) Learning similarity measure for natural image retrieval with relevance feedback. IEEE Trans Neural Netw 13(4):811–820
Zhu XS, Huang TS (2003) Relevance feedback in image retrieval: a comprehensive review. Multimed Syst 8(6):536–544
Jing F et al (2004) Relevance feedback in region-based image retrieval. IEEE Trans CSVT 14(5):672–681
Patil PB, Kokare MB (2011) Relevance feedback in content based image retrieval: a review. J Appl Comput Sci Math 10(5):41–47
Singha M, Hemachandran K (2012) Content based image retrieval using color and texture, signal & image processing. Int J (SIPIJ) 3(1):39–57
Virk IS, Maini R (2011) Content based image retrieval: tools and techniques (229–6913). Int J Eng Sci 5(2011):21–35
Ramanathan V, Li C, Deng J, Han W (2015) Learning semantic relationships for better action retrieval in images. IEEE 978-1-4673-6964-0/15(2015):1100–1109
Jabid T, Kabir MH, Chae OS (2010) Gender classification using local directional pattern (LDP). In: Pattern Recognition, pp 2162–2165
Swain M, Ballard D (1991) Color indexing. Int J Comput Vis 7(1):11–32
Stricker M, Orengo M (2005) Similarity of color image, storage and retrieval for image and video databases III. Proc SPIE 2420:381–392
Haralick RM, Shanmugam K, Dinstein I (1973) Texture features for image classification. IEEE Trans Syst Man Cybern SMC 3(6):610–621
Tamura H, Mori S, Yamawaki T (1978) Texture features corresponding to visual perception. IEEE Trans Syst Man Cybern SMC 8(6):460–473
Chang T, Kuo CCJ (1993) Texture analysis and classification with three-structured wavelet transform. IEEE Trans Image Proc 2(4):429–441
Zhang D, Wong A, Indrawan M, Lu G (2000) Content-based image retrieval using Gabor texture features. In: Proceedings of the pacific-rim conference on multimedia, Sydney, pp 392–395
Zhu Zexuan, Jia Sen, He Shan, Sun Yiwen, Ji Zhen, Shen Linlin (2015) Three-dimensional Gabor feature extraction for hyperspectral imagery classification using a memetic framework. Inf Sci 298:274–287
Zhang D, Islam MM, Lu G (2012) Rotation invariant curvelet features for region based image retrieval. Int J Comput Vis 98(2012):187–201
Vadivel A, Sural S, Majumdar AK (2007) An integrated color and intensity co-occurrence matrix. Pattern Recognit Lett 28:974–983
Gail N, Venkateshwar Rao B, Subhani Shaik A (2012) Color and texture features for image indexing and retrieval. Int J Electron Commun Comput Eng 3(1):10–14
Singha M, Henmachandran K (2012) Content based image retrieval using color and texture, signal & image processing. Int J (SIPIJ) 3(1):39–57
Kavitha Ch, Prabhakara Rao B, Govardhan A (2011) Image retrieval based on color and texture features of the image sub-blocks. Int J Comput Appl 15(7):33–37
Prakash KN, Satya Prasad K (2012) HSV color motif co-occurrence matrix for content based image retrieval. Int J Comput Appl 48(16):8–14
Lin Chuen-Horng, Chen Rong-Tai, Chan Yung-Kuan (2009) A smart content-based image retrieval system based on color and texture feature. Image Vis Comput 27(6):658–665
Babu Rao M, Prabhakara Rao B, Govardhan A (2011) CTDCIRS: content based image retrieval system based on dominant color and texture features. Int J Comput Appl 18(6):40–46
Babu Rao M, Prabhakara Rao B, Govardhan A (2011) Content based image retrieval using dominant color, texture and shape. Int J Eng Sci Technol 3(4):2887–2896
Guo JM, Prasetyo H (2015) Content-based image retrieval using features extracted from Halftoning-based block truncation coding. IEEE Trans Image Process 24(3):1010–1024
Huang PW, Dai SK (2003) Image retrieval by texture similarity. Pattern Recogn 36(3):665–679
Jhanwar N, Chaudhuri S, Seetharaman G, Zavidovique B (2004) Content-based image retrieval using motif co-occurrence matrix. Image Vis Comput 22(12):11–20
Kavitha Ch, Babu Rao M, Prabhakara Rao B, Govardhan A (2011) Image retrieval based on local histogram and texture features. Int J Comput Sci Inf Technol 2(2):741–746
Vimina ER, Poulose Jacob K (2013) A sub-block based image retrieval using modified integrated region matching. Int J Comput Sci Issues 10(1):686–692
Subrahmanyam M, Jonathan Wu QM, Maheshwari RP, Balasubramanian R (2013) Modified color motif co-occurrence matrix for image indexing and retrieval. Comput Electr Eng 39:762–774
ElAlami ME (2011) A novel image retrieval model based on the most relevant features. Knowl-Based Syst 24:23–32
Liu GH, Zhang L, Hou YK, Li ZY, Yang JY (2010) Image retrieval based on multi-texton histogram. Pattern Recognit 43(2010):2380–2389
Liu GH, Li ZY, Zhang L, Yong X (2011) Image retrieval based on micro-structure descriptor. Pattern Recognit 44:2123–2133
Liu GH, Yang JY (2013) Content-based image retrieval using color difference histogram. Pattern Recognit 46:188–198
Jabid T, Kabir H, Chae OS (2010) Local directional pattern (LDP)—a robust image descriptor for object recognition. In: IEEE international conference on AVSS, pp 482–487
Zhou J, Xu T, Gao W (2014) Content based image retrieval using local directional pattern and color histogram, optimization and control techniques and applications. Spr Proc Math Stat 86(2014):197–211
Khandave V, Mishra N (2014) Content based image retrieval using color and texture features. Int J Rec Dev Eng Technol 2(1). http://www.ijrdet.com
Youssef SM (2012) ICTEDCT-CBIR: integrating curvelet transform with enhanced dominant colors extraction and texture analysis for efficient content-based image retrieval. Comput Electr Eng 38(2012):1358–1376
Jabid T, Kabirand MH, Chae OS (2010) Local directional pattern (LDP) for face recognition. In: IEEE international conference on consumer electronics, pp 329–330
Corel-1000 and Corel-10000 image database (Online). http://www.wang.ist.psu.edu/docs/related/
Han Y, Xu C, Baciu G, Li M (2015) Lightness biased cartoon-and-texture decomposition for textile image segmentation. Neurocomputing 168(2015):575–587
Yuwu Lu, Lai Zhihui, Fan Zizhu, Cui Jinrong, Zhu Qi (2015) Manifold discriminant regression learning for image classification. Neurocomputing 166:475–486
Acknowledgments
We thank the anonymous reviewers for their valuable comments and constructive recommendations for improving the quality of this manuscript. This work is supported by Natural Science Foundation of China with Nos. 61462097 and 61262071, and Application Infrastructure Projects of Science and Technology Plan in Yunnan Province with No. 2014FD016, and Key Project of Applied Basic Research Program of Yunnan Province with No. 2016FA024.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, Jx., Liu, Xd., Xu, Tw. et al. A new fusion approach for content based image retrieval with color histogram and local directional pattern. Int. J. Mach. Learn. & Cyber. 9, 677–689 (2018). https://doi.org/10.1007/s13042-016-0597-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-016-0597-9