Abstract
As the quantity of digital images grows in many applications in our daily life, users experience an increased difficulty in finding relevant images within their image collections and common image repositories. This paper proposes a novel image search scheme that extracts the features of an image using a combined invariant features and color description to retrieve specific images using query-by-example. The proposed method can be executed in real-time on an iPhone, and can be easily used to identify a natural color image with its invariant visual features. The proposed scheme is evaluated by assessing the performance of a simulation in terms of the average precision and F-score in image databases that are commonly used for image retrieval. The experimental results reveal that the proposed algorithm offers a significant improvement of more than 7.35 and 18.09% in retrieval effectiveness when compared to open source OpenSURF and MPEG-7 color and texture descriptor, respectively. The main contribution of this paper is that the proposed approach achieves a high accuracy and stability by using a combination of the improved SURF and color descriptor when searching for a natural image.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baeza-Yates R, Ribeiro-Neto B (2011) Modern information retrieval: the concepts and technology behind search, 2nd edn. ACM Press Books. (ISBN 978-0321416919)
Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded up robust features (SURF). Comput Vis Image Underst 110(3):346–359. https://doi.org/10.1016/j.cviu.2007.09.014
Chaudhari A, Bhagat PKS (2014) An overview of content based image categorization using support vector machine. Int J Innov Sci Eng Technol 1(10):371–378
Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):1–60. https://doi.org/10.1145/1348246.1348248
Evans C (2009) Notes on the OpenSURF library. Technical report on Open SURF computer vision library, pp 1–25. https://doi.org/10.1.1.152.8095. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.152.8095. Accessed 21 May 2018
Girija OK, Sudeep Elayidom M (2016) Recent trends in image retrieval techniques for the big data platform: a survey. Int J Adv Res Comput Commun Eng 5(1):71–74. https://doi.org/10.17148/IJARCCE
ISO, International Organization for Standards (2005) ISO/IEC 24800-1: working draft—system framework and components, ISO/IEC JTC1 SC29 WG1N3684
Juan L, Gwun O (2009) A comparison of SIFT, PCA-SIFT and SURF. Int J Image Process 3(4):143–152
Kakade VM, Keche IA (2017) Review on content based image retrieval (CBIR) technique. Int J Eng Comput Sci 6(3):20414–20415. https://doi.org/10.18535/ijecs/v6i3.02
Kalantidis Y, Tolias G, Spyrou E, Mylonas P, Avrithis Y, Kollias S (2011) ViRaL: visual image retrieval and location. Multimed Tools Appl 51(2):555–592. https://doi.org/10.1007/s11042-010-0651-7
Kim SM, Park SJ, Won CS (2007) Image retrieval via query-by-layout using MPEG-7 visual descriptors. ETRI J 29(2):246–248. https://doi.org/10.4218/etrij.07.0206.0177
Kumar A, Batra S (2011) Image retrieval using SURF features and annotated data. Int J Adv Res Comput Sci 2(3):121–124. https://doi.org/10.26483/ijarcs.v2i3.497
Lakdashti A, Kialashaki N, Ghonoodi A, Soltani M (2005) Composition of MPEG7 color and edge descriptors based on human vision perception. Proc Int Soc Opt Eng. https://doi.org/10.1117/12.631571
Lew MS, Sebe N, Djeraba C, Jain R (2006) Content-based multimedia information retrieval: state of the art and challenges. ACM Trans Multimed Comput Commun Appl 2(1):1–19. https://doi.org/10.1145/1126004.1126005
Li J, Wang JZ (2003) Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans Pattern Anal Mach Intell 25(9):1075–1088. https://doi.org/10.1109/TPAMI.2003.1227984
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
Manjunath BS, Ohm J-R, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Trans Circuits Syst Video Technol 11(6):703–715. https://doi.org/10.1109/76.927424
Meenakshi RP, Kumar A (2015) Approaches and trends in content based image retrieval. Int J Emerg Trends Sci Technol 2(7):2815–2824
Mohamed AA, Makori CA, Kamau J (2016) A literature survey of image descriptors in content based image retrieval. Int J Sci Eng Res 7(3):919–929
Mustikasari M, Madenda S (2015) Texture based image retrieval using GLCM and image sub-block. Int J Adv Res Comput Sci Softw Eng 5(3):9–13
Oliva A, Torralba A (2001) Modeling the shape of the scene: a holistic representation of the spatial envelope. Int J Comput Vis 42(3):145–175. https://doi.org/10.1023/A:1011139631724
Ranjani JJ, Babu M (2016) Image retrieval using generalized Gaussian distribution and score based support vector machine. Indian J Sci Technol 9(48):1–10. https://doi.org/10.17485/ijst/2016/v9i48/108026
Sclaroff S, La Cascia M, Sethi S, Taycher L (1999) Unifying textual and visual cues for content-based image retrieval on the world wide web. Comput Vis Image Underst 75(1):86–98. https://doi.org/10.1006/cviu.1999.0765
Sharma S, Siddiqui AM (2014) Image retrieval using speeded up robust feature: an effort to improvement. Int J Comput Sci Netw Secur 14(11):102–107
Shereena VB, Julie MD (2014) Content based image retrieval: classification using neural networks. Int J Multimed Appl 6(5):31–44
Shin I-K, Ahn H, Lee Y-H (2016) Efficient image retrieval using image and audio features in video stream. International conference on innovative mobile and internet services in ubiquitous computing, pp 422–424. https://doi.org/10.1109/IMIS.2016.148
Silpa-Anan C, Hartley R (2008) Optimised KD-trees for fast image descriptor matching. IEEE conference on computer vision and pattern recognition, USA. https://doi.org/10.1109/CVPR.2008.4587638
Singh S, Rajput R (2015) Content based image retrieval using SVM, NN and KNN classification. Int J Adv Res Comput Commun Eng 4(6):549–552
Tao D, Tang X, Li X, Wu X (2006) Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans Pattern Anal Mach Intell 28(7):1088–1099. https://doi.org/10.1109/TPAMI.2006.134
Thomas S (2001) MPEG-7 visual standard for content description—an overview. IEEE Trans Circuits Syst Video Technol 11(6):696–702. https://doi.org/10.1109/76.927422
Thomee B, Bakker EM, Lew MS (2010) TOP-SURF: a visual words toolkit. In: Proceedings of the 18th ACM international conference on multimedia, The Netherlands. pp 1473–1476. https://doi.org/10.1145/1873951.1874250
Tieu K, Viola P (2004) Boosting image retrieval. Int J Comput Vision 56(1):17–36. https://doi.org/10.1023/B:VISI.0000004830.93820.78
Ting S, Guohua G (2016) Image retrieval method for deep neural network. Int J Signal Process Image Process Pattern Recognit 9(7):33–42. https://doi.org/10.14257/ijsip.2016.9.7.04
Velmurugan K, Baboo S (2011) Content-based image retrieval using SURF and colour moments. Glob J Comput Sci Technol 11(10):1–4
Wan J, Wang D, Hoi SCH, Wu P, Zhu J, Zhang Y, Li J (2014) Deep learning for content-based image retrieval: a comprehensive study. International conference on multimedia, New York. pp 157–166. https://doi.org/10.1145/2647868.2654948
Wong YM (2007) Design, implementation, and evaluation of scalable content-based image retrieval techniques. Master thesis, Chinese University of Hong Kong, Hong Kong
Xie L, Hong R, Zhang B Tian Q (2015) Image classification and retrieval are one. International conference on multimedia retrieval, pp 3–10. https://doi.org/10.1145/2671188.2749289
Zhou M, Zhou C, Wen C (2016) Real-time monitoring of batch processes using the fast k-nearest neighbor rule. Chinese Control Conference, China. https://doi.org/10.1109/ChiCC.2016.7554434
Acknowledgements
The present research was conducted by the research fund of Dankook University in 2015.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lee, YH., Bang, SI. Improved image retrieval and classification with combined invariant features and color descriptor. J Ambient Intell Human Comput 10, 2255–2264 (2019). https://doi.org/10.1007/s12652-018-0817-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-018-0817-0