Abstract
Image saliency analysis plays an important role in various applications such as object detection, image compression, and image retrieval. Traditional methods for saliency detection ignore texture cues. In this paper, we propose a novel method that combines color and texture cues to robustly detect image saliency. Superpixel segmentation and the mean-shift algorithm are adopted to segment an original image into small regions. Then, based on the responses of a Gabor filter, color and texture features are extracted to produce color and texture sub-saliency maps. Finally, the color and texture sub-saliency maps are combined in a nonlinear manner to obtain the final saliency map for detecting salient objects in the image. Experimental results show that the proposed method outperforms other state-of-the-art algorithms for images with complex textures.
Similar content being viewed by others
References
Achanta R, Estrada F, Wils P, Susstrunk S (2008) Salient region detection and segmentation. In: International conference on computer vision systems (ICVS). Springer, pp 66–75
Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. Comput Vis Pattern Recognit:1597–1604
Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Susstrunk S (2012) SLIC Superpixels Compared to State-of-the-Art Superpixel Methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282
Arrospide J, Salgado L (2013) Log-Gabor filters for image-based vehicle verification. IEEE Trans Image Process:2286–2295
Cheng MM, Zhang GX, Mitra NJ, Huang X, Hu SM (2011) Global contrast based salient region detection. IEEE Conf Comput Vis Pattern Recognit (CVPR):409–416
Cheng MM, Niloy JM, Huang XL, Hu SM (2013) SalientShape: Group Saliency in Image Collections. Vis Comput:1–12
Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach 24(5):603–619
Dolu O, Gokmen M (2009) Ensembled gabor nearest neighbor classifier for face recognition. In: 24th International symposium on computer and information sciences, pp 99–104
Fang YM, Wang JL, Manish N, Patrick LC, Lin WS (2014) Saliency detection for stereoscopic images. IEEE Trans Image Process 23(6):2625–2636
Feichtinger HG (1994) Optimal iterative algorithms in Gabor analysis. In: Proceedings of the IEEE-SP International Symposium on Time-Frequency and Time-Scale Analysis, pp 44–47
Felzenszwalb P, Huttenlocher D (2004) Efficient graph-based image segmentation. International Journal of Computer Vision (IJCV) 59(2):167–181
Guo ZH, Lu GM (2010) Palmprint recognition using Gabor magnitude code. In: 2010 International conference on machine learning and cybernetics (ICMLC), pp 796–801
Guo CL, Zhang LM (2010) A novel multiresolution spatiotemporal saliency detection model and its applications in image and video compression. IEEE Trans Image Process:185–198
Goferman S, Zelnik-Manor L, Tal A (2010) Context-aware saliency detection. Comput Vis Pattern Recognit:2376–2383
Harel J, Koch C, Perona P (2007) Graph-based visual saliency. In: Proceedings of the 20 Conference Advances in Neural Information Processing Systems 19. MIT Press, pp 545–552
Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. IEEE Conf Comput Vis Pattern Recognit:1–8
Hou XD, Harel J, Koch C (2012) Image Signature: Highlighting Sparse Salient Regions. IEEE Transactions On Pattern Analysis An Intelligence 34(1):194–201
Itti L, Koch C (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259
Jiang B, Zhang LH, Lu HC, Yang C, Yang MH (2013) Saliency Detection via Absorbing Markov Chain. IEEE International Conference on Computer Vision (ICCV), pp 1665-1672
Jing XY, Chang H, Li S, Yao YF, Liu Q, Bian LS, Man JY, Wang C (2009) Face recognition based on a Gabor-2DFisherface approach with selecting 2D Gabor principal components and discriminant vectors. In: 3rd International conference on genetic and evolutionary computing, pp 565–568
Li J, Levine MD, An Xj, Xu X, He HG (2013) Visual saliency based on scale-space analysis in the frequency domain. IEEE Trans Pattern Anal Mach Intell 35(4):996–1010
Liu Z, Zou WB, Le MO (2014) Saliency Tree: A Novel Saliency Detection Framework. IEEE Trans Image Process 23(5):1937–1952
Ma Y-F, Zhang H-J (2003) Contrast-based image attention analysis by using fuzzy growing. ACM Multimedia, pp 374-381
Madhu K, Minu RI (2013) Image segmentation using improved JSEG. In: International conference on pattern recognition, informatics and mobile engineering (PRIME), pp 37–42
Narendra A, Sinisa T (2008) Connected Segmentation Tree-A Joint Regpresentation of Region Layout and Hierachy. IEEE Conf Comput Vis Pattern Recognit (CVPR):1–8
Nemati RJ, Javed MY (2008) Fingerprint verification using filter-bank of Gabor and Log Gabor filters. In: 15th International conference on systems, signals and image processing, pp 363– 366
Perazzi F, Krahenbuhl P, Pritch Y, Hornung A (2012) Saliency Filters: Contrast Based Filtering for Salient Region Detection. Proc IEEE Conf Comput Vis Pattern Recognit:733–740
Qiu SG, Feichtinger HG (1995) Discrete Gabor structures and optimal representations. IEEE Trans Signal Process:2258–2268
Qiu SG, Feichtinger HG (1995) Gabor-type matrices and discrete huge Gabor transforms. In: International conference on acoustics, speech, and signal processing, pp 1089-1092
Ren Z, Gao S, Chia L-T, Tsang IW-H (2014) Region-Based Saliency Detection and Its Application in Object Recognition. IEEE Trans Circuits Syst Video Technol 24(5):769–779
Sharma G, Jurie F, Schmid C (2012) Discriminative spatial saliency for image classification. IEEE Conf Comput Vis Pattern Recognit:3506–3513
Wan SH, Jin PG, Yue LH (2009) An approach for image retrieval based on visual saliency. In: International conference on image analysis and signal processing, pp 172–175
Wang Q, Yan P, Yuan Y, Li X (2013) Multi-spectral saliency detection. Pattern Recognition Lett 34(1):34–41
Yang YB, Sun JG (2010) Face Recognition Based on Gabor Feature Extraction and Fractal Coding. Third International Symposium on Electronic Commerce and Security (ISECS), pp 302–306
Acknowledgment
The authors thank Fangli Ying, Xiao-Long Xiao and Xing-jian Lu for their reading the paper carefully and the useful suggestions in the saliency detection. This work is supported by the Nature Science Foundation of China (Grant No.61370174, Grant No.61572316, Grant No.61300133, and Grant No. 61202154), National High-tech R & D Program of China (863 Program) (Grant No. 2015AA011604), Shanghai Pujiang Program (No.13PJ1404500), the Science and Technology Commission of ShanghaiMunicipality Program (No. 13511505000), and the Open Project Program of the State Key Lab of CAD and CG (Grant No. A1401), Zhejiang University.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Chen, Zh., Liu, Y., Sheng, B. et al. Image saliency detection using Gabor texture cues. Multimed Tools Appl 75, 16943–16958 (2016). https://doi.org/10.1007/s11042-015-2965-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-2965-y