Skip to main content
SpringerLink
Log in

Salient object detection using feature clustering and compactness prior

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Salient object detection has been challenging computer vision though some advances have been made recently. In this study, we propose a novel salient object detection method by using feature clustering and compactness prior, in the situation of the absence of any prior information. The proposed method consists of four rigorous steps. Superpixel preprocessing is first employed to segment image into superpixels for suppressing noise and reducing computational complexity. Then, clustering algorithm is applied to get the classification of color features. Furthermore, two-dimensional entropy is used to measure the compactness of each cluster and build the background model. Finally, the salient feature is defined as the contrast between background region and other regions, and enhanced by designing a Gauss filter. To better evaluate the salient object detection accuracy, detailed experimental analysis is carried out by using 7 evaluation indexes. Our proposed method outperforms some peers in extensive experiments. It will inspire more similar techniques to be developed in this research topic.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Abualigah LM, Khader AT, Hanandeh ES (2018) Hybrid clustering analysis using improved krill herd algorithm. Appl Intell 48:4047–4071

    Article  Google Scholar 

  2. Achanta R, Hemami R, Estrada R, Susstrunk S (2009) Frequency-tuned salient region detection. In: IEEE conference on computer vision and pattern recognition, Miami Beach, pp 1597–1604

  3. Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Susstrunk S (2012) SLIC Superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2281

    Article  Google Scholar 

  4. Bai C, Chen J, Huang L, Kpalma K, Chen S (2018) Saliency-based multi-feature modeling for semantic image retrieval. J Vis Commun Image Represent 50:199–204

    Article  Google Scholar 

  5. Borji A, Cheng M -M, Hou Q, Jiang H, Li J (2019) Salient object detection: A survey. Comput Visual Media 5(2):117–150

    Article  Google Scholar 

  6. Chen J, Chen J, Cao H, Li R, Xia T, Ling H, Chen Y (2017) Saliency detection using suitable variant of local and global consistency. IET Comput Vis 11(6):479–487

    Article  Google Scholar 

  7. Cheng M, Mitra NJ, Huang X, Torr PHS, Hu S (2015) Global contrast based salient region detection. IEEE Trans Pattern Anal Mach Intell 37 (3):569–582

    Article  Google Scholar 

  8. Everingham M, Van Gool L, Williams CKI, Winn J, Zisserman A (2012) The PASCAL Visual Object Classes Challenge (VOC2012) Results http://www.pascalnetwork.org/challenges/VOC/voc2012/workshop/index.html

  9. Fan D, Cheng M, Liu Y, Li T, Borji A (2017) Structure-measure: A new way to evaluate foreground maps. IEEE Int Conf Comput Vision 4558–4567

  10. Fan D, Gong C, Cao Y, Ren B, Cheng M, Borji A (2018) Enhanced-alignment Measure for Binary Foreground Map Evaluation. Int Joint Conf Artif Intell, 698C704

  11. Fan D, Lin Z, Zhang Z, Zhu Cheng MM (2020) Rethinking RGB-d salient object detection: Models, Data Sets, and Large-Scale Benchmarks, IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2020.2996406

  12. Fan D, Wang W, Cheng M, Shen J (2019) Shifting more attention to video salient object detection. IEEE Conf Comput Vision Pattern Recognit 8546–8556

  13. Fan DP et al (2018) Salient objects in clutter: Bringing salient object detection to the foreground. European Conf Comput Vision 186–202

  14. Fu K, Zhao Q, Yu-Hua Gu I, Yang J (2019) Deepside: A general deep framework for salient object detection. Neurocomputing 356:69–82

    Article  Google Scholar 

  15. Goferman S, Zelnik-Manor L, Tal A (2010) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34(10):2376–2383

    Google Scholar 

  16. Han J, He S, Qian X, Wang D, Guo L, Liu T (2013) An object-oriented visual saliency detection framework based on sparse coding representations. Circ Syst Video Technol IEEE Trans 23(12):2009–2021

    Article  Google Scholar 

  17. Han J, Zhang D, Hu X, Guo L, Ren J, Wu F (2015) Background Prior-Based salient object detection via deep reconstruction residual. IEEE Trans Circ Syst Video Technol 25(8):1309–1321

    Article  Google Scholar 

  18. Hou X, Zhang L (2007) Saliency detection: A spectral residual approach. In: IEEE computer society conference on computer vision and pattern recognition, Minneapolis. IEEE, pp 1–8

  19. Hu W, Zhou X, Zhang L, Ji T, Liu X (2017) Salient locations which should be interested. In: 29th Chinese control and decision conference, pp 5757–5762

  20. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  21. Jain AK, Murty MN, Flynn PJ (1999) Data clustering: A review. ACM Comput Surveys 31(3):264–323

    Article  Google Scholar 

  22. Jiang H, Wang J (2011) Automatic salient object segmentation based on context and shape prior. In: The British Machine Vision Conference, Scotland, pp 110.111–110.112

  23. Li J, Levine MD, An X, Xu X, He H (2013) Visual saliency based on scale-space analysis in the frequency domain. IEEE Trans Pattern Anal Mach Intell 35(4):996–1010

    Article  Google Scholar 

  24. Li Z, Liu G, Zhang D, Xu Y (2016) Robust single-object image segmentation based on salient transition region. Pattern Recogn 52:317–331

    Article  Google Scholar 

  25. Li X, Lu H, Zhang L, Ruan X, Yang M (2013) Saliency detection via dense and sparse reconstruction. In: IEEE international conference on computer vision, pp 2976–2983

  26. Li Y, Wang S, Tian Q, Ding X (2015) A survey of recent advances in visual feature detection. Neurocomputing 149:736–751

    Article  Google Scholar 

  27. Liu T, Yuan Z, Sun J, Wang J, Zheng N, Tang X, Shum HY (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367

    Article  Google Scholar 

  28. Liu Z, Zhang W, Zhao P (2020) A cross-modal adaptive gated fusion generative adversarial network for RGB-d salient object detection. Neurocomputing 387:210–220

    Article  Google Scholar 

  29. Lyudvichenko V, Erofeev M, Gitman Y, Vatolin D (2017) A semiautomatic saliency model and its application to video compression. In: IEEE International conference on intelligent computer communication and processing, pp 7–9

  30. Ma Y, Zhang H (2003) Contrast-based image attention analysis by using fuzzy growing. In: ACM International Multimedia Conference and Exhibition, Berkeley, pp 374–381

  31. MacQueen J (1967) Some methods for classification and analysis of multivariate observations. In: 5th Berkeley symposium on mathematical statistics and probability, pp 281–297

  32. Martin D, Fowlkes C, Tal D, Malik JA (2001) database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: International conference on computer vision, Vancouver, pp 416–423

  33. Martin D, Fowlkes C, Tal D, Malik J (2001) A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics, International Conference on Computer Vision Vancouver 416–423

  34. Montazer GA, Giveki D (2015) An improved radial basis function neural network for object image retrieval. Neurocomputing 168:221–233

    Article  Google Scholar 

  35. Mu N, Xu X, Zhang X, Zhang H (2018) Salient object detection using a covariance-based CNN model in low-contrast images. Neural Comput Applic 29(8):181–192

    Article  Google Scholar 

  36. Mukherjee P, Lall B (2017) Saliency and KAZE features assisted object segmentation. Image Vision Comput 61:82–97

    Article  Google Scholar 

  37. Naqvi SS, Mirza J, Bashir T (2018) A unified framework for exploiting color coefficients for salient object detection. Neurocomputing 312:187–200

    Article  Google Scholar 

  38. Qiu W, Gao X, Han B (2017) A Superpixel-based CRF saliency detection approach. Neurocomputing 244:19–32

    Article  Google Scholar 

  39. Quan R, Han J, Zhang D, Nie F, Qian X, Li X (2018) Unsupervised salient object detection via inferring from imperfect saliency models. IEEE Trans Multimed 20(5):1101–1112

    Article  Google Scholar 

  40. Shi J, Yan Q, Xu L, Jia J (2016) Hierarchical image saliency detection on extended CSSD. IEEE Trans Pattern Anal Mach Intell 38(4):717–729

    Article  Google Scholar 

  41. Singh C, Preet Kaur K (2016) A fast and efficient image retrieval system based on color and texture features. J Vis Commun Image Represent 41:225–238

    Article  Google Scholar 

  42. Spackman KA (1989) Signal detection theory: Valuable tools for evaluating inductive learning. In: Segre AM (ed) 6th international workshop on machine learning, Morgan Kaufmann, San Francisco, pp 160–163

  43. Srivastava S, Mukherjee P, Lall B (2016) Adaptive image compression using saliency and KAZE features. In: International conference on signal processing and communications, vol 2016, pp 1–5

  44. Sultani W, Mokhtari S, Yun HB (2017) Automatic pavement object detection using superpixel segmentation combined with conditional random field. IEEE Trans Intell Transport Syst 9(7):2076–2085

    Article  Google Scholar 

  45. Tatle BW (2007) The central fixation bias in scene viewing Selecting an optimal viewing position independently of motor biases and image feature distribution. J Vis 7(14):1–17

    Article  Google Scholar 

  46. Wang J, Jiang H, Yuan Z, Cheng M-M, Xiaowei H, Zheng N (2017) Salient object detection: A discriminative regional feature integration approach, vol 123

  47. Wang W, Lai Q, Fu H et al (2019) Salient object detection in the deep learning era: An in-depth survey. arXiv:1904.09146

  48. Wang W, Shen J, Shao L (2018) Video salient object detection via fully convolutional networks. IEEE Trans Image Process 27:38–49

    Article  MathSciNet  Google Scholar 

  49. Wang W, Shen J, Yang R, Porikli F (2018) Saliency-Aware Video object segmentation. IEEE Trans Pattern Anal Mach Intell 40(1):20–33

    Article  Google Scholar 

  50. Wang B, Zhang T, Wang X (2018) Salient object detection based on Laplacian similarity metrics. Vis Comput 34(5):645–658

    Article  Google Scholar 

  51. Wei Y, Wen F, Zhu W, Sun J (2012) Geodesic saliency using background priors. In: European conference on computer vision, Florence. Springer, pp 29–42

  52. Wu Z, Su L, Huang Q (2019) Stacked cross refinement network for Edge-Aware salient object detection. IEEE Int Conf Comput Vision, seoul Korea 7263–7272

  53. Xu R, Wunsch D (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16(3):645–678

    Article  Google Scholar 

  54. Xu G, Xu L, Li X, Tang X, Wang X, Xu C (2016) An image retrieval method based on visual dictionary and saliency region. Int J Signal Process Image Process Pattern Recognit 9(7):263–274

    Google Scholar 

  55. Yang C, Zhang L, Lu H, Ruan X, Yang M-H (2013) Saliency detection via graph-based manifold ranking. In: IEEE conference on computer vision and pattern recognition, pp 3166–3173

  56. Ye L, Liu Z, Li L, Shen L, Bai C, Wang Y (2017) Salient object segmentation via effective integration of saliency and objectness. IEEE Trans Multimed 19(8):1742–1756

    Article  Google Scholar 

  57. Zhai Y, Shah M (2006) Visual attention detection in video sequences using spatiotemporal cues. In: 14th annual ACM international conference on Multimedia, Santa Barbara, pp 815–824

  58. Zhang J, Feng S, Li D, Gao Y, Chen Z, Yuan Y (2017) Image retrieval using the extended salient region. Inf Sci 399:154–182

    Article  Google Scholar 

  59. Zhang Y, Han J, Guo L (2014) Salient region detection using background priors. Optik-Int J Light Elect Opt 125(19):5872–5877

    Article  Google Scholar 

  60. Zhang Y, Han J, Guo L (2014) Salient region detection using background contrast. In: 21st IEEE international conference on image processing, pp 1184–1188

  61. Zhao J, Cao Y, Fan D, Cheng M, Li X, Zhang L (2019) Contrast prior and fluid pyramid integration for RGBD salient object detection, IEEE Conf Comput Vision Pattern Recognit, seoul, Korea 3922–3931

  62. Zhao J et al (2019) EGNEt: Edge guidance network for salient object detection. IEEE Int Conf Comput Vision, Seoul, Korea 8778–8787

  63. Zhou Y, Huo S, Xiang W, Hou C, Kung S (2018) Semi-Supervised Salient object detection using a linear feedback control system model. IEEE Trans Cybern 1–13

  64. Zhou B, Khosla A, Lapedriza A, Oliva A (2016) Torralba a learning deep features for discriminative localization. In: IEEE conference on computer vision and pattern recognition, pp 2921–2929

  65. Zhou L, Yang Z, Zhou Z, Hu D (2017) Salient region detection using diffusion process on a Two-Layer sparse graph. IEEE Trans Image Process 26(12):5882–5894

    Article  MathSciNet  Google Scholar 

  66. Zhu W, Liang S, Wei Y, Sun J (2014) Saliency optimization from robust background detection. In: IEEE conference on computer vision and pattern recognition, pp 2814–2821

  67. Zhu D, Luo Y, Dai L, Shao X, Zhou Q, Itti L, Lu J (2018) Salient object detection via a local and global method based on deep residual network. J Vis Commun Image Represent 54:1–9

    Article  Google Scholar 

  68. Zhu S, Xu Z (2018) Spatiotemporal visual saliency guided perceptual high efficiency video coding with neural network. Neurocomputing 275:511–522

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by National Natural Science Foundation (NNSF) of China (61501388), University Youth Outstanding Talents Program of Shaanxi Province, Qinglan Talent Program of Xianyang Normal University (XSYQL201605). Scientific Research Program Funded by Shaanxi Provincial Education Department (18JK0830). The Specialized Research Fund of Xianyang Normal University (XSYK19044).

Author information

Authors and Affiliations

  1. College of Mathematics and Information Science, Xianyang Normal University, Xianyang, Shaanxi, 712000, China

    Yanbang Zhang & Fen Zhang

  2. School of Automation, Northwestern Polytechnical University, Xi’an, Shaanxi, 710072, China

    Yanbang Zhang & Lei Guo

  3. Department of Computer and Information Science, Fordham University, New York, NY, 10023, USA

    Henry Han

Authors
  1. Yanbang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fen Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lei Guo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Henry Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yanbang Zhang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, Y., Zhang, F., Guo, L. et al. Salient object detection using feature clustering and compactness prior. Multimed Tools Appl 80, 24867–24884 (2021). https://doi.org/10.1007/s11042-021-10744-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-10744-z

Keywords

Search

Navigation