Skip to main content
SpringerLink
Log in

Saliency detection via background prior and foreground seeds

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

As an image pre-processing technology, saliency detection (DS) can be used in a wide variety of visual tasks. A bottom-up method of DS via background prior and foreground seeds is proposed. To highlight the object and suppress the background noise, two saliency maps are obtained by using the background prior and foreground seeds. First, we use global colour and spatial distance matrices to compute a background saliency map. To evenly emphasize the saliency region, the single-layer cellular automata is used to refine the background-based saliency map. Second, a set of foreground seeds is obtained from the refined background-based saliency map. Then, the foreground-based saliency map is calculated based on the foreground seeds and refined by biased Gaussian filtering. The proposed method could emphasize the foreground target, as well as restrain the background noise. The experiment results show that our method has good ability in saliency detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Achanta R, Hemami S, Estrada F et al (2009) Frequency-tuned salient region detection. 2009 IEEE conference on computer vision and pattern recognition (CVPR), Miami, USA. June. 20-25:1597–1604

    Google Scholar 

  2. Achanta R, Shaji A, Smith K et al (2012) SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2281

    Article  Google Scholar 

  3. Alexe B, Deselaers T, Ferrari V (2010) What is an object? 2010 IEEE conference on computer vision and pattern recognition (CVPR), San Francisco, USA, :.73–80. .

  4. Borji A (2015) What is a salient object? A dataset and a baseline model for salient object detection. IEEE Trans Image Process 24(2):742–756

    Article  MathSciNet  Google Scholar 

  5. Chen X, Li Q, Song Y, et al. (2012) Supervised geodesic propagation for semantic label transfer. European conference on computer vision (ECCV), Firenze, Italy: 553–565

  6. Cheng M.M, Zhang G.X, Mitra N.J, et al. (2011) Global contrast based salient region detection. 2011 IEEE conference on computer vision and pattern recognition (CVPR), Providence, USA: 409–416

  7. Ding Y, Xiao J, Yu J (2011) Importance filtering for image retargeting. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI: 89–96

  8. Goferman S, Zelnikmanor L, Tal A (Oct. 2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34(10):1915–1926

    Article  Google Scholar 

  9. Guo C, Ma Q, Zhang L (2008) Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In: 2008 IEEE conference on computer vision and pattern recognition (CVPR), Anchorage, USA, June. 23–28, pp 1–8

    Google Scholar 

  10. Hornung A, Pritch Y, Krahenbuhl P, et al. (2012) Saliency filters: contrast based filtering for salient region detection. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, USA: 733–740

  11. Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. 2007 IEEE conference on computer vision and pattern recognition (CVPR), Minneapolis, USA. June. 17-22:1–8

    Google Scholar 

  12. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  13. Lee G, Tai YW, Kim J, et al. (2016) Deep saliency with encoded low level distance map and high level features. 2016 IEEE conference on computer vision and pattern recognition (CVPR), Las Vegas, United States: 660–668

  14. Li Q, Chen X, Song Y et al (2014) Geodesic propagation for semantic labeling. IEEE Trans Image Process (TIP) 23(11):4812–4825

    Article  MathSciNet  Google Scholar 

  15. Li Y, Hou X, Koch C, et al. (2014) The secrets of salient object segmentation. 2014 IEEE conference on computer vision and pattern recognition (CVPR), Columbus, USA, June 23–28, pp.280–287. .

  16. Liu T, Yuan Z, Sun J et al (2011) Learning to detect a salient object. IEEE Trans Softw Eng 33(2):353–367

    Google Scholar 

  17. Lu H, Li B, Zhu J, et al. (2016) Wound intensity correction and segmentation with convolutional neural networks. Concurr Comput: Pract Exper 29(6)

  18. Lu H, Li Y, Uemura T et al (2018) Low illumination underwater light field images reconstruction using deep convolutional neural networks. Futur Gener Comput Syst 82:142–148

    Article  Google Scholar 

  19. Mahadevan V, Vasconcelos N (2009) Saliency-based discriminant tracking. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, USA: 1007–1013

  20. Marchesotti L, Cifarelli C, Csurka G (2009) A framework for visual saliency detection with applications to image thumbnailing. IEEE International Conference on Computer Vision (ICCV), Kyoto, Japan: 2232–2239

  21. Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: analysis and an algorithm. Advances in neural information processing systems: natural and synthetic, Vancouver, Canada: 849–856

  22. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybernet 9(1):62–66

    Article  Google Scholar 

  23. Perazzi F, Krähenbühl P, Pritch Y, et al. (2012) Saliency filters: contrast based filtering for salient region detection. 2012 IEEE conference on computer vision and pattern recognition (CVPR), Providence, USA: 733–740

  24. Qin Y, Lu HC, Xu YQ et al. (2015) Saliency detection via cellular automata. 2015 IEEE conference on computer vision and pattern recognition (CVPR), Boston, USA: 110–119

  25. Rahtu E, Kannala J, Salo M, et al. (2010) Segmenting salient objects from images and videos. IEEE conference on European conference on computer vision (ECCV), Heraklion, Greece: 366–379

  26. Rother C, Kolmogorov V, Blake A (2004) “GrabCut”-interactive foreground extraction using iterated graph cuts. ACM Trans Graph 23(3):309–314

    Article  Google Scholar 

  27. Serikawa S, Lu H (2013) Underwater image dehazing using joint trilateral filter. Comput Electr Eng 40(1):41–50

    Article  Google Scholar 

  28. Shi J, Yan Q, Xu L et al (2016) Hierarchical saliency detection on extended CSSD. IEEE Trans Pattern Anal Mach Intell 38(4):717–729

    Article  Google Scholar 

  29. Siagian C, Itti L (2007) Rapid biologically-inspired scene classification using features shared with visual attention. IEEE Trans Pattern Anal Mach Intell 29(2):300–312

    Article  Google Scholar 

  30. Sun J, Ling H (2011) Scale and object aware image retargeting for thumbnail browsing. IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain: 1511–1518

  31. Von Neumann J (1951) The general and logical theory of automata. Papers of John Von Neumann on computing and computer theory: 1–41

  32. Wang J.P, Lu H.C, Li X.H, et al. Saliency detection via background and foreground seed selection. Neurocomputing, Vol.152, pp. 359–368, 2015.

  33. Wang L, Lu H, Zhang P, Xiang R, et al. (2016) Saliency detection with recurrent fully convolutional networks. 2016 IEEE conference on European conference on computer vision (ECCV), Amsterdam, The Netherlands: 825–841

  34. Wei Y, Wen F, Zhu W et al (2012) Geodesic saliency using background priors. In: 2012 IEEE conference on European conference on computer vision (ECCV), Florence, Italy, October. 7–13, pp 29–42

    Google Scholar 

  35. Xiao H, Feng J, Wei Y et al (2018) Deep salient object detection with dense connections and distraction diagnosis. IEEE Trans Multimed 20(12):3239–3251

    Article  Google Scholar 

  36. Yang JM, Yang MH (2012) Top-down visual saliency via joint CRF and dictionary learning. 2012 IEEE conference on computer vision and pattern recognition (CVPR), Providence, USA: 2296–2303

  37. Yang C, Zhang LH, Lu HC et al (2013) Saliency detection via graph-based manifold ranking. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR), Portland, USA, June. 23–28, pp 3166–3173

    Chapter  Google Scholar 

  38. Yang C, Zhang LH, Lu H (2013) Graph-regularized saliency detection with convex-hull-based center. IEEE Signal Process Lett 20(7):637–640

    Article  Google Scholar 

  39. Yang C, Zhang L, Lu H, et al. (2013) Saliency detection via graph-based manifold ranking. 2013 IEEE computer society conference on computer vision and pattern recognition (CVPR), Portland, USA: 3166–3173

  40. Zhang L, Tong M, Mashs T et al (2008) SUN: a bayesian framework for saliency using natural statistics. J Vis 8(7):1–20

    Article  Google Scholar 

  41. Zhang P, Wang D, Lu H, et al. (2017) Learning uncertain convolutional features for accurate saliency detection. 2017 IEEE international conference on computer vision (ICCV), Venice, Italy: 212–221

  42. Zhang X, Gao T, Gao D (2018) A new deep spatial transformer convolutional neural network for image saliency detection. Des Autom Embed Syst 22(3):243–256

    Article  Google Scholar 

  43. Zhang F, Wang M, Xiao ZT, et al. (2018) Saliency detection via fully convolution neural network and low rank sparse decomposition. Acta Automat Sin 44. doi: https://doi.org/10.16383/j.aas.2018.c170535

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (No. 61601325), Tianjin Science and Technology Major Projects and Engineering (No. 17ZXSCSY00060, No. 17ZXHLSY00040) and the Program for Innovative Research Team in University of Tianjin (grant no. TD13-5034).

Author information

Authors and Affiliations

  1. School of Electronics and Information Engineering, Tianjin Polytechnic University, Tianjin, 300,387, China

    Mingjun Ding, Xu Xu, Fang Zhang, Zhitao Xiao, Yanbei Liu, Lei Geng, Jun Wu & Jia Wen

  2. Tianjin Key Laboratory of Optoelectronic Detection Technology and System, Tianjin, 300,387, China

    Mingjun Ding, Xu Xu, Fang Zhang, Zhitao Xiao, Yanbei Liu, Lei Geng, Jun Wu, Jia Wen & Meng Wang

Authors
  1. Mingjun Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xu Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fang Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhitao Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yanbei Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Lei Geng
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jun Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Jia Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Meng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fang Zhang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ding, M., Xu, X., Zhang, F. et al. Saliency detection via background prior and foreground seeds. Multimed Tools Appl 79, 14849–14870 (2020). https://doi.org/10.1007/s11042-019-7728-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7728-8

Keywords

Search

Navigation