Skip to main content
SpringerLink
Log in

Image saliency detection based on rectangular-wave spectrum analysis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Saliency detection is widely used in the fields of computer graphics and multimedia processing. Many computer graphics tasks, such as image segmentation, image labeling, and tracking, rely on the accurate generation of saliency maps. However, most current methods lack the ability to generate a fine boundary between the foreground and background while also providing a high recall rate. The saliency detection algorithm proposed in this paper is based on rectangular-wave spectrum analysis. In this method, we divide a given image into several regions, which are then convoluted using a pre-set rectangular-wave template. We determine the final saliency value by calculating the difference between a region and its adjacent regions, and its uniqueness compared with the entire image. Repeated tests using different data sets produced a high accuracy-recall rate. Moreover, the boundary in our saliency map is clear and fine.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Achanta R, Estrada F, Wils P, Susstrunk S (2009) Salient region detection and segmentation. ICVS:1597–1604

  2. Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequence tuned salient region detection. CVPR:409–414

  3. Bruce N, Tsotsos J (2005) Saliency based on information maximization. Proc Adv Neural Inf Process Syst 18:155–162

    Google Scholar 

  4. Cheng M-M, Zhang G-X, Mitra NJ, et al. (2011) Global contrast based salient region detection. CVPR

  5. Ell T, Sangwin S (2007) Hypercomplex fourier transforms of color images. IEEE Trans on Image Process 16(1):22–35

    Article  MathSciNet  MATH  Google Scholar 

  6. Goferman S, Zelnik-Manor L, Tal A (2010) Context aware saliency detection. CVPR

  7. Gopalakrishnan V, Hu Y, Rajan D (2009) Salient region detection by modeling distributions of color and orientation [J]. IEEE Trans on Multimedia 11(5):892–905

    Article  Google Scholar 

  8. Guo C, Ma Q, Zhang L (2008) Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. CVPR

  9. Harel J, Koch C, Perona P. (2006) Graph based visual saliency. NIPS:545–552

  10. Hou X, Zhang L (2007) A spectral residual approach. CVPR:1–8

  11. Itti L, Koth C (2000) A saliency-based search mechanism for overt and convert shifts of visual attention. Vis Res 40(10-12):1489–1506. 1

    Article  Google Scholar 

  12. Itti L, Koth C, Niebur E et al (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Machine Intell 20(11):1254–1259. 1, 5

    Article  Google Scholar 

  13. Judd T, Ehinger T, Durand F, Torralba A (2009) Learning to predict where humans look. ICCV 3(1):9–44

    Google Scholar 

  14. Kennedy R, Gallier J, Shi J. (2011) Contour cut: identifying salient contours in images by solving a Hermitian eigenvalue problem. CVPR

  15. Liu T, Yuan Z, Sun J, Wang J, Zheng N, T. X., S. H.Y (2011) Learning to detect a salient object. IEEE TPAMI 33(2):353 –367

    Article  Google Scholar 

  16. Ma Y-F, Zhang H-J (2003) Contrast-based image attention analysis by using fuzzy growing. ACM Multimedia:374–381

  17. Triesman AM, Gelade G (1980) A feature integration theory of attention. Cogn Psychol 12(1):97– 136

    Article  Google Scholar 

  18. Tsotsos JK et al (1995) Modelling visual attention via selective tuning. Artif Intell 78:507– 545

    Article  MathSciNet  Google Scholar 

  19. Yan J, Zhu M, Liu Y (2010) Visual saliency detection via sparsity pursuit. IEEE Signal Process Lett 17(8):739–742

    Article  Google Scholar 

  20. Zhang Q, Liu H, Shen J et al (2010) An improved computational approach for salient region detection [J]. J Comput 5(7):1011–1018

    Google Scholar 

  21. Zhai Y, Shah M (2006) Visual attention detection in video sequences using spatio-temporal cues. ACM Multimedia:815–824

  22. Zhao H, Chen J, Han Y, Cao X (2014) Image aesthetics enhancement using composition-based saliency detection. MMSJ

Download references

Acknowledgments

The authors would like to thank all reviewers for their helpful suggestions and constructive comments. The work is supported by the National Natural Science Foundation of China (No. 61202154, 61133009), National Key Technology R&D Program (No. 2012BAH55F02), the National Basic Research Project of China (No. 2011CB302203), Shanghai Pujiang Program (No. 13PJ1404500), the Science and Technology Commission of Shanghai Municipality Program (No. 13511505000), the Open Projects Program of National Laboratory of Pattern Recognition, and the Open Project Program of the State Key Lab of CAD&CG (Grant No. A1401), Zhejiang University.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China

    Yi Yang, Bin Sheng, Zezhou Cheng & Ruimin Shen

  2. Department of Computer and Information Science, University of Macau, Macao, China

    Wen Wu

Authors
  1. Yi Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bin Sheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wen Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zezhou Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ruimin Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Sheng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, Y., Sheng, B., Wu, W. et al. Image saliency detection based on rectangular-wave spectrum analysis. Multimed Tools Appl 75, 6173–6187 (2016). https://doi.org/10.1007/s11042-015-2565-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2565-x

Keywords

Search

Navigation