Skip to main content

Saliency Detection Based on Deep Learning and Graph Cut

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing – PCM 2018 (PCM 2018)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 11166))

Included in the following conference series:

  • 3320 Accesses

Abstract

In this paper, we propose a new saliency detection method based on deep learning detection models and graph-cut partitioning methods. First, we present a full convolution deep neural network saliency detection model. By training a binary classification, full convolution, deep neural network, the image is divided into foreground and background. Given the initial image, the output is the coarse-grained saliency map with foreground and background. Second, we present a saliency detection method based on graph community partitioning. Using the superpixels algorithm, the initial image is transformed from pixel level to region level, and the super-pixel region similarity matrix is constructed. The similarity matrix is automatically divided into areas by the community-partitioning algorithm, and the segmentation map is obtained. The saliency values of each region are computed by the Gauss kernel function. Lastly, we combine the high-level global saliency map of deep learning with the low-level local saliency map of graph partitioning cut, and realize the saliency detection task of the original image. To illustrate the effectiveness of the proposed method, we also compare the method with the seven popular saliency detection algorithms and evaluate them on four public image databases. A large number of experimental results demonstrate that this algorithm has obvious superiority in comparison with existing algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Jiang, H., Wang, J., Yuan, Z., Wu, Y., Zheng, N., Li, S.: Salient object detection: a discriminative regional feature integration approach. In: CVPR (2013)

    Google Scholar 

  2. Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. In: CVPR (2010)

    Google Scholar 

  3. Shen, X., Wu, Y.: A unified approach to salient object detection via low rank matrix recovery. In: CVPR (2012)

    Google Scholar 

  4. Yang, C., Zhang, L., Lu, H., Ruan, X., Yang, M.-H.: Saliency detection via graph-based manifold ranking. In: CVPR (2013)

    Google Scholar 

  5. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Susstrunk, S.: SLIC superpixels. EPFL (2010)

    Google Scholar 

  6. Eigen, D., Fergus, R.: Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In: Proceedings of IEEE ICCV, pp. 1850–1858 (2015)

    Google Scholar 

  7. Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: Proceedings of ICML, pp. 807–814 (2010)

    Google Scholar 

  8. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: Proceedings of ICLR (2015)

    Google Scholar 

  9. Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: CVPR (2009)

    Google Scholar 

  10. Cheng, M.-M., Mitra, N.J., Huang, X., Hu, S.-M.: Salientshape: group saliency in image collections. Vis. Comput. 30(4), 443–453 (2014)

    Article  Google Scholar 

  11. Yan, Q., Xu, L., Shi, J., Jia, J.: Hierarchical saliency detection. In: Proceedings of IEEE Conference CVPR, pp. 1155–1162 (2013)

    Google Scholar 

  12. Liu, T., Sun, J., Zheng, N.-N., Tang, X., Shum, H.-Y.: Learning to detect a salient object. In: CVPR (2007)

    Google Scholar 

  13. Li, G., Yu, Y.: Visual saliency based on multiscale deep features. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5455–5463. IEEE Press, Boston, USA (2015)

    Google Scholar 

  14. Achanta, R., Estrada, F., Wils, P., Süsstrunk, S.: Salient region detection and segmentation. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 66–75. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-79547-6_7

    Chapter  Google Scholar 

  15. Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. Adv. Neural. Inf. Process. Syst. 19, 545–552 (2007)

    Google Scholar 

  16. Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: CVPR (2007)

    Google Scholar 

  17. Zhu, W., Liang, S., Wei, Y., Sun, J.: Saliency optimization from robust background detection. In: CVPR (2014)

    Google Scholar 

Download references

Acknowledgments

This study was supported by the National Natural Science Foundation of China (Project No. 61572239). Scientific Research Foundation for Advanced Talents of Jiangsu University (Project No. 14JDG040).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hu Lu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lu, H., Song, Y., Sun, J., Xu, X. (2018). Saliency Detection Based on Deep Learning and Graph Cut. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11166. Springer, Cham. https://doi.org/10.1007/978-3-030-00764-5_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-00764-5_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-00763-8

  • Online ISBN: 978-3-030-00764-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics