Abstract
In this paper, we propose a new saliency detection method based on deep learning detection models and graph-cut partitioning methods. First, we present a full convolution deep neural network saliency detection model. By training a binary classification, full convolution, deep neural network, the image is divided into foreground and background. Given the initial image, the output is the coarse-grained saliency map with foreground and background. Second, we present a saliency detection method based on graph community partitioning. Using the superpixels algorithm, the initial image is transformed from pixel level to region level, and the super-pixel region similarity matrix is constructed. The similarity matrix is automatically divided into areas by the community-partitioning algorithm, and the segmentation map is obtained. The saliency values of each region are computed by the Gauss kernel function. Lastly, we combine the high-level global saliency map of deep learning with the low-level local saliency map of graph partitioning cut, and realize the saliency detection task of the original image. To illustrate the effectiveness of the proposed method, we also compare the method with the seven popular saliency detection algorithms and evaluate them on four public image databases. A large number of experimental results demonstrate that this algorithm has obvious superiority in comparison with existing algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Jiang, H., Wang, J., Yuan, Z., Wu, Y., Zheng, N., Li, S.: Salient object detection: a discriminative regional feature integration approach. In: CVPR (2013)
Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. In: CVPR (2010)
Shen, X., Wu, Y.: A unified approach to salient object detection via low rank matrix recovery. In: CVPR (2012)
Yang, C., Zhang, L., Lu, H., Ruan, X., Yang, M.-H.: Saliency detection via graph-based manifold ranking. In: CVPR (2013)
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Susstrunk, S.: SLIC superpixels. EPFL (2010)
Eigen, D., Fergus, R.: Predicting depth, surface normals and semantic labels with a common multi-scale convolutional architecture. In: Proceedings of IEEE ICCV, pp. 1850–1858 (2015)
Nair, V., Hinton, G.E.: Rectified linear units improve restricted Boltzmann machines. In: Proceedings of ICML, pp. 807–814 (2010)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: Proceedings of ICLR (2015)
Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: CVPR (2009)
Cheng, M.-M., Mitra, N.J., Huang, X., Hu, S.-M.: Salientshape: group saliency in image collections. Vis. Comput. 30(4), 443–453 (2014)
Yan, Q., Xu, L., Shi, J., Jia, J.: Hierarchical saliency detection. In: Proceedings of IEEE Conference CVPR, pp. 1155–1162 (2013)
Liu, T., Sun, J., Zheng, N.-N., Tang, X., Shum, H.-Y.: Learning to detect a salient object. In: CVPR (2007)
Li, G., Yu, Y.: Visual saliency based on multiscale deep features. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 5455–5463. IEEE Press, Boston, USA (2015)
Achanta, R., Estrada, F., Wils, P., Süsstrunk, S.: Salient region detection and segmentation. In: Gasteratos, A., Vincze, M., Tsotsos, J.K. (eds.) ICVS 2008. LNCS, vol. 5008, pp. 66–75. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-79547-6_7
Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. Adv. Neural. Inf. Process. Syst. 19, 545–552 (2007)
Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: CVPR (2007)
Zhu, W., Liang, S., Wei, Y., Sun, J.: Saliency optimization from robust background detection. In: CVPR (2014)
Acknowledgments
This study was supported by the National Natural Science Foundation of China (Project No. 61572239). Scientific Research Foundation for Advanced Talents of Jiangsu University (Project No. 14JDG040).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Lu, H., Song, Y., Sun, J., Xu, X. (2018). Saliency Detection Based on Deep Learning and Graph Cut. In: Hong, R., Cheng, WH., Yamasaki, T., Wang, M., Ngo, CW. (eds) Advances in Multimedia Information Processing – PCM 2018. PCM 2018. Lecture Notes in Computer Science(), vol 11166. Springer, Cham. https://doi.org/10.1007/978-3-030-00764-5_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-00764-5_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00763-8
Online ISBN: 978-3-030-00764-5
eBook Packages: Computer ScienceComputer Science (R0)