Skip to main content
Log in

Low-rank weighted co-saliency detection via efficient manifold ranking

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Co-saliency detection, which aims to detect common salient objects in a group of images, has attracted much attention in the field of computer vision. In this paper, we present an effective co-saliency detection approach that first exploits an efficient manifold ranking scheme to extract a set of co-saliency regions, and then renders rank constraint to the feature matrix of the extracted regions to achieve a high-quality co-saliency map. Specifically, for each input image, we first develop a two-stage manifold ranking algorithm to generate multiple coarse co-saliency maps, and then we extract a group of co-salient regions from each image by fusing the co-saliency maps and the superpixels extracted from it. Then, we design an adaptive weight for each co-saliency map based on the sparse error matrix that is obtained by rendering rank constraint on the feature matrix of the salient regions. Finally, we multiply the coarse co-saliency maps with their corresponding weights to get the fine fusion results, which are further optimized by Graph cuts. Extensive evaluations on the iCoseg dataset demonstrate favorable performance of the proposed approach over some state-of-art methods in terms of both qualitative and quantitative results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. In: IEEE conference on computer vision and pattern recognition, pp 1597–1604

  2. Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2012) Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274–2282

    Article  Google Scholar 

  3. Batra D, Kowdle A, Parikh D, Luo J, Luo TL (2010) icoseg: Interactive co-segmentation with intelligent scribble guidance. In: IEEE conference on computer vision and pattern recognition, pp 3169–3176. IEEE

  4. Boykov Y, Kolmogorov V (2001) An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. In: International workshop on energy minimization methods in computer vision and pattern recognition, pp 359–374

  5. Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239

    Article  Google Scholar 

  6. Cao X, Tao Z, Zhang B, Fu H, Feng W (2014) Self-adaptively weighted co-saliency detection via rank constraint. IEEE Trans Image Process 23(9):4175–4186

    MathSciNet  MATH  Google Scholar 

  7. Cao X, Cheng Y, Tao Z, Fu H (2014) Co-saliency detection via base reconstruction. In: Proceedings of ACM international conference on multimedia, pp 997–1000. ACM

  8. Cao X, Tao Z, Zhang B, Huazhu F, Li X (2013) Saliency map fusion based on rank-one constraint. In: IEEE international conference on multimedia and expo, pp 1–6

  9. Cheng M-M, Mitra NJ, Huang X, Hu S-M (2014) Salientshape: Group saliency in image collections. Vis Comput 30(4):443–453

    Article  Google Scholar 

  10. Fu H, Cao X, Tu Z (2013) Cluster-based co-saliency detection. IEEE Trans Image Process 22(10):3766

    Article  MathSciNet  MATH  Google Scholar 

  11. Ge C, Keren F, Liu F, Li B, Yang J (2016) Co-saliency detection via inter and intra saliency propagation. Signal Process Image Commun 44:69–83

    Article  Google Scholar 

  12. Huang R, Feng W, Sun J (2015) Saliency and co-saliency detection by low-rank multiscale fusion. In: IEEE international conference on multimedia and expo, pp 1–6

  13. Itti L, Koch C, Niebur E (2002) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  14. Jia Y, Han M (2013) Category-independent object-level saliency detection. In: IEEE international conference on computer vision, pp 1761–1768. IEEE

  15. Jian M, Qi Q, Dong J, Sun X, Sun Y, Lam K-M (2017) Saliency detection using quaternionic distance based weber local descriptor and level priors. Multi Tools Appl 77:1–18

  16. Jian M, Qi Q, Dong J, Yin Y, Lam K-M (2018) Integrating qdwd with pattern distinctness and local contrast for underwater saliency detection. J Vis Commun Image Represent 53:31–41

    Article  Google Scholar 

  17. Li H, Ngan KN (2011) A co-saliency model of image pairs. IEEE Trans Image Process 20(12):3365–3375

    Article  MathSciNet  MATH  Google Scholar 

  18. Li H, Meng F, Ngan KN (2013) Co-salient object detection from multiple images. IEEE Trans Multimed 15(8):1896–1909

    Article  Google Scholar 

  19. Li L, Liu Z, Zou W, Zhang X, Meur OL (2014) Co-saliency detection based on region-level fusion and pixel-level refinement. In: IEEE international conference on multimedia and expo, pp 1–6

  20. Li Y, Keren F, Liu Z, Yang J (2014) Efficient saliency-model-guided visual co-saliency detection. IEEE Signal Process Lett 22(5):588–592

    Article  Google Scholar 

  21. Liu Z, Zou W, Li L, Shen L, Meur OL (2013) Co-saliency detection based on hierarchical segmentation. IEEE Signal Process Lett 21(1):88–92

    Article  Google Scholar 

  22. Ohtsu N (2007) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66

    Article  Google Scholar 

  23. Partridge M, Jabri M (2002) Robust principal component analysis. In: Proceedings of the IEEE signal processing society workshop on neural networks for signal processing, pp 289–298

  24. Qin Y, Lu H, Xu Y, Wang H (2015) Saliency detection via cellular automata. In: IEEE conference on computer vision and pattern recognition, pp 110–119. IEEE

  25. Wang L, Gao C, Jian J, Tang L, Liu J (2018) Semantic feature based multi-spectral saliency detection. Multimed Tools Appl 77(3):3387–3403

    Article  Google Scholar 

  26. Wei L, Zhao S, El Farouk Bourahla O, Li X, Wu F (2017) Group-wise deep co-saliency detection. In: Proceedings of the 26th international joint conference on artificial intelligence, pp 3041–3047. AAAI Press

  27. Xiang D, Wang Z (2017) Salient object detection via saliency bias and diffusion. Multimed Tools Appl 76(5):6209–6228

    Article  Google Scholar 

  28. Xu B, Bu J, Chen C, Cai D, He X, Liu W, Luo J (2011) Efficient manifold ranking for image retrieval. In: Proceedings of the 34th international ACM SIGIR conference on research and development in information retrieval, p 525–534. ACM

  29. Yang C, Zhang L, Huchuan L, Ruan X, Yang MH (2013) Saliency detection via graph-based manifold ranking. In: IEEE conference on computer vision and pattern recognition, pp 3166–3173

  30. Zhang D, Huazhu F, Han J, Borji A, Li X (2018) A review of co-saliency detection algorithms: fundamentals, applications, and challenges. ACM Trans Intell Syst Technol 9(4):38

    Article  Google Scholar 

  31. Zhang D, Han J, Li C, Wang J, Li X (2016) Detection of co-salient objects by looking deep and wide. Int J Comput Vis 120(2):215–232

    Article  MathSciNet  Google Scholar 

  32. Zhang D, Meng D, Han J (2017) Co-saliency detection via a self-paced multiple-instance learning framework. IEEE Trans Pattern Anal Mach Intell 39 (5):865–878

    Article  Google Scholar 

  33. Zhu W, Liang S, Wei Y, Sun J (2014) Saliency optimization from robust background detection. In: IEEE conference on computer vision and pattern recognition, pp 2814–2821

Download references

Acknowledgments

This work was supported in part by the National Natural Science Foundation of China under Grant 61876088, Grant 61532009, and Grant 61773002, in part by the Natural Science Foundation of Jiangsu Province under Grant BK20170040.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kaihua Zhang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Li, T., Song, H., Zhang, K. et al. Low-rank weighted co-saliency detection via efficient manifold ranking. Multimed Tools Appl 78, 21309–21324 (2019). https://doi.org/10.1007/s11042-019-7403-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-7403-0

Keywords

Navigation