survey

A Review of Co-Saliency Detection Algorithms: Fundamentals, Applications, and Challenges

Authors:

Xuelong LiAuthors Info & Claims

ACM Transactions on Intelligent Systems and Technology (TIST), Volume 9, Issue 4

Article No.: 38, Pages 1 - 31

https://doi.org/10.1145/3158674

Published: 30 January 2018 Publication History

Abstract

Co-saliency detection is a newly emerging and rapidly growing research area in the computer vision community. As a novel branch of visual saliency, co-saliency detection refers to the discovery of common and salient foregrounds from two or more relevant images, and it can be widely used in many computer vision tasks. The existing co-saliency detection algorithms mainly consist of three components: extracting effective features to represent the image regions, exploring the informative cues or factors to characterize co-saliency, and designing effective computational frameworks to formulate co-saliency. Although numerous methods have been developed, the literature is still lacking a deep review and evaluation of co-saliency detection techniques. In this article, we aim at providing a comprehensive review of the fundamentals, challenges, and applications of co-saliency detection. Specifically, we provide an overview of some related computer vision works, review the history of co-saliency detection, summarize and categorize the major algorithms in this research area, discuss some open issues in this area, present the potential applications of co-saliency detection, and finally point out some unsolved challenges and promising future works. We expect this review to be beneficial to both fresh and senior researchers in this field and to give insights to researchers in other related areas regarding the utility of co-saliency detection algorithms.

References

[1]

Ravi Achanta, Sheila Hemami, Francisco Estrada, and Sabine Susstrunk. 2009. Frequency-tuned salient region detection. In IEEE Conference on Computer Vision and Pattern Recognition. Miami, IEEE, 1597--1604.

[2]

Dhruv Batra, Adarsh Kowdle, Devi Parikh, Jiebo Luo, and Tsuhan Chen. 2010. Icoseg: Interactive co-segmentation with intelligent scribble guidance. In IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, IEEE, 3169--3176.

[3]

Ali Borji. 2012. Boosting bottom-up and top-down visual features for saliency estimation. In IEEE Conference on Computer Vision and Pattern Recognition. Providence, IEEE, 438--445.

Digital Library

[4]

Ali Borji, Ming-Ming Cheng, Huaizu Jiang, and Jia Li. 2015. Salient object detection: A benchmark. IEEE Transactions on Image Processing 24, 12 (2015), 5706--5722.

Digital Library

[5]

Ali Borji and Laurent Itti. 2013. State-of-the-art in visual attention modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 1 (2013), 185--207.

Digital Library

[6]

Ali Borji and James Tanner. 2016. Reconciling saliency and object center-bias hypotheses in explaining free-viewing fixations. IEEE Transactions on Neural Networks and Learning Systems 27, 6 (2016), 1214--1226.

[7]

Pratik Prabhanjan Brahma, Dapeng Wu, and Yiyuan She. 2016. Why deep learning works: A manifold disentanglement perspective. IEEE Transactions on Neural Networks and Learning Systems 27, 10 (2016), 1997--2008.

[8]

Xiaochun Cao, Yupeng Cheng, Zhiqiang Tao, and Huazhu Fu. 2014. Co-saliency detection via base reconstruction. In ACM International Conference on Multimedia. Florida, ACM, 997--1000.

Digital Library

[9]

Xiaochun Cao, Zhiqiang Tao, Bao Zhang, Huazhu Fu, and Wei Feng. 2014. Self-adaptively weighted co-saliency detection via rank constraint. IEEE Transactions on Image Processing 23, 9 (2014), 4175--4186.

[10]

Xiaochun Cao, Zhiqiang Tao, Bao Zhang, Huazhu Fu, and Xuewei Li. 2013. Saliency map fusion based on rank-one constraint. In IEEE International Conference on Multimedia and Expo. San Jose, IEEE, 1--8.

[11]

Xiaochun Cao, Feng Wang, Bao Zhang, Huazhu Fu, and Chao Li. 2016. Unsupervised pixel-level video foreground object segmentation via shortest path algorithm. Neurocomputing 172 (2016), 235--243.

Digital Library

[12]

Xiaochun Cao, Changqing Zhang, Huazhu Fu, Xiaojie Guo, and Qi Tian. 2016. Saliency-aware nonparametric foreground annotation based on weakly labeled data. IEEE Transactions on Neural Networks and Learning Systems 27, 6 (2016), 1253--1265.

[13]

Kai-Yueh Chang, Tyng-Luh Liu, and Shang-Hong Lai. 2011. From co-saliency to co-segmentation: An efficient and fully unsupervised energy minimization model. In IEEE Conference on Computer Vision and Pattern Recognition. Colorado Springs, IEEE, 2129--2136.

Digital Library

[14]

Xiaojun Chang, Zhigang Ma, Yi Yang, Zhiqiang Zeng, and Alexander G. Hauptmann. 2017. Bi-level semantic representation analysis for multimedia event detection. IEEE Trans Cybernetics 47, 5 (2017), 1180--1197.

[15]

Xiaojun Chang, Yaoliang. Yu, Yi Yang, and E. P. Xing. 2017. Semantic pooling for complex event analysis in untrimmed videos. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 8 (2017), 1617--1632.

Digital Library

[16]

Hwann-Tzong Chen. 2010. Preattentive co-saliency detection. In IEEE International Conference on Image Processing. Hong Kong, IEEE, 1117--1120.

[17]

Tianshui Chen, Liang Lin, Lingbo Liu, Xiaonan Luo, and Xuelong Li. 2016. DISC: Deep image saliency computing via progressive representation learning. IEEE Transactions on Neural Networks and Learning Systems 27, 6 (2016), 1135--1149.

[18]

Yi-Lei Chen and Chiou-Ting Hsu. 2014. Implicit rank-sparsity decomposition: Applications to saliency/co-saliency detection. In International Conference on Pattern Recognition. Stockholm, IEEE, 2305--2310.

Digital Library

[19]

Ming Cheng, Niloy J. Mitra, Xumin Huang, Philip H. S. Torr, and Song Hu. 2015. Global contrast based salient region detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 37, 3 (2015), 569--582.

Digital Library

[20]

Ming-Ming Cheng, Niloy J. Mitra, Xiaolei Huang, and Shi-Min Hu. 2014. SalientShape: Group saliency in image collections. The Visual Computer 30, 4 (2014), 443--453.

Digital Library

[21]

Yupeng Cheng, Huazhu Fu, Xingxing Wei, Jiangjian Xiao, and Xiaochun Cao. 2014. Depth enhanced saliency detection method. In Proceedings of International Conference on Internet Multimedia Computing and Service. 23--28.

Digital Library

[22]

Minsu Cho, Suha Kwak, Cordelia Schmid, and Jean Ponce. 2015. Unsupervised object discovery and localization in the wild: Part-based matching with bottom-up region proposals. In IEEE Conference on Computer Vision and Pattern Recognition. Boston, IEEE, 1201--1210.

[23]

Ramazan Gokberk Cinbis, Jakob Verbeek, and Cordelia Schmid. 2014. Multi-fold MIL training for weakly supervised object localization. In IEEE Conference on Computer Vision and Pattern Recognition. Columbus, IEEE, 2409--2416.

Digital Library

[24]

Runmin Cong, Jianjun Lei, Huazhu Fu, Qingming Huang, Xiaochun Cao, and Chunping Hou. 2018. Co-saliency detection for RGBD images based on multi-constraint feature matching and cross label propagation. IEEE Transactions on Image Processing 27, 2 (2018), 568--579.

Digital Library

[25]

Runmin Cong, Jianjun Lei, Huazhu Fu, Weisi Lin, Qingming Huang, Xiaochun Cao, and Chunping Hou. 2017, Accepted. An iterative co-saliency framework for RGBD images. IEEE Transactions on Cybernetics (2017, Accepted).

[26]

Jesse Davis and Mark Goadrich. 2006. The relationship between precision-recall and ROC curves. In International Conference on Machine Learning. Pittsburgh, ACM, 233--240.

Digital Library

[27]

Yue Deng, Qionghai Dai, Risheng Liu, Zengke Zhang, and Sanqing Hu. 2013. Low-rank structure learning via nonconvex heuristic recovery. IEEE Transactions on Neural Networks and Learning Systems 24, 3 (2013), 383--396.

[28]

Thomas Deselaers, Bogdan Alexe, and Vittorio Ferrari. 2012. Weakly supervised localization and learning with generic knowledge. International Journal of Computer Vision 100, 3 (2012), 275--293.

Digital Library

[29]

Shuze Du and Shifeng Chen. 2015. Detecting co-salient objects in large image sets. Signal Processing Letters 22, 2 (2015), 145--148.

[30]

Yuming Fang, Zhou Wang, Weisi Lin, and Zhijun Fang. 2014. Video saliency incorporating spatiotemporal cues and uncertainty weighting. IEEE Transactions on Image Processing 23, 9 (2014), 3910--3921.

[31]

David A. Forsyth, Jitendra Malik, Margaret M. Fleck, Hayit Greenspan, Thomas Leung, Serge Belongie, Chad Carson, and Chris Bregler. 1996. Finding Pictures of Objects in Large Collections of Images. Springer.

[32]

Huazhu Fu, Xiaochun Cao, and Zhuowen Tu. 2013. Cluster-based co-saliency detection. IEEE Transactions on Image Processing 22, 10 (2013), 3766--3778.

Digital Library

[33]

Huazhu Fu, Dong Xu, Stephen Lin, and Jiang Liu. 2015. Object-based RGBD image co-segmentation with mutex constraint. In IEEE Conference on Computer Vision and Pattern Recognition. Boston, IEEE, 4428--4436.

[34]

Huazhu Fu, Dong Xu, Bao Zhang, and Stephen Lin. 2014. Object-based multiple foreground video co-segmentation. In IEEE Conference on Computer Vision and Pattern Recognition. Columbus, IEEE, 3166--3173.

Digital Library

[35]

Huazhu Fu, Dong Xu, Bao Zhang, Stephen Lin, and Rabab Kreidieh Ward. 2015. Object-based multiple foreground video co-segmentation via multi-state selection graph. IEEE Transactions on Image Processing 24, 11 (2015), 3415--3424.

Digital Library

[36]

Carolina Galleguillos, Boris Babenko, Andrew Rabinovich, and Serge Belongie. 2008. Weakly supervised object localization with stable segmentations. In European Conference on Computer Vision. Marseille, Springer, 193--207.

Digital Library

[37]

Chuang Gan, Naiyan Wang, Yi Yang, Dit Yan Yeung, and Alexander G. Hauptmann. 2015. DevNet: A deep event network for multimedia event detection and evidence recounting. In IEEE Conference on Computer Vision and Pattern Recognition. Boston, IEEE, 2568--2577.

[38]

Chenjie Ge, Keren Fu, Fanghui Liu, Li Bai, and Jie Yang. 2016. Co-saliency detection via inter and intra saliency propagation. Signal Processing: Image Communication 44 (2016), 69--83.

Digital Library

[39]

Stas Goferman, Lihi Zelnik-Manor, and Ayellet Tal. 2012. Context-aware saliency detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 10 (2012), 1915--1926.

Digital Library

[40]

Junwei Han, Gong Cheng, Zhenpeng Li, and Dingwen Zhang. 2017. A unified metric learning-based framework for co-saliency detection. IEEE Transactions on Circuits and Systems for Video Technology PP, 99 (2017), 1--1.

[41]

Junwei Han, Dingwen Zhang, Gong Cheng, Lei Guo, and Jinchang Ren. 2015. Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning. IEEE Transactions on Geoscience and Remote Sensing 53, 6 (2015), 3325--3337.

[42]

Junwei Han, Dingwen Zhang, Xintao Hu, Lei Guo, Jinchang Ren, and Feng Wu. 2015. Background prior-based salient object detection via deep reconstruction residual. IEEE Transactions on Circuits and Systems for Video Technology 25, 8 (2015), 1309--1321.

Digital Library

[43]

Junwei Han, Dingwen Zhang, Shifeng Wen, Lei Guo, Tianming Liu, and Xuelong Li. 2016. Two-stage learning to predict human eye fixations via SDAEs. IEEE Transactions on Cybernetics 46, 2 (2016), 487--498.

[44]

Dorit S. Hochbaum and Vikas Singh. 2009. An efficient algorithm for co-segmentation. In IEEE Conference on Computer Vision and Pattern Recognition. Miami, IEEE, 269--276.

[45]

Rui Huang, Wei Feng, and Jizhou Sun. 2015. Saliency and co-saliency detection by low-rank multiscale fusion. In IEEE International Conference on Multimedia and Expo. Torino, IEEE, 1--6.

[46]

Xun Huang, Chengyao Shen, Xavier Boix, and Qi Zhao. 2015. SALICON: Reducing the semantic gap in saliency prediction by adapting deep neural networks. In IEEE International Conference on Computer Vision. Chile, IEEE, 262--270.

Digital Library

[47]

Laurent Itti, Christof Koch, and Ernst Niebur. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 11 (1998), 1254--1259.

Digital Library

[48]

David E. Jacobs, Dan B. Goldman, and Eli Shechtman. 2010. Cosaliency: Where people look when comparing images. In ACM Symposium on User Interface Software and Technology. 219--228.

Digital Library

[49]

Dong-ju Jeong, Insung Hwang, and Nam Ik Cho. 2017. Co-salient object detection based on deep saliency networks and seed propagation over an integrated graph. In arXiv:1706.09650.

[50]

KoteswarRao Jerripothula, Jianfei Cai, and Junsong Yuan. 2016. CATS: Co-saliency activated tracklet selection for video co-localization. In European Conference on Computer Vision. Amsterdam, Springer, 187--202.

[51]

Huiyun Jing, Xin He, Qi Han, and Xiamu Niu. 2015. Co-saliency detection linearly combining single-view saliency and foreground correspondence. IEICE Transactions on Information and System 98, 4 (2015), 985--988.

[52]

Armand Joulin, Francis Bach, and Jean Ponce. 2010. Discriminative clustering for image co-segmentation. In IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, IEEE, 1943--1950.

[53]

Armand Joulin, Francis Bach, and Jean Ponce. 2012. Multi-class cosegmentation. In IEEE Conference on Computer Vision and Pattern Recognition. Providence, IEEE, 542--549.

Digital Library

[54]

Armand Joulin, Kevin Tang, and Li Fei-Fei. 2014. Efficient image and video co-localization with frank-wolfe algorithm. In European Conference on Computer Vision. Zurich, Springer, 253--268.

[55]

Abhishek Kar, Shubham Tulsiani, João Carreira, and Jitendra Malik. 2015. Category-specific object reconstruction from a single image. In IEEE Conference on Computer Vision and Pattern Recognition. Boston, IEEE, 1966--1974.

[56]

Vera Kettnaker and Ramin Zabih. 1999. Bayesian multi-camera surveillance. In IEEE Conference on Computer Vision and Pattern Recognition. Ft. Collins, IEEE, 253--259.

[57]

Gunhee Kim, Eric P. Xing, Li Fei-Fei, and Takeo Kanade. 2011. Distributed cosegmentation via submodular optimization on anisotropic diffusion. In IEEE International Conference on Computer Vision. Barcelona, IEEE, 169--176.

Digital Library

[58]

Wonjun Kim, Chanho Jung, and Changick Kim. 2011. Spatiotemporal saliency detection and its applications in static and dynamic scenes. IEEE Transactions on Circuits and Systems for Video Technology 21, 4 (2011), 446--456.

Digital Library

[59]

Congyan Lang, Tam V. Nguyen, Harish Katti, Karthik Yadati, Mohan Kankanhalli, and Shuicheng Yan. 2012. Depth matters: Influence of depth cues on visual saliency. In European Conference on Computer Vision. Florence, Springer, 101--115.

[60]

Hongliang Li, Fanman Meng, and K. Ngan. 2013. Co-salient object detection from multiple images. IEEE Transactions on Multimedia 15, 8 (2013), 1896--1909.

Digital Library

[61]

Hongliang Li and King Ngi Ngan. 2011. A co-saliency model of image pairs. IEEE Transactions on Image Processing 20, 12 (2011), 3365--3375.

Digital Library

[62]

Lina Li, Zhi Liu, Wenbin Zou, Xiang Zhang, and Olivier Le Meur. 2014. Co-saliency detection based on region-level fusion and pixel-level refinement. In IEEE International Conference on Multimedia and Expo. Chengdu, IEEE, 1--6.

[63]

Li-Jia Li, Hao Su, Yongwhan Lim, and Li Fei-Fei. 2014. Object bank: An object-level image representation for high-level visual recognition. International Journal of Computer Vision 107, 1 (2014), 20--39.

Digital Library

[64]

Wei-Te Li, Haw-Shiuan Chang, Kuo-Chin Lien, Hui-Tang Chang, and Y. F. Wang. 2013. Exploring visual and motion saliency for automatic video object extraction. IEEE Transactions on Image Processing 22, 7 (2013), 2600--2610.

[65]

Xi Li, Weiming Hu, Chunhua Shen, Zhongfei Zhang, Anthony Dick, and Anton Van Den Hengel. 2013. A survey of appearance models in visual object tracking. ACM Transactions on Intelligent Systems and Technology 4, 4 (2013), 58.

Digital Library

[66]

Yijun Li, Keren Fu, Zhi Liu, and Jie Yang. 2015. Efficient saliency-model-guided visual co-saliency detection. Signal Processing Letters 22, 5 (2015), 588--592.

[67]

Yong Li, Bin Sheng, Lizhuang Ma, Wen Wu, and Zhifeng Xie. 2013. Temporally coherent video saliency using regional dynamic contrast. IEEE Transactions on Circuits and Systems for Video Technology 23, 12 (2013), 2067--2076.

Digital Library

[68]

Xiaodan Liang, Yunchao Wei, YunPeng Chen, Jianchao Yang, Liang Lin, and Shuicheng Yan. 2017. Learning to segment human by watching YouTube. IEEE Transactions on Pattern Analysis and Machine Intelligence PP, 99 (2017), 1--1.

[69]

Zijia Lin, Guiguang Ding, Jungong Han, and Jianmin Wang. 2017. Cross-view retrieval via probability-based semantics-preserving hashing. IEEE Transactions on Cybernetics 47, 12 (2017), 4342--4355.

[70]

Nian Liu, Junwei Han, Dingwen Zhang, Shifeng Wen, and Tianming Liu. 2015. Predicting eye fixations using convolutional neural networks. In IEEE Conference on Computer Vision and Pattern Recognition. Boston, IEEE, 362--370.

[71]

Tie Liu, Zejian Yuan, Jian Sun, Jingdong Wang, Nanning Zheng, Xiaoou Tang, and Heung-Yeung Shum. 2011. Learning to detect a salient object. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 2 (2011), 353--367.

Digital Library

[72]

Zhi Liu, Wenbin Zou, Lina Li, Liquan Shen, and O. Le Meur. 2014. Co-saliency detection based on hierarchical segmentation. Signal Processing Letters 21, 1 (2014), 88--92.

[73]

Jing Lou, Fenglei Xu, Qingyuan Xia, Wankou Yang, and Mingwu Ren. 2017. Hierarchical co-salient object detection via color names. Asian Conference on Pattern Recognition. Nanjing, IEEE, 1--7.

[74]

Chia-Ju Lu, Chih-Fan Hsu, and Mei-Chen Yeh. 2013. Real-time salient object detection. In Acm International Conference on Multimedia. Barcelona, ACM, 401--402.

Digital Library

[75]

Yun Luo, Mian Jiang, Yongkang Wong, and Qiming Zhao. 2015. Multi-camera saliency. IEEE Transactions on Pattern Analysis 8 Machine Intelligence 37, 10 (2015), 2057--2070.

Digital Library

[76]

Ye Luo, Junsong Yuan, and Jianwei Lu. 2016. Finding spatio-temporal salient paths for video objects discovery. Journal of Visual Communication and Image Representation 38 (2016), 45--54.

Digital Library

[77]

Vijay Mahadevan and Nuno Vasconcelos. 2010. Spatiotemporal saliency in dynamic scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 1 (2010), 171--177.

Digital Library

[78]

MH Nguyen and Lorenzo Torresani. 2009. Weakly supervised discriminative localization and classification: A joint learning process. In IEEE International Conference on Computer Vision. Kyoto, IEEE, 1925--1932.

[79]

Tam V. Nguyen, Mengdi Xu, Guangyu Gao, Mohan Kankanhalli, Qi Tian, and Shuicheng Yan. 2013. Static saliency vs. dynamic saliency: A comparative study. In Acm International Conference on Multimedia. Barcelona, ACM, 987--996.

Digital Library

[80]

Megha Pandey and Svetlana Lazebnik. 2011. Scene recognition and weakly supervised object localization with deformable part-based models. In IEEE International Conference on Computer Vision. Barcelona, IEEE, 1307--1314.

Digital Library

[81]

Alex Papushoy and Adrian G. Bors. 2015. Image retrieval based on query by saliency content. Digital Signal Processing 36 (2015), 156--173.

Digital Library

[82]

Houwen Peng, Bing Li, Weihua Xiong, Weiming Hu, and Rongrong Ji. 2014. RGBD salient object detection: A benchmark and algorithms. In European Conference on Computer Vision. Zurich, Springer, 92--109.

[83]

Alessandro Prest, Christian Leistner, Javier Civera, Cordelia Schmid, and Vittorio Ferrari. 2012. Learning object class detectors from weakly annotated video. In IEEE Conference on Computer Vision and Pattern Recognition. Providence, IEEE, 3282--3289.

Digital Library

[84]

Rong Quan, Junwei Han, Dingwen Zhang, and Feiping Nie. 2016. Object co-segmentation via graph optimized-flexible manifold ranking. In IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, IEEE, 687--695.

[85]

Nicolas Riche, Matei Mancas, Dubravko Culibrk, Vladimir Crnojevic, Bernard Gosselin, and Thierry Dutoit. 2013. Dynamic saliency models and human attention: A comparative study on videos. In Asian Conference on Computer Vision. Daejeon, Springer, 586--598.

Digital Library

[86]

Carsten Rother, Tom Minka, Andrew Blake, and Vladimir Kolmogorov. 2006. Cosegmentation of image pairs by histogram matching: Incorporating a global constraint into MRFs. In IEEE Conference on Computer Vision and Pattern Recognition. New York, IEEE, 993--1000.

Digital Library

[87]

Marcos Rubinstein, Armand Joulin, Johannes Kopf, and Ce Liu. 2013. Unsupervised joint object discovery and segmentation in internet images. In IEEE Conference on Computer Vision and Pattern Recognition. Portland, IEEE, 1939--1946.

Digital Library

[88]

Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, and others. 2015. Imagenet large scale visual recognition challenge. International Journal of Computer Vision 115, 3 (2015), 211--252.

Digital Library

[89]

Ning-Min Shen, Jing Li, Pei-Yun Zhou, Ying Huo, and Yi Zhuang. 2016. BSFCoS: Block and sparse principal component analysis-based fast co-saliency detection method. International Journal of Pattern Recognition and Artificial Intelligence 30, 1 (2016).

[90]

Zhiyuan Shi, Parthipan Siva, Tony Xiang, and Q. Mary. 2012. Transfer learning by ranking for weakly supervised object annotation. In British Machine Vision Conference. Guildford, 78.1--78.11.

[91]

Parthipan Siva, Chris Russell, Tao Xiang, and Lourdes Agapito. 2013. Looking beyond the image: Unsupervised learning for object saliency and detection. In IEEE Conference on Computer Vision and Pattern Recognition. Portland, IEEE, 3238--3245.

Digital Library

[92]

Parthipan Siva and Tao Xiang. 2011. Weakly supervised object detector learning with model drift detection. In IEEE International Conference on Computer Vision. Barcelona, IEEE, 343--350.

Digital Library

[93]

Hangke Song, Zhi Liu, Yufeng Xie, Lishan Wu, and Mengke Huang. 2016. RGBD co-saliency detection via bagging-based clustering. IEEE Signal Processing Letters 23, 12 (2016), 1722--1726.

[94]

Hyun Oh Song, Yong Jae Lee, Stefanie Jegelka, and Trevor Darrell. 2014. Weakly-supervised discovery of visual pattern configurations. In Advances in Neural Information Processing Systems. Montreal, 1637--1645.

Digital Library

[95]

Yicheng Song, Yongdong Zhang, Juan Cao, Jinhui Tang, Xingyu Gao, and Jintao Li. 2014. A unified geolocation framework for web videos. ACM Transactions on Intelligent Systems and Technology 5, 3 (2014), 49.

Digital Library

[96]

Zhiyu Tan, Liang Wan, Wei Feng, and Chi-Man Pun. 2013. Image co-saliency detection by propagating superpixel affinities. In IEEE International Conference on Acoustics, Speech and Signal Processing. Vancouver, IEEE, 2114--2118.

[97]

Ke Tang, Armand Joulin, Li-Jia Li, and Li Fei-Fei. 2014. Co-localization in real-world images. In IEEE Conference on Computer Vision and Pattern Recognition. Columbus, IEEE, 1464--1471.

Digital Library

[98]

Zhiqiang Tao, Hongfu Liu, Huazhu Fu, and Yun Fu. 2017. Image cosegmentation via saliency-guided constraint clustering with cosine similarity. In AAAI Conference on Artificial Intelligence. San Francisco, 4285--4291.

[99]

Sara Vicente, Joao Carreira, Leobelle Agapito, and Jorge Batista. 2014. Reconstructing Pascal VOC. In IEEE Conference on Computer Vision and Pattern Recognition. Columbus, IEEE, 41--48.

Digital Library

[100]

Sara Vicente, Carsten Rother, and Vladimir Kolmogorov. 2011. Object cosegmentation. In IEEE Conference on Computer Vision and Pattern Recognition. Colorado Springs, IEEE, 2217--2224.

Digital Library

[101]

Chong Wang, Weiqiang Ren, Kaiqi Huang, and Tieniu Tan. 2014. Weakly supervised object localization with latent category learning. In European Conference on Computer Vision. Zurich, Springer, 431--445.

[102]

Wenguan Wang, Jianbing Shen, Xuelong Li, and Fatih Porikli. 2015. Robust video object cosegmentation. IEEE Transactions on Image Processing 24, 10 (2015), 3137--3148.

Digital Library

[103]

Wenguan Wang, Jianbing Shen, and F. Porikli. 2015. Saliency-aware geodesic video object segmentation. In IEEE Conference on Computer Vision and Pattern Recognition. Boston, IEEE, 3395--3402.

[104]

Wenguan Wang, Jianbing Shen, Hanqiu Sun, and Ling Shao. 2017. ViCoS2: Video co-saliency guided co-segmentation. IEEE Transactions on Circuits and Systems for Video Technology (2017).

[105]

Zhengxiang Wang and Rujie Liu. 2012. Semi-supervised learning for large scale image cosegmentation. In IEEE International Conference on Computer Vision. Sydney, IEEE, 393--400.

Digital Library

[106]

Lina Wei, Shanshan Zhao, Omar El Farouk Bourahla, Xi Li, and Fei Wu. 2017. Group-wise deep co-saliency detection. In International Joint Conference on Artificial Intelligence. Melbourne, 3041--3047.

Digital Library

[107]

Yichen Wei, Fang Wen, Wangjiang Zhu, and Jian Sun. 2012. Geodesic saliency using background priors. In European Conference on Computer Vision. Florence, Springer, 29--42.

Digital Library

[108]

John Winn, Antonio Criminisi, and Thomas Minka. 2005. Object categorization by learned universal visual dictionary. In IEEE International Conference on Computer Vision. Beijing, IEEE, 1800--1807.

Digital Library

[109]

Chen Xia, Fei Qi, and Guangming Shi. 2016. Bottom--Up visual saliency estimation with deep autoencoder-based sparse reconstruction. IEEE Transactions on Neural Networks and Learning Systems 27, 6 (2016), 1227--1240.

[110]

Yufeng Xie, Linwei Ye, Zhi Liu, and Xuemei Zou. 2016. Video co-saliency detection. In International Conference on Digital Image Processing. Chengdu, SPIE, 100335G.

[111]

Qiong Yan, Li Xu, Jianping Shi, and Jiaya Jia. 2013. Hierarchical saliency detection. In IEEE Conference on Computer Vision and Pattern Recognition. Portland, IEEE, 1155--1162.

Digital Library

[112]

Chuan Yang, Lihe Zhang, Huchuan Lu, Xiang Ruan, and Ming-Hsuan Yang. 2013. Saliency detection via graph-based manifold ranking. In IEEE Conference on Computer Vision and Pattern Recognition. Portland, IEEE, 3166--3173.

Digital Library

[113]

Jiong Yang, Gangqiang Zhao, Junsong Yuan, Xiaohui Shen, Zhe Lin, Brian Price, and Jonathan Brandt. 2016. Discovering primary objects in videos by saliency fusion and iterative appearance estimation. IEEE Transactions on Circuits and Systems for Video Technology 26, 6 (2016), 1070--1083.

[114]

Linjun Yang, Bo Geng, Yang Cai, Alan Hanjalic, and Xian-Sheng Hua. 2011. Object retrieval using visual query context. IEEE Transactions on Multimedia 13, 6 (2011), 1295--1307.

Digital Library

[115]

Xiwen Yao, Junwei Han, Dingwen Zhang, and Feiping Nie. 2017. Revisiting co-saliency detection: A novel approach based on two-stage multi-view spectral rotation co-clustering. IEEE Transactions on Image Processing 26, 7 (2017), 3196--3209.

Digital Library

[116]

Linwei Ye, Zhi Liu, Junhao Li, Wan-Lei Zhao, and Liquan Shen. 2015. Co-saliency detection via co-salient object discovery and recovery. Signal Processing Letters 22, 11 (2015), 2073--2077.

[117]

Yuan Yuan, Xiaodan Liang, Xiaolong Wang, Dit Yan Yeung, and Abhinav Gupta. 2017. Temporal dynamic graph LSTM for action-driven video object detection. In IEEE International Conference on Computer Vision. Venice, IEEE, 1801--1810.

[118]

Matthew D. Zeiler, Graham W. Taylor, and Rob Fergus. 2011. Adaptive deconvolutional networks for mid and high level feature learning. In IEEE International Conference on Computer Vision. Barcelona, IEEE, 2018--2025.

Digital Library

[119]

Dingwen Zhang, Junwei Han, Gong Cheng, Zhenbao Liu, Shuhui Bu, and Lei Guo. 2015. Weakly supervised learning for target detection in remote sensing images. IEEE Geoscience and Remote Sensing Letters 12, 4 (2015), 701--705.

[120]

Dingwen Zhang, Junwei Han, Jungong Han, and Ling Shao. 2016. Cosaliency detection based on intrasaliency prior transfer and deep intersaliency mining. IEEE Transactions on Neural Networks and Learning Systems 27, 6 (2016), 1163--1176.

[121]

Dingwen Zhang, Junwei Han, Lu Jiang, Senmao Ye, and Xiaojun Chang. 2017. Revealing event saliency in unconstrained video collection. IEEE Transactions on Image Processing 26, 4 (2017), 1746--1758.

Digital Library

[122]

Dingwen Zhang, Junwei Han, Chao Li, and Jingdong Wang. 2015. Co-saliency detection via looking deep and wide. In IEEE Conference on Computer Vision and Pattern Recognition. Boston, IEEE, 2994--3002.

[123]

Dingwen Zhang, junwei Han, Chao Li, Jingdong Wang, and Xuelong Li. 2016. Detection of co-salient objects by looking deep and wide. International Journal of Computer Vision 120, 2 (2016), 215--232.

Digital Library

[124]

Dingwen Zhang, Junwei Han, Yang Yang, and Dong Huang. 2017. Learning category-specific 3D shape models from weakly labeled 2D images. In IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, IEEE, 4573--4581.

[125]

Dingwen Zhang, Deyu Meng, and Junwei Han. 2017. Co-saliency detection via a self-paced multiple-instance learning framework. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 5 (2017), 865--878.

Digital Library

[126]

Dingwen Zhang, Deyu Meng, Chao Li, Lu Jiang, Qian Zhao, and Junwei Han. 2015. A self-paced multiple-instance learning framework for co-saliency detection. In IEEE International Conference on Computer Vision. Chile, IEEE, 594--602.

Digital Library

[127]

Dingwen Zhang, Deyu Meng, Long Zhao, and Junwei Han. 2016. Bridging saliency detection to weakly supervised object detection based on self-paced curriculum learning. In International Joint Conference on Artificial Intelligence. New York, 3538--3544.

Digital Library

[128]

Dingwen Zhang, Le Yang, Deyu Meng, Dong Xu, and Junwei Han. 2017. SPFTN: A self-paced fine-tuning network for segmenting objects in weakly labelled videos. In IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, IEEE, 4429--4437.

[129]

Jianming Zhang, Stan Sclaroff, Zhe Lin, Xiaohui Shen, Brian Price, and Radomir Mech. 2015. Minimum barrier salient object detection at 80 FPS. In IEEE International Conference on Computer Vision. Chile, IEEE, 1404--1412.

Digital Library

[130]

Guiqian Zhu, Yi Ji, Xianjin Jiang, Zenan Xu, and Chunping Liu. 2017. Co-saliency detection based on superpixel clustering. In International Conference on Knowledge Science, Engineering and Management. 287--295.

[131]

Hongyuan Zhu, Fanman Meng, Jianfei Cai, and Shijian Lu. 2016. Beyond pixels: A comprehensive survey from bottom-up to semantic image segmentation and cosegmentation. Journal of Visual Communication and Image Representation 34 (2016), 12--27.

Digital Library

[132]

Wangjiang Zhu, Shuang Liang, Yichen Wei, and Jian Sun. 2014. Saliency optimization from robust background detection. In IEEE Conference on Computer Vision and Pattern Recognition. Columbus, IEEE, 2814--2821.

Digital Library

[133]

Yu Zhu, Wenbin Chen, and Guodong Guo. 2015. Fusing multiple features for depth-based action recognition. ACM Transactions on Intelligent Systems and Technology 6, 2 (2015), 18.

Digital Library

Cited By

Zhu JCai WZhang MLin YLiu M(2025)Saliency detection for underwater moving object with sonar based on motion estimation and multi-trajectory analysisPattern Recognition10.1016/j.patcog.2024.111043158(111043)Online publication date: Feb-2025
https://doi.org/10.1016/j.patcog.2024.111043
Ge YPan JRen JHe MBi HZhang Q(2025)Co-salient object detection with consensus mining and consistency cross-layer interactive decodingImage and Vision Computing10.1016/j.imavis.2025.105414154(105414)Online publication date: Feb-2025
https://doi.org/10.1016/j.imavis.2025.105414
Guan YQiu YLeng JYang FYu SLiu YFeng YZhu YZhou LLiang YZhang CLi CGuo MTsafrir DMUSUVATHI MGupta RAbu-Ghazaleh N(2024)Amanda: Unified Instrumentation Framework for Deep Neural NetworksProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 110.1145/3617232.3624864(1-18)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3617232.3624864
Show More Cited By

Index Terms

A Review of Co-Saliency Detection Algorithms: Fundamentals, Applications, and Challenges
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision problems
      2. Computer vision tasks

Recommendations

Co-saliency Detection with Graph Matching
Survey Paper, Research Commentary and Regular Papers

Recently, co-saliency detection, which aims to automatically discover common and salient objects appeared in several relevant images, has attracted increased interest in the computer vision community. In this article, we present a novel graph-matching ...
Modern Learning Methodologies for Co-Saliency Detection
HUMA'21: Proceedings of the 2nd International Workshop on Human-centric Multimedia Analysis

Visual saliency computing aims to imitate the human visual attention mechanism to identify the most prominent or unique areas or objects from a visual scene. It is one of the basic low-level image processing techniques and can be applied to many ...
Object-level saliency detection with color attributes

Recently, saliency detection has been becoming a popular topic in computer vision. In this paper we propose an object-level saliency detection algorithm which explicitly explores bottom-up visual attention and objectness cues. Firstly, some category-...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology

ACM Transactions on Intelligent Systems and Technology Volume 9, Issue 4

Research Survey and Regular Papers

July 2018

280 pages

ISSN:2157-6904

EISSN:2157-6912

DOI:10.1145/3183892

Editor:
Yu Zheng
Microsoft Research, China

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 January 2018

Accepted: 01 November 2017

Revised: 01 October 2017

Received: 01 July 2017

Published in TIST Volume 9, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Survey
Research
Refereed

Funding Sources

Excellent Doctorate Foundation through Northwestern Polytechnical University
National Science Foundation of China
Doctorate Foundation through Northwestern Polytechnical University

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

94
Total Citations
View Citations
1,292
Total Downloads

Downloads (Last 12 months)59
Downloads (Last 6 weeks)3

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhu JCai WZhang MLin YLiu M(2025)Saliency detection for underwater moving object with sonar based on motion estimation and multi-trajectory analysisPattern Recognition10.1016/j.patcog.2024.111043158(111043)Online publication date: Feb-2025
https://doi.org/10.1016/j.patcog.2024.111043
Ge YPan JRen JHe MBi HZhang Q(2025)Co-salient object detection with consensus mining and consistency cross-layer interactive decodingImage and Vision Computing10.1016/j.imavis.2025.105414154(105414)Online publication date: Feb-2025
https://doi.org/10.1016/j.imavis.2025.105414
Guan YQiu YLeng JYang FYu SLiu YFeng YZhu YZhou LLiang YZhang CLi CGuo MTsafrir DMUSUVATHI MGupta RAbu-Ghazaleh N(2024)Amanda: Unified Instrumentation Framework for Deep Neural NetworksProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 110.1145/3617232.3624864(1-18)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3617232.3624864
Chakraborty SNaha SBastan MK C ASamaras D(2024)Unsupervised and semi-supervised co-salient object detection via segmentation frequency statistics2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00040(331-341)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00040
Apostol ETruică CPaschke A(2024)ContCommRTD: A Distributed Content-Based Misinformation-Aware Community Detection System for Real-Time Disaster ReportingIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.341723236:11(5811-5822)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1109/TKDE.2024.3417232
Xiao HTang LLi BLuo ZLi S(2024)Zero-Shot Co-Salient Object Detection FrameworkICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10448084(4010-4014)Online publication date: 14-Apr-2024
https://doi.org/10.1109/ICASSP48485.2024.10448084
Zhu JGuo QJuefei-Xu FHuang YLiu YPu G(2024)Cosalpure: Learning Concept from Group Images for Robust Co-Saliency Detection2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00352(3669-3678)Online publication date: 16-Jun-2024
https://doi.org/10.1109/CVPR52733.2024.00352
Zhang GNiu DWang HTang YZang ZHuang Q(2024)STFformer: An Effective PM2.5 Prediction Model2024 36th Chinese Control and Decision Conference (CCDC)10.1109/CCDC62350.2024.10587392(5131-5136)Online publication date: 25-May-2024
https://doi.org/10.1109/CCDC62350.2024.10587392
Tan ZGu XCheng Q(2024)Co-saliency detection with two-stage co-attention mining and individual calibrationEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107201127:PAOnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.engappai.2023.107201
Dong PWang BCong RSun HLi C(2024)Transformer with large convolution kernel decoder network for salient object detection in optical remote sensing imagesComputer Vision and Image Understanding10.1016/j.cviu.2023.103917240(103917)Online publication date: Mar-2024
https://doi.org/10.1016/j.cviu.2023.103917
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents