skip to main content
10.1145/3390557.3394125acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiciaiConference Proceedingsconference-collections
research-article

Saliency detection based on weighted color contrast of image patch

Published: 04 June 2020 Publication History

Abstract

Image saliency analysis is an important research content in the field of computer vision. At present, the main method of saliency analysis is to measure the saliency of single pixel or regular image patch. It is easy to be affected by image texture, noise and other factors, and some important information is lost in the process of segmentation, which makes it difficult to extract salient objects from the image. Therefore, a saliency detection algorithm based on weighted color contrast of image patch is proposed. Firstly, the original image is divided into different size and non-overlapping image patch structure. Then, the color contrast of the image patch, the number of pixels included and the spatial distance between the two image patches are calculated. Considering the influence of spatial distance between image patches on saliency value, the weighted color contrast model of image patch is used to detect salient region. Finally, considering the influence of spatial distance between pixels on saliency value, the salient region is enhanced by calculating the distance between each pixel and the center of the salient region. In order to evaluate this algorithm, we use the largest publicly available data set in the world for testing. Experimental results show that the proposed method has better precision and recall rate, can significantly suppress the influence of complex texture and noise.

References

[1]
Fu K, Gu I, Yang J. Saliency detection by fully learning a continuous conditional random field. IEEE Transactions on Multimedia, 2017, PP (99):1--1.
[2]
Li G, Yu Y. Visual saliency detection based on multiscale deep CNN features. IEEE Transactions on Image Processing, 2016, 25(11): 5012--5024.
[3]
Zhang X D, Lu Y, Zhai Y W, et al. Image saliency detection combined with regional covariance analysis[J]. Chinese Journal of Image and Graphics, 2018, 21(5): 605--615.
[4]
Koch C, Ullman S. Shifts in selective visual attention: towards the underlying neural circuitry[J]. Journal of Human Neurobiology, 1985, 4(4): 219--227.
[5]
Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(11):1254--1259.
[6]
Harel J, Koch C, Perona P. Graph-based visual saliency. In: Proceedings of the 2006 MIT Annual Conference on Neural Information Processing Systems. Vancouver, Canada: The MIT Press, 2006:545--552.
[7]
Goferman S, Zelnik-Manor L, Tal A. Context-aware saliency detection. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE, 2010:2376--2383.
[8]
Wang M, Konrad J, Ishwar P, Jing K, Rowley H A. Image saliency: from intrinsic to extrinsic context. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Colorado Springs, USA: IEEE, 2011:417--424.
[9]
Cheng M M, Zhang G X, Mitra N J, Huang X L, Hu S M. Global contrast based salient region detection. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Colorado Springs, USA: IEEE, 2011:409--416.
[10]
Humphrey K, Underwood G. Domain knowledge moderates the influence of visual saliency in scene recognition[J]. British Journal of Psychology, 2009, 100(2): 377--398.
[11]
Achanta R, Hemami S, Estrada F, et al. Frequency-tuned salient region detection[C]//IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2009). 2009 (CONF): 1597--1604.
[12]
Weijer J V D, Gevers T, Bagdanov A D. Boosting color saliency in image feature detection. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2006, 28(1): 150--156.
[13]
Harel J, Koch C, Perona P. Graph-based visual saliency[J]. Adv. In Neural Information Proc. Systems, 2007(19): 545--552.
[14]
Liu Y, Zhang Q, Han J, et al. Salient object detection employing robust sparse representation and local consistency[J]. Image and Vision Computing, 2018, 69(1): 155--167.
[15]
Hou X, Harel J, Koch C. Image Signature: Highlighting Sparse Salient Regions[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2012, 34(1):194.
[16]
Borji A, Cheng M M, Jiang H, et al. Salient object detection: a survey[J]. ArXiv Preprint, 2014, 2 (4): 1411--5878.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICIAI '20: Proceedings of the 2020 the 4th International Conference on Innovation in Artificial Intelligence
May 2020
271 pages
ISBN:9781450376587
DOI:10.1145/3390557
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • The Hong Kong Polytechnic: The Hong Kong Polytechnic University
  • Xi'an Jiaotong-Liverpool University: Xi'an Jiaotong-Liverpool University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Image Patch Structure
  2. Image Salient Region
  3. Visual Attention Mechanism
  4. Weighted Color Contrast

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICIAI 2020

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 40
    Total Downloads
  • Downloads (Last 12 months)3
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Mar 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media