skip to main content
10.1145/3390557.3394125acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiciaiConference Proceedingsconference-collections
research-article

Saliency detection based on weighted color contrast of image patch

Published:04 June 2020Publication History

ABSTRACT

Image saliency analysis is an important research content in the field of computer vision. At present, the main method of saliency analysis is to measure the saliency of single pixel or regular image patch. It is easy to be affected by image texture, noise and other factors, and some important information is lost in the process of segmentation, which makes it difficult to extract salient objects from the image. Therefore, a saliency detection algorithm based on weighted color contrast of image patch is proposed. Firstly, the original image is divided into different size and non-overlapping image patch structure. Then, the color contrast of the image patch, the number of pixels included and the spatial distance between the two image patches are calculated. Considering the influence of spatial distance between image patches on saliency value, the weighted color contrast model of image patch is used to detect salient region. Finally, considering the influence of spatial distance between pixels on saliency value, the salient region is enhanced by calculating the distance between each pixel and the center of the salient region. In order to evaluate this algorithm, we use the largest publicly available data set in the world for testing. Experimental results show that the proposed method has better precision and recall rate, can significantly suppress the influence of complex texture and noise.

References

  1. Fu K, Gu I, Yang J. Saliency detection by fully learning a continuous conditional random field. IEEE Transactions on Multimedia, 2017, PP (99):1--1.Google ScholarGoogle Scholar
  2. Li G, Yu Y. Visual saliency detection based on multiscale deep CNN features. IEEE Transactions on Image Processing, 2016, 25(11): 5012--5024.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Zhang X D, Lu Y, Zhai Y W, et al. Image saliency detection combined with regional covariance analysis[J]. Chinese Journal of Image and Graphics, 2018, 21(5): 605--615.Google ScholarGoogle Scholar
  4. Koch C, Ullman S. Shifts in selective visual attention: towards the underlying neural circuitry[J]. Journal of Human Neurobiology, 1985, 4(4): 219--227.Google ScholarGoogle Scholar
  5. Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(11):1254--1259.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Harel J, Koch C, Perona P. Graph-based visual saliency. In: Proceedings of the 2006 MIT Annual Conference on Neural Information Processing Systems. Vancouver, Canada: The MIT Press, 2006:545--552.Google ScholarGoogle Scholar
  7. Goferman S, Zelnik-Manor L, Tal A. Context-aware saliency detection. In: Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition. San Francisco, USA: IEEE, 2010:2376--2383.Google ScholarGoogle ScholarCross RefCross Ref
  8. Wang M, Konrad J, Ishwar P, Jing K, Rowley H A. Image saliency: from intrinsic to extrinsic context. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Colorado Springs, USA: IEEE, 2011:417--424.Google ScholarGoogle Scholar
  9. Cheng M M, Zhang G X, Mitra N J, Huang X L, Hu S M. Global contrast based salient region detection. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition. Colorado Springs, USA: IEEE, 2011:409--416.Google ScholarGoogle Scholar
  10. Humphrey K, Underwood G. Domain knowledge moderates the influence of visual saliency in scene recognition[J]. British Journal of Psychology, 2009, 100(2): 377--398.Google ScholarGoogle ScholarCross RefCross Ref
  11. Achanta R, Hemami S, Estrada F, et al. Frequency-tuned salient region detection[C]//IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2009). 2009 (CONF): 1597--1604.Google ScholarGoogle Scholar
  12. Weijer J V D, Gevers T, Bagdanov A D. Boosting color saliency in image feature detection. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2006, 28(1): 150--156.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Harel J, Koch C, Perona P. Graph-based visual saliency[J]. Adv. In Neural Information Proc. Systems, 2007(19): 545--552.Google ScholarGoogle Scholar
  14. Liu Y, Zhang Q, Han J, et al. Salient object detection employing robust sparse representation and local consistency[J]. Image and Vision Computing, 2018, 69(1): 155--167.Google ScholarGoogle Scholar
  15. Hou X, Harel J, Koch C. Image Signature: Highlighting Sparse Salient Regions[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2012, 34(1):194.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Borji A, Cheng M M, Jiang H, et al. Salient object detection: a survey[J]. ArXiv Preprint, 2014, 2 (4): 1411--5878.Google ScholarGoogle Scholar

Index Terms

  1. Saliency detection based on weighted color contrast of image patch

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICIAI '20: Proceedings of the 2020 the 4th International Conference on Innovation in Artificial Intelligence
      May 2020
      271 pages
      ISBN:9781450376587
      DOI:10.1145/3390557

      Copyright © 2020 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 June 2020

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited
    • Article Metrics

      • Downloads (Last 12 months)4
      • Downloads (Last 6 weeks)1

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader