skip to main content
10.1145/3447587.3447588acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicigpConference Proceedingsconference-collections
research-article

Multi-Scale Amplitude Spectrum Substitution for Visual Saliency Detection

Published: 04 June 2021 Publication History

Abstract

Saliency detection is among the fundamental issues in simulating human visual mechanism. In this paper, we propose a new framework called Amplitude Spectrum Substitution (ASS) to summarize typical frequency-based saliency models. We then present a saliency detection model by applying the ASS method to a multi-scale structure, where substituted amplitude spectrums of all scales are trained from plenty of natural images. We further provide a novel measurement of global saliency called Salient Feature Number (SFN) to find out the optimal saliency map in the proper scale. Experimental results clearly demonstrate that the proposed model outperforms fifteen state-of-the-art competing models in predicting human fixations.

References

[1]
Ali Borji, Ming-Ming Cheng, Qibin Hou, Huaizu Jiang, and Jia Li. 2019. Salient object detection: A survey. Comp. Visual Media 5, 2, 117–150. https://doi.org/10.1007/s41095-019-0149-9
[2]
Tie Liu, Zejian Yuan, Jian Sun, Jingdong Wang, Nanning Zheng, Xiaoou Tang, and Heungyeung Shum. 2011. Learning to detect a salient object. IEEE Trans. Pattern Anal. Mach. Intell. 33,2, 353-367. https://doi.org/10.1109/TPAMI.2011.146
[3]
Qi Zheng, Shujian Yu, and Xinge You. 2020. Coarse-to-fine salient object detection with low-rank matrix recovery. Neurocomputing, 376, 232-243. https://doi.org/10.1016/j.neucom.2019.08.091
[4]
Qibin Hou, Mingming Cheng, Xiaowei Hu, Ali Borji, Zhuowen Tu, and Philip H S Torr. 2017. Deeply supervised salient object detection with short connections. In Proceedings of the 35th IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Honolulu, HI, 5300-5309. https://doi.org/10.1109/CVPR.2017.563
[5]
Ting Zhao and Xiangqian Wu. 2019. Pyramid feature attention network for saliency detection. In Proceedings of the 37th IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Long Beach, CA, 3085-3094. https://doi.org/10.1109/CVPR.2019.00320
[6]
Xiaodi Hou and Liqing Zhang. 2007. Saliency detection: A spectral residual approach. In Proceedings of the 25th IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Minneapolis, MN, 1-8. https://doi.org/10.1109/CVPR.2007.383267
[7]
Chenlei Guo, Qi Ma, and Liming Zhang. 2008. Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. In Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Anchorage, AK, 1-8. https://doi.org/10.1109/CVPR.2008.4587715
[8]
Schauerte, Boris, and Rainer Stiefelhagen. 2012. Quaternion-based spectral saliency detection for eye fixation prediction. In Proceedings of the 12th European Conference on Computer Vision (ECCV). Florence, Italy, 116-129. https://doi.org/10.1007/978-3-642-33709-3_9
[9]
Xiaodi Hou, Jonathan Harel, and Christof Koch. 2012. Image signature: Highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell. 34, 1, 194-201. https://doi.org/10.1109/TPAMI.2011.146
[10]
Dongyue Chen and Hao Chu. 2012. Scale-invariant amplitude spectrum modulation for visual saliency detection. IEEE Trans. Neural Netw. 23, 8, 1206-1214. https://doi.org/10.1109/TNNLS.2012.2198888
[11]
Jian Li, Martin D Levine, Xiangjing An, Xin Xu, and Hangen He. 2013. Visual saliency based on scale-space analysis in the frequency domain. IEEE Trans. Pattern Anal. Mach. Intell. 35, 4, 996-1010. https://doi.org/10.1109/TPAMI.2012.147
[12]
Ali Borji and Laurent Itti. 2013. State-of-the-art in visual attention modeling. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1, 185-207. https://doi.org/10.1109/TPAMI.2012.89
[13]
Neil D B Bruce and John K Tsotsos. 2010. Attention based on information maximization. Journal of Vision. 7, 9, 950-950. https://doi.org/10.1109/TPAMI.2012.89
[14]
Chuan Yang, Lihe Zhang, Huchuan Lu, Xiang Ruan and Minghsuan Yang. 2013. Saliency detection via graph-based manifold ranking In Proceedings of the 31th IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Portland, OR, 1-8. https://doi.org/10.1109/TPAMI.2012.89
[15]
Krista A Ehinger, Barbara Hidalgosotelo, Antonio Torralba, and Aude Oliva. 2009. Modelling search for people in 900 scenes: A combined source model of eye guidance. Visual Cognition. 17, 6, 945-978. https://doi.org/10.1109/TPAMI.2012.89
[16]
Gert Kootstra, Bart De Boer, and Lambert Schomaker. 2011. Predicting eye fixations on complex visual stimuli using local symmetry. Cognitive Computation. 3, 1, 223-240. https://doi.org/10.1109/TPAMI.2012.89
[17]
Tilke Judd, Krista A Ehinger, Fredo Durand, and Antonio Torralba. 2009. Learning to predict where humans look. In Proceedings of the 12th IEEE International Conference on Computer Vision (ICCV). Kyoto, Japan, 2106-2113. https://doi.org/10.1109/TPAMI.2012.89
[18]
Subramanian Ramanathan, Harish Katti, Nicu Sebe, Mohan S Kankanhalli, and Tatseng Chua. 2010. An eye fixation database for saliency detection in images. In Proceedings of the 11th European Conference on Computer Vision (ECCV). Heraklion, Crete, Greece, 30-43. https://doi.org/10.1007/978-3-642-15561-1_3
[19]
Kathryn Koehler, Fei Guo, Sheng Zhang, and Miguel P Eckstein. 2014. What do saliency models predict. Journal of Vision. 14, 3, 14-14. https://doi.org/10.1007/978-3-642-15561-1_3

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICIGP '21: Proceedings of the 2021 4th International Conference on Image and Graphics Processing
January 2021
231 pages
ISBN:9781450389105
DOI:10.1145/3447587
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Amplitude Spectrum Substitution
  2. Human Fixation Prediction
  3. Salient Feature Number
  4. Visual Saliency Detection

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICIGP 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 52
    Total Downloads
  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media