Skip to main content

A Novel Emotional Saliency Map to Model Emotional Attention Mechanism

  • Conference paper
  • First Online:
MultiMedia Modeling (MMM 2016)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9517))

Included in the following conference series:

Abstract

Saliency map analysis provides an alternative methodology to image semantic understanding in many applications such as adaptive content delivery and region-based image retrieval. A lot of visual saliency map algorithms have been proposed during the last decades. Recent psychophysical research further reveals that visual attention can be modulated and improved by the affective significance of stimuli, called Emotional Attention, which might not only supplement but also compete with other sources of top-down control on attention. Inspired by this mechanism, we propose a novel computational emotional attention model in this paper. In particular, we present an intuitive emotional saliency map computation method by calculating Minkowski-norm of pixel’s isolated saliency value and multi-scale local contrast information in color emotion space. Experimental results on diverse image datasets show that the proposed model can outperform some current state-of-the-art visual saliency map.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Fecteaua, J.H., Munoz, D.P.: Salience, relevance, and firing: a priority map for target selection. Trends Cogn. Sci. 10(8), 382–390 (2006)

    Article  Google Scholar 

  2. Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE TPAMI 20(11), 1254–1259 (1998)

    Article  Google Scholar 

  3. Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: CVPR, pp. 1–8 (2007)

    Google Scholar 

  4. Valenti, R., Sebe, N., Gevers, T.: Image saliency by isocentric curvedness and color. In: ICCV, pp. 2185–2192 (2009)

    Google Scholar 

  5. Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: NIPS, pp. 545–552 (2006)

    Google Scholar 

  6. Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: CVPR, pp. 1597–1604 (2009)

    Google Scholar 

  7. Eastwood, J.D., Smilek, D., Merikle, P.M.: Differential attentional guidance by unattended faces expressing positive and negative emotion. Percept. Psychophysics 63(6), 1004–1013 (2001)

    Article  Google Scholar 

  8. Vuilleumier, P.: How brains beware: neural mechanisms of emotional attention. TRENDS Cogn. Sci. 9(12), 585–594 (2005)

    Article  Google Scholar 

  9. Anderson, A.K.: Affective influences on the attentional dynamics supporting awareness. J. Exp. Psychol. 134(2), 258–281 (2005)

    Article  Google Scholar 

  10. Carretie, L., Hinojosa, J.A., Martin-Loeches, M.: Automatic attention to emotional stimuli: neural correlates. Hum. Brain Mapp. 22(4), 290–299 (2004)

    Article  Google Scholar 

  11. Ou, L., Luo, M., Woodcock, A., Wright, A.: A study of colour emotion and colour preference. Part I. Col. Res. App. 29(3), 232–240 (2004)

    Article  Google Scholar 

  12. Andersen, S.K.: Color-selective attention need not be mediated by spatial attention. J. Vis. 9(6), 1–7 (2009)

    Article  Google Scholar 

  13. Liu, T., Sun, J., Zheng, N.N., Tang, X.: Learning to detect a salient object. In: CVPR, pp. 1–8 (2007)

    Google Scholar 

  14. Li, B., Xiong, W., Wu, O., et al.: Horror image recognition based on context-aware multi-instance learning. IEEE Trans. Image Process. 24(12), 5193–5205 (2015)

    Article  Google Scholar 

  15. Peng, H., Li, B., Ji, R., Hu, W.: Salient object detection via low-rank and structured sparse matrix decomposition. In: The 27th AAAI Conference on Artificial Intelligence (2013)

    Google Scholar 

  16. Li, B., Xiong, W., Hu, W.: Visual saliency map from tensor analysis. In: The 26th AAAI Conference on Artificial Intelligence (2012)

    Google Scholar 

Download references

Acknowlegment

This work is supported by the National Nature Science Foundation of China (No. 61303086, 61370038, 61571045, 61472227, 61503219, 61572296), National Nature Science Foundation of Shandong province (No. ZR2013FM015, ZR2015FL020) and Domestic Visiting Schoars Project of Shandong Provincial Education Department.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bing Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Ding, X., Huang, L., Li, B., Lang, C., Hua, Z., Wang, Y. (2016). A Novel Emotional Saliency Map to Model Emotional Attention Mechanism. In: Tian, Q., Sebe, N., Qi, GJ., Huet, B., Hong, R., Liu, X. (eds) MultiMedia Modeling. MMM 2016. Lecture Notes in Computer Science(), vol 9517. Springer, Cham. https://doi.org/10.1007/978-3-319-27674-8_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27674-8_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27673-1

  • Online ISBN: 978-3-319-27674-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics