Jie Liu
ABSTRACT
With the development of information technology and networks, images can be seen everywhere in life. When people browse magazines and the Internet, they come into contact with thousands of images, some of which remain in people's memories, while others are forgotten. Isola et al. first proposed the concept of image memorability and proved that image memorability is an intrinsic and stable attribute of images and can be shared among different viewers. Image memorability prediction has important research value and can be applied to education, advertising and other fields. In order to promote the research of image memorability prediction, the main theories and methods are summarized. Based on the comparison and analysis of the literatures related to image memorability prediction, this paper firstly reviews the proposal and quantification of the concept of image memorability. The features that affect the image memorability and the methods for extracting features are analyzed. The prediction of predictive image memorability is introduced in detail. The prediction is constructed based on Support Vector Machine and Convolution Neural Network and using different features that affect image memorability. Finally, the future work of image memorability is summarized and forecasted.
- Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A.. 2008. Visual long-term memory has a massive capacity for object details. In Proceedings of the National Academy of Sciences,105(38), 14325--14329.Google Scholar
Cross Ref
- Hunt, R. R., & Worthen, J. B. 2006. Distinctiveness and memory. New York, NY: Oxford University Press.Google Scholar
- Isola, P., Xiao, J., Torralba, A., & Oliva, A.. 2011. What makes an image memorable?. In Computer Vision & Pattern Recognition. IEEE. Google ScholarDigital Library
- Isola, P., Xiao, J., Parikh D., Torralba A., & Oliva, A.. 2014. What makes a photograph memorable?. In IEEE. Transactions on Pattern Analysis and Machine Intelligence,36(7), 1469--1482. Google ScholarDigital Library
- Brady, T. F., Konkle, T., Alvarez, G. A., & Oliva, A.. 2008. Visual long-term memory has a massive capacity for object details. In Proceedings of the National Academy of Sciences,105(38), 14325--14329.Google ScholarCross Ref
- Konkle, T., Brady, T. F., Alvarez, G. A., & Oliva, A.. 2010. Scene memory is more detailed than you think: the role of categories in visual long-term memory. In Psychological Science, 21(11), 1551--1556.Google ScholarCross Ref
- Chang, Chih-Chunq, Lin CHih-Jen. 2011. LIBSVM:A library for support vector machines.ACM Transactions on Intelligent Systems and Technology,Vol.2,No.3,. Google ScholarDigital Library
- Goetschalckx, L., Moors, P., & Wagemans, J. 2017. Image memorability across longer time intervals. In Memory, 1--8.Google Scholar
- Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. 2008. Labelme: a database and web-based tool for image annotation.In International Journal of Computer Vision, 77(1-3), 157--173. Google ScholarDigital Library
- Choi, M. J., Lim, J. J., Torralba, A., & Willsky, A. S.. 2010. Exploiting hierarchical context on a large database of object categories. In IEEE, CVPR,The Twenty-Third IEEE Conference on Computer Vision and Pattern Recognition, 13--18.Google Scholar
- Xiao, J., Hays, J., Ehinger, K. A., Oliva, A., & Torralba, A. 2010. SUN database: Large-scale scene recognition from abbey to zoo. In IEEE. Computer Vision & Pattern Recognition, 3485--3492.Google Scholar
- Berg, Berg, Daume, Dodge, Goyal, & Han, et al. 2012. Understanding and predicting importance in images. In CVPR,In Proceeding of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 157(10), 3562--3569. Google ScholarDigital Library
- Mancas, M., & Meur, O. L. 2014. Memorability of natural scenes: The role of attention. In IEEE International Conference on Image Processing, 196--200.Google Scholar
- Bylinskii Z. 2015.Computational understanding of image memorability.Google Scholar
- Baveye, Y., Cohendet, R., Silva, M. P. D., & Callet, P. L. 2016. Deep learning for image memorability prediction: the emotional bias. Acm on Multimedia Conference, 491--495. Google ScholarDigital Library
- Khosla, A., Xiao, J., Torralba, A., & Oliva, A. 2012. Memorability of image regions. International Conference on Neural Information Processing Systems,v1, 296--304. Google ScholarDigital Library
- Kim, J., Yoon, S., & Pavlovic, V. 2013. Relative spatial features for image memorability. In Proceedings of the 21st ACM international conference on Multimedia. ACM, 761--764. Google ScholarDigital Library
- Zarezadeh, S., Rezaeian, M., & Sadeghi, M. T. 2017. Image memorability prediction using deep features. Iranian conference on electrical engineering (icee). 2176--2181.Google ScholarCross Ref
- Khosla, A., Raju, A. S., Torralba, A., & Oliva, A. 2015. Understanding and predicting image memorability at a large scale. In IEEE International Conference on Computer Vision (ICCV), 2390--2398. Google ScholarDigital Library
- Lahrache, S., El Qadi, A., & El Ouazzani, R. 2016. Bag-of-features for image memorability evaluation. IET Computer Vision, 10(6), 577--584.Google ScholarCross Ref
- Celikkale, B., Erdem, A., & Erdem, E. 2015. Predicting memorability of images using attention-driven spatial pooling and image semantics. In Image and Vision Computing. 35--46 Google ScholarDigital Library
- Parikh, D., Parikh, D., Torralba, A., & Oliva, A. 2011. Understanding the intrinsic memorability of images. In International Conference on Neural Information Processing Systems. Google ScholarDigital Library
- Khosla, A., Xiao, J., Isola, P., Torralba, A., & Oliva, A. 2012. Image memorability and visual inception.In SIGGRAPH Asia 2012 Technical Briefs. 1--4. Google ScholarDigital Library
- Jing, P., Su, Y., Nie, L., & Gu, H. 2017. Predicting image memorability through adaptive transfer learning from external sources. IEEE Transactions on Multimedia, 19(5), 1050--1062. Google ScholarDigital Library
- Zhou, B., Garcia, A. L., Xiao, J., Torralba, A., & Oliva, A. 2015. Learning deep features for scene recognition using places database. In Advances in neural information processing systems. 487--495. Google ScholarDigital Library
- Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., & Ma, S., et al. 2014. Imagenet large scale visual recognition challenge. International Journal of Computer Vision, 115(3), 211--252. Google ScholarDigital Library
- Siarohin, A., Zen, G., Majtanovic, C., Alameda-Pineda, X., Ricci, E., & Sebe, N. 2017. How to make an image more memorable? a deep style transfer approach. ACM on International Conference on Multimedia Retrieval. Google ScholarDigital Library
- Mengjuan F., Wei J., & Weijie, M. 2017. Creating memorable video summaries that satisfy the user's intention for taking the videos, In ELSEVIER. 1911--1920. Google ScholarDigital Library
Index Terms
- Review of Image Memorability Prediction
Recommendations
Image memorability and visual inception
SA '12: SIGGRAPH Asia 2012 Technical BriefsWhen glancing at a magazine, or browsing the Internet, we are continuously being exposed to photographs. However, not all images are equal in memory; some stitch to our minds, while others are forgotten. In this paper we discuss the notion of image ...
Relative spatial features for image memorability
MM '13: Proceedings of the 21st ACM international conference on MultimediaRecent studies in image memorability showed that the memorability of an image is a measurable quantity and is closely correlated with semantic attributes. However, the intrinsic characteristics of memorability are not yet fully understood. It has been ...
Deep Learning for Image Memorability Prediction: the Emotional Bias
MM '16: Proceedings of the 24th ACM international conference on MultimediaImage memorability prediction is a recent topic in computer science. First attempts have shown that it is possible to computationally infer from the intrinsic properties of an image the extent to which it is memorable. In this paper, we introduce a fine-...
Comments