ABSTRACT
Computational analysis and prediction of digital media interestingness is a challenging task, largely driven by subjective nature of interestingness. Several attempts were made to construct a reliable measure and obtain a better understanding of interestingness based on various psychological study results. However, most current works focus on interestingness prediction for images. While the video affective analysis has been studied for quite some time, there are few works that explictly try to predict interestingness of videos. In this work, we extend a recent pilot study on the video interestingness prediction by using a mid-level representation of sentiment (emotion) sequence. We evaluate our proposed framework on three datasets including the datasets proposed by the pilot study and show that the result effectively verifies a promising utility of the approach.
- E. Acar. Learning Representations for A_ective Video Understanding. In ACM MM, 2013. Google ScholarDigital Library
- D. Berlyne. Conict, arousal, and curiosity. McGraw-Hill, 1960.Google Scholar
- I. Biederman and E. Vessel. Perceptual Pleasure and the Brain. American Scientist, 2006.Google ScholarCross Ref
- D. Borth, R. Ji, T. Chen, T. Breuel, and S.-F. Chang. Large-scale Visual Sentiment Ontology and Detectors Using Adjective Noun Pairs. In ACM MM, 2013. Google ScholarDigital Library
- N. Dalal and B. Triggs. Histogram of oriented gradients for human detection. In IEEE CVPR, 2005. Google ScholarDigital Library
- R. Datta, D. Joshi, J. Li, and J. Wang. Studying Aesthetics in Photographic Images Using a Computational Approach. In ECCV, 2006. Google ScholarDigital Library
- S. Dhar, V. Ordonez, and T. Berg. High Level Describable Attributes for Predicting Aesthetics and Interestingness. In IEEE CVPR, 2011. Google ScholarDigital Library
- M. Gönen and E. Alpaydin. Multiple Kernel Learning Algorithms. JMLR, 12:2211--2268, 2011. Google ScholarDigital Library
- H. Grabner, F. Nater, M. Druey, and L. V. Gool. Visual interestingness in image sequences. In ACM MM, 2013. Google ScholarDigital Library
- M. Gygli, H. Grabner, H. Riemenschneider, F. Nater, and L. V. Gool. The interestingness of images. In ICCV, 2013. Google ScholarDigital Library
- R. Herbrich, T. Graepel, and K. Obermayer. Large Margin Rank Boundaries for Ordinal Regression, chapter 7, pages 115--132. MIT Press, 2000.Google Scholar
- T. Jaakkola and D. Haussler. Exploiting generative models in discriminative classifiers. In NIPS, 1998. Google ScholarDigital Library
- Y.-G. Jiang, Y. Wang, R. Feng, X. Xue, Y. Zheng, and H. Yang. Understanding and predicting interestingness of videos. In AAAI, 2013.Google ScholarDigital Library
- S. Koelstra, C. Mühl, M. Soleymani, J.-S. Lee, A. Yazdani, T. Ebrahimi, T. Pun, A. Nijholt, and I. Patras. DEAP: A Database for Emotion Analysis Using Physiological Signals. IEEE Trans. Affective Computing, 3:18--31, 2012. Google ScholarDigital Library
- L.-J. Li, H. Su, E. P. Xing, and L. Fei-Fei. Object Bank: A High-Level Image Representation for Scene Classification and Semantic Feature Sparsification. In NIPS, 2010.Google Scholar
- F. Liu, Y. Niu, and M. Gleicher. Using Web Photos for Measuring Video Frame Interestingness. In IJCAI, 2009. Google ScholarDigital Library
- D. G. Lowe. Distinctive image features from scale-invariant keypoints. IJCV, 60(2):91--110, Nov. 2004. Google ScholarDigital Library
- J. Machajdik and A. Hanbury. A_ective image classification using features inspired by psychology and art theory. In ACM MM, 2010. Google ScholarDigital Library
- N. Murray, L. Marchesotti, and F. Perronnin. AVA: A Large-Scale Database for Aesthetic Visual Analysis. In IEEE CVPR, 2012.Google ScholarCross Ref
- F. Perronnin, J. S_anchez, and T. Mensink. Improving the fisher kernel for large-scale image classification. In ECCV, 2010. Google ScholarDigital Library
- R. Plutchik and H. Kellerman. Emotion: Theory, Research, and Experience Volume 1. Academic Press,Google Scholar
- T. Schaul, L. Pape, T. Glasmachers, V. Graziano, and J. Schmidhuber. Coherence Progress: A Measure of Interestingness Based on Fixed Compressors. In Artificial General Intelligence, 2011. Google ScholarDigital Library
- K. R. Scherer. What are emotions? And how can they be measured? Social Science Information, 44:695--729, 2005.Google ScholarCross Ref
- E. Shechtman and M. Irani. Matching Local Self-Similarities across Images and Videos. In IEEE CVPR, 2007.Google ScholarCross Ref
- M. Soleymani, G. Chanel, J. J. Kierkels, and T. Pun. Affective ranking of movie scenes using physiological signals and content analysis. In Proc. of the 2nd ACM Workshop on MM Semantics, MS '08, pages 32--39, New York, NY, USA, 2008. ACM. Google ScholarDigital Library
- R. Srivastava, S. Yan, T. Sim, and S. Roy. Recognizing emotions of characters in movies. In IEEE ICASSP, 2012.Google ScholarCross Ref
- L. Torresani, M. Szummer, and A. Fitzgibbon. Efficient Object Category Recognition Using Classemes. In ECCV, 2010. Google ScholarDigital Library
- J. Wang, C. Xu, E. Chng, and Q. Tian. Sports highlight detection from keyword sequences using hmm. In IEEE ICME, volume 1, pages 599--602 Vol.1, June 2004.Google Scholar
- M. Xu, J. Jin, S. Luo, and L. Duan. Hierarchical movie a_ective content analysis based on arousal and valence features. In ACM MM, 2008. Google ScholarDigital Library
- Q. Zhang and B. Li. Relative hidden markov models for evaluating motion skills. In IEEE CVPR, 2013. Google ScholarDigital Library
Index Terms
Sentiment Flow for Video Interestingness Prediction
Recommendations
Interestingness measures for association rules: Combination between lattice and hash tables
There are many methods which have been developed for improving the time of mining frequent itemsets. However, the time for generating association rules were not put in deep research. In reality, if a database contains many frequent itemsets (from ...
Entity-level sentiment prediction in Danmaku video interaction
AbstractSentiment analysis in Danmaku video interaction aims at measuring public mood in respect of the video, which is helpful for the potential applications in behavioral science. Once these sentiments are discovered, this feedback can help video ...
Revisiting Interestingness Measures for Knowledge Discovery in Databases
ACCT '12: Proceedings of the 2012 Second International Conference on Advanced Computing & Communication TechnologiesThe voluminous amount of data stored in databases contains hidden knowledge which could be valuable to improve decision making process of any organization. As it is not humanely possible to analyze large databases, it has become essential to apply ...
Comments