Abstract
In the previous work of affective video analysis, supervised learning methods are frequently used as classifiers. However, labeling abundant examples is time consuming and even impossible for it needs annotation from human beings. While unlabeled video clips are easy to be obtained and they are adequate. In this paper, we present a semi- supervised approach to recognize emotions from videos. Firstly, visual and audio features are extracted. Then bivariate correlation is used to select sensitive features. After that, low density separation, a semi-supervised learning algorithm, is adopted as the classifier. The comparative experiments on our own constructed database showed that the semi-supervised algorithm performs better than supervised one, illuminating the effectiveness and feasibility of our approach.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Nack, F., Dorai, C., Venkatesh, S.: Computational media aesthetics: finding meaning beautiful. IEEE Multimedia 8(4), 10–12 (2001)
Kang, H.-B.: Affective Contents Retrieval from Video with Relevance Feedback. Digital Libraries: Technology and Management of Indigenous Knowledge for Global Access, 243–252 (2003)
Hanjalic, A., Xu, L.Q.: Affective video content representation and modeling. IEEE Transactions on Multimedia 7(1), 143–154 (2005)
Xu, M., Jin, J.S., Luo, S., Duan, L.: Hierarchical movie affective content analysis based on arousal and valence features. In: Proceeding of the 16th ACM International Conference on Multimedia, Vancouver, British Columbia, Canada, pp. 677–680 (2008)
Arifin, S.: Affective Level Video Segmentation by Utilizing the Pleasure-Arousal-Dominance Information. IEEE Transactions on Multimedia 10(7), 1325–1341 (2008)
Wang, S.F., Wang, X.F.: Emotional semantic detection from multimedia: a brief overview. Kansei Engineering and Soft Computing: Theory and Practice, pp. 126–146. IGI Global, Pennsylvania (2010)
Zhu, X.: Semi-Supervised Learning Literature Survey (2008), http://pages.cs.wisc.edu/jerryzhu/research/ssl/semireview.html
Schuller, B., Dorfner, J., Rigoll, G.: Determination of Non-Prototypical Valence and Arousal in Popular Music: Features and Performances. EURASIP Journal on Audio, Speech, and Music Processing, Special Issue on Scalable Audio-Content Analysis 2010, 19 pages (2010) Article ID 735854
Boersma, P., Weenink, D.: Praat: doing phonetics by computer. Computer Program (2008)
Wang, H.L., Cheong, L.-F.: Affective Understanding in Film. IEEE Trans. Circuits System Video Technology 16(6), 689–704 (2006)
Moncrieff, S., Dorai, C., Venkatesh, S.: Affect Computing in Film through Sound Energy Dynamics. In: Proceeding of the Ninth ACM International Conference on Multimedia, Ottawa, Canada, pp. 525–527 (2001)
Chapelle, O., Zien, A.: Semi-supervised classification by low density separation. In: Proc. of the Tenth International Workshop on Artificial Intelligence and Statistics (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, S., Lin, H., Hu, Y. (2011). Affective Classification in Video Based on Semi-supervised Learning. In: Liu, D., Zhang, H., Polycarpou, M., Alippi, C., He, H. (eds) Advances in Neural Networks – ISNN 2011. ISNN 2011. Lecture Notes in Computer Science, vol 6677. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21111-9_26
Download citation
DOI: https://doi.org/10.1007/978-3-642-21111-9_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21110-2
Online ISBN: 978-3-642-21111-9
eBook Packages: Computer ScienceComputer Science (R0)