Abstract
To provide interesting videos, it is important to generate relevant tags and annotations that describe the whole video or its segment efficiently. Because generating annotations and tags is a time-consuming process, it is essential for analyzing videos without human intervention. Although there have been many studies of implicit human-centered tagging using bio-signals, most of them focus on affective tagging and tag relevance assessment. This paper proposes binary and unary classification models that recognize actions meaningful to users in videos, for example jumps in the figure skating program, using EEG features of band power (BP) values and asymmetry scores (AS). As a result, the binary and binary classification models achieved the best balanced accuracies of 52.86% and 50.06% respectively. The binary classification models showed high specificity on non-jump actions and the unary classification models showed high sensitivity on jump actions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Soleymani, M., Pantic, M.: Human-centered implicit tagging: Overview and perspectives. In: IEEE International Conference on Systems, Man, and Cybernetics, pp. 3304–3309. IEEE Press, New York (2012)
Joho, H., Jose, M.J., Valenti, R., Sebe, N.: Exploiting Facial Expressions for Affective Video Summarisation. In: ACM International Conference on Image and Video Retrieval, Article No. 31, pp. 1–8. ACM, Santorini (2009)
Peng, W.-T., et al.: Editing by Viewing: Automatic Home Video Summarization by Viewing Behavior Analysis. IEEE Transaction on Multimedia 13(3), 539–550 (2011)
Money, A.G., Agius, H.: ELVIS: Entertainment-Led Video Summaries. ACM Trans. Multimedia Computing, Communications, and Applications, 17:1–17:30 (2010)
Schaaff, K., Schultz, T.: Towards Emotion Recognition from Electroencephalographic Signals. In: 3rd IEEE International Conference on Affective Computing and Intelligent Interaction, pp. 1–6. IEEE Press, New York (2009)
Liu, Y., Sourina, O., Nguyen, M.K.: Real-Time EEG-Based Human Emotion Recognition and Visualization. In: International Conference on Cyberworlds, pp. 262–269. IEEE Press, New York (2010)
Nie, D., Wang, X.W., Shi, L.C., Lu, B.L.: EEG-based Emotion Recognition during Watching Movies. In: 5th International Conference on Neural Engineering, pp. 186–191. IEEE Press, New York (2011)
Koelstra, S., et al.: Single Trial Classification of EEG and Peripheral Physiological Signals for Recognition of Emotions Induced by Music Videos. In: Yao, Y., Sun, R., Poggio, T., Liu, J., Zhong, N., Huang, J. (eds.) BI 2010. LNCS, vol. 6334, pp. 89–100. Springer, Heidelberg (2010)
Yazdani, A., et al.: Affect Recognition Based on Physiological Changes during the Watching of Music Videos. ACM Trans. Interactive Intelligent System 2(1), 7:1–7:26 (2012)
Soleymani, M., Pantic, M.: Multimedia Implicit Tagging using EEG Signals. In: IEEE International Conference on Multimedia and Expo. IEEE Press, New York (2013)
Russell, J.A.: A Circumplex Model of Affect. Journal of Personality and Social Psychology 39(6), 1161–1178 (1980)
Aurup, G.M.M.: User Preference Extraction from Bio-signals: An Experimental Study. Master’s thesis. Concordia University (2011)
Moon, J., Kim, Y., Lee, H., Bae, C., Yoon, W.C.: Extraction of User Preference for Video Stimuli Using EEG-Based User Responses. ETRI Journal 35(6), 1105–1114 (2013)
Soleymani, M., Kaltwang, S., Pantic, M.: Human behavior sensing for tag relevance assessment. In: The 21st ACM International Conference on Multimedia, pp. 657–660. ACM, New York (2013)
Koelstra, S., Patras, I.: EEG analysis for implicit tagging of video data. In: Workshop on Affective Computing and Intelligent Interaction, pp. 1–6 (2009)
Niebles, J.C., Wang, H., Fei-Fei, L.: Unsupervised Learning of Human Action Categories Using Spatial-Temporal Words. International Journal of Computer Vision 79(3), 299–318 (2008)
Malmivou, J., Plonsey, R.: Bioelectromagnetism: Principles and Applications of Bioelectric and Biomagnetic Fields, 1st edn. Oxford University Press, New York (1995)
Petrantonakis, P.C., Hadjileontiadis, L.J.: Emotion Recognition from Brain Signals Using Hybrid Adaptive Filtering and Higher Order Crossings Analysis. IEEE Trans. Affective Computing 1(2), 81–97 (2010)
Sörnmo, L., Laguna, P.: Bioelectrical Processing in Cardiac and Neurological Applications, 1st ed. Elsevier Academic Press, Waltham (2005)
Iscana, Z., Dokura, Z., Demiralp, T.: Classification of Electroencephalogram Signals with Combined Time and Frequency Features. Expert Systems with Applications 38(8), 10499–10505 (2011)
Allen, J.J., et al.: The Stability of Resting Frontal Electroencephalographic Asymmetry in Depression. Psychophysiology 41(2), 269–280 (2004)
Altman, N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician 46(3), 175–185 (1992)
Artificial neural networks, http://en.wikipedia.org/wiki/Artificial_neural_networks
Naive Bayes classifier, http://en.wikipedia.org/wiki/Naive_Bayes_classifier
Support vector machine, http://en.wikipedia.org/wiki/Support_vector_machine
Schölkopf, B., Platt, J.C., Shawe-Taylor, J., Smola, A.J., Williamson, R.C.: Estimating the support of a high-dimensional distribution. Neural Computation 13(7), 1443–1471 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Moon, J., Kwon, Y., Kang, K., Bae, C., Yoon, W.C. (2015). Recognition of Meaningful Human Actions for Video Annotation Using EEG Based User Responses. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds) MultiMedia Modeling. MMM 2015. Lecture Notes in Computer Science, vol 8936. Springer, Cham. https://doi.org/10.1007/978-3-319-14442-9_50
Download citation
DOI: https://doi.org/10.1007/978-3-319-14442-9_50
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14441-2
Online ISBN: 978-3-319-14442-9
eBook Packages: Computer ScienceComputer Science (R0)