Abstract
In this paper, we present a user-based event detection method for social web videos. Previous research in event detection has focused on content-based techniques, such as pattern recognition algorithms that attempt to understand the contents of a video. There are few user-centric approaches that have considered either search keywords, or external data such as comments, tags, and annotations. Moreover, some of the user-centric approaches imposed an extra effort to the users in order to capture required information. In this research, we are describing a method for the analysis of implicit users’ interactions with a web video player, such as pause, play, and thirty-seconds skip or rewind. The results of our experiments indicated that even the simple user heuristic of local maxima might effectively detect the same video-events, as indicated manually. Notably, the proposed technique was more accurate in the detection of events that have a short duration, because those events motivated increased user interaction in video hot-spots. The findings of this research provide evidence that we might be able to infer semantics about a piece of unstructured data just from the way people actually use it.
Similar content being viewed by others
References
Aisopos F, Papadakis G and Varvarigou T (2011) Sentiment analysis of social media content using N-Gram graphs. In Proceedings of the 3rd ACM SIGMM international workshop on Social media (WSM ’11). ACM, New York, NY, USA, 9–14
Cha S, Kwak M, Rodriguez H, Ahn P and Moon Y (2007) I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. Proceedings of the 7th ACM SIGCOMM Conference on internet measurement. ACM, San Diego, California, USA, New York, NY, pp 1–14
Chen L, Chen G, Xu C, March J and Benford S (2008) EmoPlayer: a media player for video clips with affective annotations. Int Comp pp 17–28
Crockford C and Agius H (2006) An empirical investigation into user navigation of digital video using the VCR-like control set. Int J Hum Comput Stud pp 340–355
Doulamis AD, Doulamis ND (2004) Optimal content-based video decomposition for interactive video navigation. IEEE Trans Circ Syst Video Tech 14(6):757–775
Doulamis DA, Gonzàlez J (2010) First ACM international workshop on analysis and retrieval of tracked events and motion in imagery streams (ARTEMI. ACM Multimedia 2010:1749–1750
Drucker S, Glatzer A and Mar SD, Wong C (2002) SmartSkip: consumer level browsing and skipping of digital video content. In Proceedings of the SIGCHI Conference on human factors in computing systems: changing our world, changing ourselves, Minneapolis, Minnesota, USA, pp 219–226
Girgensohn A, Boreczky J, Wilcox L (2001) Keyframe-based user interfaces for digital video. Computer 34:61–67
He L, Sanocki E, Gupta A and Grudin J (1999) Auto-summarization of audio-video presentations. Proceedings of the seventh ACM international conference on Multimedia (Part 1) - MULTIMEDIA ’99, ACM Press, New York, New York, USA, pp 489–498
Hjelsvold R, Vdaygiri S and Léauté Y (2001) Web-based personalization and management of interactive video. Proceedings of the tenth international conference on World Wide Web - WWW ’01, pp 129–139
Kelly D (2009) Methods for evaluating interactive information retrieval systems with users, foundations and trends in information retrieval Vol. 3: No 1–2, pp 1–224
Kim J, Kim H, Park K (2006) Towards optimal navigation through video content on interactive TV. Inter Comp 18:723–746
Leftheriotis I, Gkonela C and Chorianopoulos K (2010) Efficient video indexing on the web: a system that leverages user interactions with a video player. In Proceedings of the 2nd International Conference on User-Centric Media (UCMEDIA)
Li FC, Gupta A, Sanocki E, He L-W and Rui Y (2000) Browsing digital video. Proceedings of the SIGCHI conference on human factors in computing systems - CHI ’00, vol. 2, pp 169–176
Ma Y-F and Zhang H-J (2005) Video snapshot: a bird view of video sequence. 11th International Multimedia Modelling Conference, IEEE, pp 94–101
Mitra S, Agrawal M, Yadav A, Carlsson N, Eager D and Mahanti A (2011) Characterizing web-based video sharing workloads. ACM Trans. Web 5, 2, Article 8 (May 2011)
Ntalianis KS, Doulamis AD, Sapatsoulis NT and Doulamis N (2010) Human action annotation, modeling and analysis based on implicit user interaction. Multimedia Tools Appl. 50, 1 (October 2010), 199–225
Peng W-T, Chu W-T, Chang C-H, Chou C-N, Huang W-J, Chang W-Y, Hung Y-P (2011) Editing by viewing: automatic home video summarization by viewing behavior analysis. IEEE Trans Multimed 13(3):539–550
Shamma DA, Shaw R, Shafton PL and Liu Y (2007) Watch what I watch: using community activity to understand content. Proceedings of the international workshop on Workshop on multimedia information retrieval - MIR ’07, N. ACM, ACM Press, New York, ed., Augsburg, Bavaria, Germany, p 275
Shen X, Tan B and Zhai CX (2005) Implicit user modeling for personalized search. In Proceedings of the 14th ACM international conference on Information and knowledge management (CIKM ’05). ACM, New York, NY, USA, 824–831. SOCIOS EU project: http://www.sociosproject.eu/
Syeda-Mahmood T and Ponceleon D (2001) Learning video browsing behavior and its application in the generation of video previews. Proceedings of the ninth ACM international conference on Multimedia - MULTIMEDIA ’01, ACM Press, New York, New York, USA, p 119
Takahashi Y, Nitta N and Babaguchi N (2005) Video summarization for large sports video archives. In Proceedings of the 13th Annual ACM international Conference on Multimedia, Hilton, Singapore, ACM, New York, pp 820–828
Yu B, Ma W-Y, Nahrstedt K and Zhang H-J (2003) Video summarization based on user log enhanced link analysis. Proceedings of the eleventh ACM international conference on Multimedia - MULTIMEDIA ’03, ACM Press, New York, New York, USA, p 382
Zhang D, Guo B, Yu Z (2011) The emergence of social and community intelligence. Computer 44(7):21–28
Acknowledgements
We are thankful to Ioannis Leftheriotis for his work on early system prototypes and to the participants of the user study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gkonela, C., Chorianopoulos, K. VideoSkip: event detection in social web videos with an implicit user heuristic. Multimed Tools Appl 69, 383–396 (2014). https://doi.org/10.1007/s11042-012-1016-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-012-1016-1