Skip to main content
Log in

VideoSkip: event detection in social web videos with an implicit user heuristic

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we present a user-based event detection method for social web videos. Previous research in event detection has focused on content-based techniques, such as pattern recognition algorithms that attempt to understand the contents of a video. There are few user-centric approaches that have considered either search keywords, or external data such as comments, tags, and annotations. Moreover, some of the user-centric approaches imposed an extra effort to the users in order to capture required information. In this research, we are describing a method for the analysis of implicit users’ interactions with a web video player, such as pause, play, and thirty-seconds skip or rewind. The results of our experiments indicated that even the simple user heuristic of local maxima might effectively detect the same video-events, as indicated manually. Notably, the proposed technique was more accurate in the detection of events that have a short duration, because those events motivated increased user interaction in video hot-spots. The findings of this research provide evidence that we might be able to infer semantics about a piece of unstructured data just from the way people actually use it.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://www.youtube.com/watch?v=GOQfIXxbjlE

  2. http://www.youtube.com/watch?v=Z09ythJT9Wk

  3. http://www.youtube.com/watch?v=LzkYvtqlT5I

References

  1. Aisopos F, Papadakis G and Varvarigou T (2011) Sentiment analysis of social media content using N-Gram graphs. In Proceedings of the 3rd ACM SIGMM international workshop on Social media (WSM ’11). ACM, New York, NY, USA, 9–14

  2. Cha S, Kwak M, Rodriguez H, Ahn P and Moon Y (2007) I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. Proceedings of the 7th ACM SIGCOMM Conference on internet measurement. ACM, San Diego, California, USA, New York, NY, pp 1–14

  3. Chen L, Chen G, Xu C, March J and Benford S (2008) EmoPlayer: a media player for video clips with affective annotations. Int Comp pp 17–28

  4. Crockford C and Agius H (2006) An empirical investigation into user navigation of digital video using the VCR-like control set. Int J Hum Comput Stud pp 340–355

  5. Doulamis AD, Doulamis ND (2004) Optimal content-based video decomposition for interactive video navigation. IEEE Trans Circ Syst Video Tech 14(6):757–775

    Article  Google Scholar 

  6. Doulamis DA, Gonzàlez J (2010) First ACM international workshop on analysis and retrieval of tracked events and motion in imagery streams (ARTEMI. ACM Multimedia 2010:1749–1750

    Google Scholar 

  7. Drucker S, Glatzer A and Mar SD, Wong C (2002) SmartSkip: consumer level browsing and skipping of digital video content. In Proceedings of the SIGCHI Conference on human factors in computing systems: changing our world, changing ourselves, Minneapolis, Minnesota, USA, pp 219–226

  8. Girgensohn A, Boreczky J, Wilcox L (2001) Keyframe-based user interfaces for digital video. Computer 34:61–67

    Article  Google Scholar 

  9. He L, Sanocki E, Gupta A and Grudin J (1999) Auto-summarization of audio-video presentations. Proceedings of the seventh ACM international conference on Multimedia (Part 1) - MULTIMEDIA ’99, ACM Press, New York, New York, USA, pp 489–498

  10. Hjelsvold R, Vdaygiri S and Léauté Y (2001) Web-based personalization and management of interactive video. Proceedings of the tenth international conference on World Wide Web - WWW ’01, pp 129–139

  11. Kelly D (2009) Methods for evaluating interactive information retrieval systems with users, foundations and trends in information retrieval Vol. 3: No 1–2, pp 1–224

  12. Kim J, Kim H, Park K (2006) Towards optimal navigation through video content on interactive TV. Inter Comp 18:723–746

    Google Scholar 

  13. Leftheriotis I, Gkonela C and Chorianopoulos K (2010) Efficient video indexing on the web: a system that leverages user interactions with a video player. In Proceedings of the 2nd International Conference on User-Centric Media (UCMEDIA)

  14. Li FC, Gupta A, Sanocki E, He L-W and Rui Y (2000) Browsing digital video. Proceedings of the SIGCHI conference on human factors in computing systems - CHI ’00, vol. 2, pp 169–176

  15. Ma Y-F and Zhang H-J (2005) Video snapshot: a bird view of video sequence. 11th International Multimedia Modelling Conference, IEEE, pp 94–101

  16. Mitra S, Agrawal M, Yadav A, Carlsson N, Eager D and Mahanti A (2011) Characterizing web-based video sharing workloads. ACM Trans. Web 5, 2, Article 8 (May 2011)

  17. Ntalianis KS, Doulamis AD, Sapatsoulis NT and Doulamis N (2010) Human action annotation, modeling and analysis based on implicit user interaction. Multimedia Tools Appl. 50, 1 (October 2010), 199–225

    Google Scholar 

  18. Peng W-T, Chu W-T, Chang C-H, Chou C-N, Huang W-J, Chang W-Y, Hung Y-P (2011) Editing by viewing: automatic home video summarization by viewing behavior analysis. IEEE Trans Multimed 13(3):539–550

    Article  Google Scholar 

  19. Shamma DA, Shaw R, Shafton PL and Liu Y (2007) Watch what I watch: using community activity to understand content. Proceedings of the international workshop on Workshop on multimedia information retrieval - MIR ’07, N. ACM, ACM Press, New York, ed., Augsburg, Bavaria, Germany, p 275

  20. Shen X, Tan B and Zhai CX (2005) Implicit user modeling for personalized search. In Proceedings of the 14th ACM international conference on Information and knowledge management (CIKM ’05). ACM, New York, NY, USA, 824–831. SOCIOS EU project: http://www.sociosproject.eu/

  21. Syeda-Mahmood T and Ponceleon D (2001) Learning video browsing behavior and its application in the generation of video previews. Proceedings of the ninth ACM international conference on Multimedia - MULTIMEDIA ’01, ACM Press, New York, New York, USA, p 119

  22. Takahashi Y, Nitta N and Babaguchi N (2005) Video summarization for large sports video archives. In Proceedings of the 13th Annual ACM international Conference on Multimedia, Hilton, Singapore, ACM, New York, pp 820–828

  23. Yu B, Ma W-Y, Nahrstedt K and Zhang H-J (2003) Video summarization based on user log enhanced link analysis. Proceedings of the eleventh ACM international conference on Multimedia - MULTIMEDIA ’03, ACM Press, New York, New York, USA, p 382

  24. Zhang D, Guo B, Yu Z (2011) The emergence of social and community intelligence. Computer 44(7):21–28

    Article  Google Scholar 

Download references

Acknowledgements

We are thankful to Ioannis Leftheriotis for his work on early system prototypes and to the participants of the user study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Konstantinos Chorianopoulos.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gkonela, C., Chorianopoulos, K. VideoSkip: event detection in social web videos with an implicit user heuristic. Multimed Tools Appl 69, 383–396 (2014). https://doi.org/10.1007/s11042-012-1016-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1016-1

Keywords

Navigation