Markos Avlonitis
Konstantinos Chorianopoulos
David Ayman Shamma
ABSTRACT
Semantic video research has employed crowdsourcing techniques on social web video data sets such as comments, tags, and annotations, but these data sets require an extra effort on behalf of the user. We propose a pulse modeling method, which analyzes implicit user interactions within web video, such as rewind. In particular, we have modeled the user information seeking behavior as a time series and the semantic regions as a discrete pulse of fixed width. We constructed these pulses from user interactions with a documentary video that has a very rich visual style with too many cuts and camera angles/frames for the same scene. Next, we calculated the correlation coefficient between dynamically detected user pulses at the local maximums and the reference pulse. We have found when people are actively seeking for information in a video, their activity (these pulses) significantly matches the semantics of the video. This proposed pulse analysis method complements previous work in content-based information retrieval and provides an additional user-based dimension for modeling the semantics of a web video.
- C. Gkonela, K. Chorianopoulos. VideoSkip: event detection in social web videos with an implicit user heuristic. Multimedia Tools and Applications, http://dx.doi.org/10.1007%2fs11042-012--1016--1, 2012.Google Scholar
- D. A. Shamma, R. Shaw, P. L. Shafton, and Y. Liu. Watch what i watch: using community activity to understand content. In MIR '07: Proceedings of the international workshop on Workshop on multimedia information retrieval, pages 275--284, New York, NY, USA, 2007. ACM. Google ScholarDigital Library
- E. Vanmarcke. Random fields: Analysis and Synthesis. Cambridge, MA: MIT Press, 1983.Google Scholar
Index Terms
- Crowdsourcing user interactions within web video through pulse modeling
Recommendations
Predicting user activity level in social networks
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge ManagementThe study of users' social behaviors has gained much research attention since the advent of various social media such as Facebook, Renren and Twitter. A major kind of applications is to predict a user's future activities based on his/her historical ...
Crowdsourcing user interactions with the video player
WebMedia '12: Proceedings of the 18th Brazilian symposium on Multimedia and the webEvery second millions of users enjoy content streaming on diverse video players (e.g., Web, Apps, social networks) and create billions of interactions within online video, such as play, pause, seek/scrub. This collective intelligence of video viewers ...
A framework for WWW user activity analysis based on user interest
User activity plays an important role in the operation of many kinds of websites. Significant progress has been made on user activity modeling by researchers in many kinds of Web information process fields, such as Web log mining, blogs social network ...
Comments