Junfeng Jiang
ABSTRACT
In this paper, we develop a video player to allow the users to do fast-forward playback based on the semantic video content. The whole system has two modules, processing and playing. In the processing part, we present a video time density function (VTDF) to describe the temporal dynamics of video data first. A VTDF-based temporal quantization method is then developed to find the best quanta and partition in the time domain. The optimal quanta are used to extract key frames. The optimal number of key frames is determined by a temporal mean square error (TMSE)-based criterion. In the playing module, we combine the key frame sequence and a set of parameters together and feed them into a triangle-based transition function to generate the sampled frames in a non-uniform way. A built video player will play all sampled frames in its intelligent fast-forward mode for a given fast-forward speed factor. The implementation of video player demonstrates the feasibility of proposed method in practice.
- C. Cotsaces, N. Nikolaidis and I. Pitas, "Video shot boundary detection and condensed representation: a review," IEEE Signal Processing Magazine, vol.23, No.2, 2006.Google Scholar
Cross Ref
- Paul Over, Alan F. Smeaton, and Philip Kelly, "The trecvid rushes summarization evaluation pilot," in Proc. of ACM Multimedia, Sep. 2007.Google Scholar
- B.-T. Truong and S. Venkatesh, "Video abstraction: a systematic review and classification," ACM Trans. on Multimedia Computing, Communications and Applications, vol.3, No.1, Feb. 2007. Google ScholarDigital Library
- B.-W. Chen, J.-C. Wang and J.-F. Wang, "A novel video summarization based on mining the story-structure and semantic relations among concept entities," IEEE Trans. on Multimedia, vol.11, No.2, pp.295--312, 2009. Google ScholarDigital Library
- X. Zhu, J. Fan, A.-K. Elmagarmid, and X. Wu, "Hierarchical video summarization and content description joint semantic and visual similarity," ACM Multimedia System, 2003. Google ScholarDigital Library
- J. Jiang, X.-P. Zhang, "Gaussian mixture vector quantization-based video summarization using independent component analysis," in Proc. of IEEE Int. Work. on Multimedia Signal Processing (MMSP), Oct. 2010.Google Scholar
- Z. Xiong, R. Radhakrishnan, A. Divakaran, Y. Rui, and T.-S. Huang, "A unified framework for video summarization, browsing and retrieval," Elsevier Academic Press, 2006. Google ScholarDigital Library
- S. Benini, P. Migliorati, and R. Leonardi, "Hidden Markov models for video skim generation," In Proc. of the 8th Int. Work. on Image Analysis for Multimedia Interactive Services, Jun. 2007. Google ScholarDigital Library
- Y.-F. Ma, L. Lu, H.-J. Zhang, and M. Li, "A user attention model for video summarization," in Proc. of ACM Multimedia, Dec. 2002. Google ScholarDigital Library
- J. Jiang, X.-P. Zhang, "A new player-enabled rapid video navigation method using temporal quantization and repeated weighted boosting search," in Proc. of the 7th IEEE Computer Society Work. on Perceptual Organization in Computer Vision (POCV) in conjunction with CVPR 2010.Google Scholar
- K-Y Cheng, S-J Luo, B-Y Chen, and H-H Chu, "SmartPlayer: user-centric video fast-forwarding," in Proc. of the 27th Int. Conf. on Human Factors in Computing Systems, 2009. Google ScholarDigital Library
- J. Zhou and X.-P. Zhang. "An ICA mixture hidden Markov model for video content analysis," IEEE Trans. on Circuits and Systems for Video Technology, pp.1576--1586, 2008. Google ScholarDigital Library
- Z. Cernekova, I. Pitas, and C. Nikou. "Information theory-based shot cut/fade detection and video summarization," IEEE Trans. on Circuits and Systems for Video Technology, 2006. Google ScholarDigital Library
Index Terms
- A smart video player with content-based fast-forward playback
Recommendations
A content-based rapid video playback method using motion-based video time density function and temporal quantization
SAPMIA '10: Proceedings of the 2010 ACM workshop on Social, adaptive and personalized multimedia interaction and accessIn this paper, we propose a new content-based rapid video playback method using motion-based video time density function (MVTDF) and temporal quantization. In particular, we formulate the rapid video playback problem as a generic sampling problem. We ...
A content-based video fast-forward playback method using video time density function and rate distortion theory
ICME '11: Proceedings of the 2011 IEEE International Conference on Multimedia and ExpoIn this paper, we propose a new video summary method using video time density function (VTDF) and rate distortion theory. The whole system has two main modules, processing and playing. In the processing part, we apply VTDF to describe the temporal ...
A GP-based Video Game Player
GECCO '15: Proceedings of the 2015 Annual Conference on Genetic and Evolutionary ComputationA general video game player is an an agent that can learn to play different video games with no specific domain knowledge. We are working towards developing a GP-based general video game player. Our system currently extracts game state features from ...
Comments