Abstract
The limited display size of the mobile devices has been imposing significant barriers for mobile device users to enjoy browsing high-resolution videos. In this paper, we present a novel video adaptation scheme based on attention area detection for users to enrich browsing experience on mobile devices. During video compression, the attention information which refers to as attention objects in frames will be detected and embedded into bitstreams using the supplement enhanced information (SEI) tool. In this research, we design a special SEI structure for embedding the attention information. Furthermore, we also develop a scheme to adjust adaptive quantization parameters in order to improve the quality on encoding the attention areas. When the high-resolution bitstream is transmitted to mobile users, a fast transcoding algorithm we developed earlier will be applied to generate a new bitstream for attention areas in frames. The new low-resolution bitstream containing mostly attention information, instead of the high-resolution one, will be sent to users for display on the mobile devices. Experimental results show that the proposed spatial adaptation scheme is able to improve both subjective and objective video qualities.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chang, S.-F., Vetro, A.: Video adaptation: Concepts, technologies, and open issues. Proc. IEEE 93(1), 148–158 (2005)
Xin, J., Lin, C.–W., Sun, M.–T.: Digital Video Transcoding. Proceedings of the IEEE 93(1) (January 2005)
Vetro, A., Christopoulos, C., Sun, H.: An overview of video transcoding architectures and techniques. IEEE Signal Processing Magazine 20(2), 18–29 (2003)
Wang, Y., Li, H.Q., Fan, X., Chen, C.W.: An attention based spatial adaptation scheme for H.264 videos over mobiles. IJPRAI special issue on Intelligent Mobile and Embedded Systems 20(4), 565–584 (2006)
Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H.264/ISO/IEC 14496-10 AVC. In: Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-GO50 (2003)
Chen, L.Q., Xie, X., Fan, X., Ma, W.Y., Zhang, H.J., Zhou, H.Q.: A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal 9(4), 353–364 (2003)
Fan, X., Xie, X., Zhou, H.-Q., Ma, W.-Y.: Looking into Video Frames on Small Displays. In: Proceedings of the eleventh ACM international conference on Multimedia, Berkeley, CA, USA, November 2003, pp. 247–250 (2003)
Ma, Y.-F., Zhang, H.-J.: Contrast-Based Image Attention Analysis by Using Fuzzy Growing. In: Proceedings of the eleventh ACM international conference on Multimedia, Berkeley, CA, USA, November 2003, pp. 374–381 (2003)
JVT reference software official version. Image Processing Homepage, http://bs.hhi.de/~suehring/tml/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, Y., Li, H., Liu, Z., Chen, C.W. (2006). Attention Information Based Spatial Adaptation Framework for Browsing Videos Via Mobile Devices. In: Zhuang, Y., Yang, SQ., Rui, Y., He, Q. (eds) Advances in Multimedia Information Processing - PCM 2006. PCM 2006. Lecture Notes in Computer Science, vol 4261. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11922162_90
Download citation
DOI: https://doi.org/10.1007/11922162_90
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-48766-1
Online ISBN: 978-3-540-48769-2
eBook Packages: Computer ScienceComputer Science (R0)