Abstract
Growing popularity and richer functionality of contemporary mobile handheld devices such as PDAs and smart phones have enabled emerging video streaming applications to these devices via various wireless networks. However, these handheld devices are significantly constrained by limited resources available to them for some sophisticated operations. Among these limitations, the available processing power has limited these devices to perform full scale decoding of the video compressed with H.264 standard [1], [2]. The typically small display size of the handheld devices has been imposing significant barriers for the devices users to enjoy high-resolution videos. This paper presents some challenges in design decoding algorithm for smart phones, in video adaptation to suit heterogeneous devises, in browsing videos via handheld devices by diverse mobile device users. Several approaches will be proposed to meet these challenges and to offer the mobile device users an enhanced experience in these emerging mobile video applications.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Wiegand, T., Sullivan, G.J., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol 13, 560–576 (2003)
Tamhankar, A., Rao, K.R.: An overview of H.264/MPEG-4 part 10., Communications and Signal Processing Track, Texas Systems Day, November 15, 2003, Dallas Hall, SMU (2003)
Kim, J.-G., Wang, Y., Chang, S.-F., Kim, H.-M.: An optimal framework of video adaptation and its application to rate adaptation transcoding. ETRI Journal 27(4)(2005)
Mobile Profile Proposal, ISO/IEC, JTC1/SC29/WG11 and ITU-T SG16 Q.6, document JVT-C161, 3nd meeting, Fairfax, VA, USA, 6-10 March 2002 (2002)
Vetro, A., Christopoulos, C., Sun, H.: An overview of video transcoding architectures and techniques. IEEE Signal Processing Magazine 20(2), 18–29 (2003)
Xin, J., Lin, C.-W., Sun, M.-T.: Digital Video Transcoding. Proceedings of the IEEE, 93(1) (January 2005)
Fan, X., Xie, X., Zhou, H.-Q., Ma, W.-Y.: Looking into video frames on small displays. In: Proceedings of the eleventh ACM international conference on Multimedia November 2003, Berkeley, CA, USA, pp. 247–250 (2003)
Chen, L.Q., Xie, X., Fan, X., Ma, W.Y., Zhang, H.J., Zhou, H.Q.: A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal 9(4), 353–364 (2003)
Hua, X.-S., Chen, X.-R., Liu, W., Zhang, H.-J.: Automatic Location of Text in Video Frames. In: Proceedings of the third International Workshop on Multimedia Information Retrieval, Ottawa, Canada, October 2001, pp. 126–129 (2001)
Draft ITU-T recommendation and final draft international standard of joint video specification (ITU-T Rec. H.264/ISO/IEC 14496-10 AVC. In: Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-GO50 (2003)
H.264/MPEG-4 Part 10: Transform & Quantization, H.264 tutorial, http://www.vodex.com
Marpe, D., Schwarz, H., Wiegand, T.: Context-Based Adaptive Binary Arithmetic Coding in H. 264/AVC Video Compression Standard IEEE Trans. Circuits Syst. Video Technol 13, 620–636 (2003)
List, P., Joch, A., Lainema, J., Bjontegaard, G., Karczewicz, M.: Adaptive deblocking filter. IEEE Trans. Circuits Syst. Video Technol 13, 614–619 (2003)
JVT reference software official version, Image Processing Homepage, http://bs.hhi.de/~suehring/tml/
Wang, Y., Li, H., Chen, C.W.: A novel video coding scheme for mobile devices. In: Proc. Int. Conf. Mobile and Ubiquitous Multimedia October 2004, College Park, MD (2004)
Kuo, C.-H., Shen, M., Kuo, C.-C.J.: Fast Inter-prediction mode decision and motion search for H.264. In: Proceedings of IEEE International Conference on Multimedia and Expo 2004, Taipei, Taiwan, pp. 663–666 (June 2004)
Lee, J., Jeon, B.: Fast mode decision for H.264. In: Proceedings of IEEE International Conference on Multimedia and Expo 2004, Taipei, Taiwan June 2004, pp.1131–1134 (2004)
Sun, X., Foote, J., Kimber, D., Manjunath, B.S.: Panoramic video capturing and compressed domain virtual camera control. In: Proceedings of the ninth ACM international conference on Multimedia, Ottawa, Canada, September 2001 pp. 229–238 (2001)
Wang, Y., Li, H.Q., Fan, X., Chen, C.W.: An attention based spatial adaptation scheme for H.264 videos over mobiles. Int. Journal Pattern Recognition & Artificial Intelligence special issue on Intelligent Mobile & Embedded Systems 20(4), 565–584 (2006)
Chang, S.-F., Vetro, A.: Video adaptation: Concepts, technologies, and open issues. Proc. IEEE 93(1), 148–158 (2005)
Tourapis, A.M., Au, O.C., Liou, M.L.: Highly efficient predictive zonal algorithms for fast block-mathcing motion estimation. IEEE Trans. Circuits Syst. Video Technol. 12(10), 934–947 (2002)
Yin, P., Tourapis, H.-Y.C., Tourapis, A.M., Boyce, J.: Fast mode decision and motion estimation for JVT/H.264. In: Proceedings of International Conference on Image Processing 2003, Barcelona, Spain, September 2003, pp. 853–856 (2003)
Shen, B.: Submacroblock motion compensation for fast down-scale transcoding of compressed video. IEEE Trans. Circuits Syst. Video Technol. 15(10), 1291–1302 (2005)
Wang, Y., Li, H., Chen, C.W.: An attention-information-based spatial adaptation framework for browsing videos via mobile devices. EURASIP Journal of Advances in Signal Processing (Accepted for publication)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Chen, C.W., Li, H. (2007). Video Streaming to Mobile Handheld Devices: Challenges in Decoding, Adaptation, and Browsing. In: Sebe, N., Liu, Y., Zhuang, Y., Huang, T.S. (eds) Multimedia Content Analysis and Mining. MCAM 2007. Lecture Notes in Computer Science, vol 4577. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73417-8_9
Download citation
DOI: https://doi.org/10.1007/978-3-540-73417-8_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73416-1
Online ISBN: 978-3-540-73417-8
eBook Packages: Computer ScienceComputer Science (R0)