Skip to main content
SpringerLink
Log in

Hybrid Layered Video Encoding for Mobile Internet-Based Computer Vision and Multimedia Applications

  • Chapter
Mobile Multimedia Processing (WMMP 2008)

Part of the book series: Lecture Notes in Computer Science ((LNCCN,volume 5960))

Included in the following conference series:

Abstract

Mobile networked environments are typically resource constrained in terms of the available bandwidth and battery capacity on mobile devices. Real-time video applications entail the analysis, storage, transmission, and rendering of video data, and are hence resource-intensive. Since the available bandwidth in the mobile Internet is constantly changing, and the battery life of a mobile video application decreases with time, it is desirable to have a video representation scheme that adapts dynamically to the available resources. A Hybrid Layered Video (HLV) encoding scheme is proposed, which comprises of content-aware, multi-layer encoding of texture and a generative sketch-based representation of the object outlines. Different combinations of the texture- and sketch-based representations result in distinct video states, each with a characteristic bandwidth and power consumption profile. The proposed HLV encoding scheme is shown to be effective for mobile Internet-based multimedia applications such as background subtraction, face detection, face tracking and face recognition on resource-constrained mobile devices.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Atallah, M.J.: Linear time algorithm for the Hausdorff distance between convex polygons. Information Processing Letters 17(4), 207–209 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  2. Besl, P.J., Jain, R.: Segmentation through variable-order surface fitting. IEEE Trans. Pattern Analysis and Machine Intelligence 10(2), 167–192 (1988)

    Article  Google Scholar 

  3. Bouguet, J.Y.: Pyramisdal Implementation of the Lucas Kanade Feature Tracker, Intel Corporation, Microprocessor Research Labs; included in the distribution of OpenCV

    Google Scholar 

  4. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Analysis and Machine Intelligence 8(6), 679–698 (1986)

    Article  Google Scholar 

  5. Chattopadhyay, S., Luo, X., Bhandarkar, S.M., Li, K.: FMOE-MR: content-driven multi-resolution MPEG-4 fine-grained scalable layered video encoding. In: Proc. ACM Multimedia Computing and Networking Conference (ACM MMCN 2007), San Jose, CA, January 2007, pp. 650404.1–11 (2007)

    Google Scholar 

  6. Chattopadhyay, S., Bhandarkar, S.M., Li, K.: Ligne-Claire video encoding for power constrained mobile environments. In: Proc. ACM Multimedia, Augsburg, Germany, September 2007, pp. 1036–1045 (2007)

    Google Scholar 

  7. Cheung, S.-C., Kamath, C.: Robust background subtraction with foreground validation for urban traffic video. EURASIP Jour. Applied Signal Processing 14, 1–11 (2005); UCRL-JRNL-201916

    MATH  Google Scholar 

  8. Coding of Audio-Visual Objects, Part-2 Visual, Amendment 4: Streaming Video Profile, ISO/IEC 14 496-2/FPDAM4 (July 2000)

    Google Scholar 

  9. Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Analysis and Machine Intelligence 25(5), 564–577 (2003)

    Article  Google Scholar 

  10. Cornea, R., Nicolau, A., Dutt, N.: Software annotations for power optimization on mobile devices. In: Proc. Conf. Design, Automation and Test in Europe, Munich, Germany, March 2006, pp. 684–689 (2006)

    Google Scholar 

  11. Cucchiara, R., Grana, C., Prati, A., Vezzani, R.: Computer vision techniques for PDA accessibility of in-house video surveillance. In: Proc. ACM SIGMM International Workshop on Video Surveillance, Berkeley, CA, November 2003, pp. 87–97 (2003)

    Google Scholar 

  12. Dai, M., Loguinov, D.: Analysis and modeling of MPEG-4 and H.264 multi-layer video traffic. In: Proc. IEEE INFOCOM, Miami, FL, March 2005, pp. 2257–2267 (2005)

    Google Scholar 

  13. Davies, E.: Machine Vision: Theory, Algorithms and Practicalities, pp. 42–44. Academic Press, San Diego (1990)

    Google Scholar 

  14. Geusebroek, J.-M., Smeulders, A.W.M., Van de Weijer, J.: Fast anisotropic Gauss filtering. IEEE Trans. Image Processing 12(8), 938–943 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  15. Hakeem, A., Shafique, K., Shah, M.: An object-based video coding framework for video sequences obtained from static cameras. In: Proc. ACM Multimedia, Singapore, November 2005, pp. 608–617 (2005)

    Google Scholar 

  16. Hennessy, J.L., Patterson, D.A.: Computer Architecture - A Quantitative Approach, 4th edn. Appendix D. Morgan Kaufmann, San Francisco (2007)

    MATH  Google Scholar 

  17. http://www.squared5.com

  18. Ivanov, Y., Bobick, A., Liu, J.: Fast lighting independent background subtraction. International Journal of Computer Vision 37(2), 199–207 (2000)

    Article  MATH  Google Scholar 

  19. Javed, O., Shafique, K., Shah, M.: A hierarchical approach to robust background subtraction using color and gradient information. In: Proc. IEEE Workshop on Motion and Video Computing, Orlando, FL, December 2002, pp. 22–27 (2002)

    Google Scholar 

  20. Khan, S., Shah, M.: Object based segmentation of video using color motion and spatial information. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, Kauai Island, HI, December 2001, vol. 2, pp. 746–751 (2001)

    Google Scholar 

  21. Ku, C.-W., Chen, L.-G., Chiu, Y.-M.: A very low bit-rate video coding system based on optical flow and region segmentation algorithms. In: Proc. SPIE Conf. Visual Communication and Image Processing, Taipei, Taiwan, May 1995, vol. 3, pp. 1318–1327 (1995)

    Google Scholar 

  22. Liang, C., Mohapatra, S., Zarki, M.E., Dutt, N., Venkatasubramanian, N.: A backlight optimization scheme for video playback on mobile devices. In: Proc. Consumer Communications and Networking Conference (CCNC 2006), January 2006, vol. 3(2), pp. 833–837 (2006)

    Google Scholar 

  23. Luo, X., Bhandarkar, S.M.: Robust background updating for real-time surveillance and monitoring. In: Proc. Intl. Conf. Image Analysis and Recognition, Toronto, Canada, September, 2005, pp. 1226–1233 (2005)

    Google Scholar 

  24. Luo, X., Bhandarkar, S.M., Hua, W., Gu, H., Guo, C.: Nonparametric background modeling using the CONDENSATION algorithm. In: Proc. IEEE Intl. Conf. Advanced Video and Signal-based Surveillance (AVSS 2006), Sydney, Australia, November 2006, pp. 13–18 (2006)

    Google Scholar 

  25. Luo, X., Bhandarkar, S.M.: Tracking of multiple objects using optical flow-based multiscale elastic matching. In: Vidal, R., Heyden, A., Ma, Y. (eds.) WDV 2005/2006. LNCS, vol. 4358, pp. 203–217. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  26. Mohapatra, S., Cornea, R., Dutt, N., Nicolau, A., Venkatasubramanian, N.: Integrated power management for video streaming to mobile handheld devices. In: Proc. ACM Multimedia, Berkeley, CA, November 2003, pp. 582–591 (2003)

    Google Scholar 

  27. Ni, P., Isovic, D., Fohler, G.: User-friendly H.264/AVC for remote browsing. In: Proc. ACM Multimedia, Santa Barbara, CA, October 2006, pp. 643–646 (2006)

    Google Scholar 

  28. Richardson, I.E.G.: H.264 and MPEG-4 Video Compression: Video Coding for Next Generation Multimedia. Wiley, New York (2004)

    Google Scholar 

  29. Rosin, P.L., West, G.A.W.: Non-parametric segmentation of curves into various representations. IEEE Trans. Pattern Analysis and Machine Intelligence 17(12), 1140–1153 (1995)

    Article  Google Scholar 

  30. Salembier, P., Marques, F., Pardas, M., Morros, J.R., Corset, I., Jeannin, S., Bouchard, L., Meyer, F., Marcotegui, B.: Segmentation-based video coding system allowing the manipulation of objects. IEEE Trans. Circuits and Systems for Video Technology 7(1), 60–74 (1997)

    Article  Google Scholar 

  31. Salomon, D.: Data Compression: The Complete Reference. Springer, Berlin (2004)

    MATH  Google Scholar 

  32. Sikora, T.: Trends and perspectives in image and video coding. Proc. IEEE 93(1), 6–17 (2005)

    Article  Google Scholar 

  33. Turk, M., Pentland, A.: Eigenfaces for recognition. Jour. Cognitive Neurosicence 3(1), 71–86 (1991)

    Article  Google Scholar 

  34. Viola, P., Jones, M.: Rapid Object Detection using a Boosted Cascade of Simple Features. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, Kauai Island, HI, December 2001, vol. 1, pp. 511–518 (2001)

    Google Scholar 

  35. Zarit, B.D., Super, B.J., Quek, F.K.H.: Comparison of five color models in skin pixel classification. In: Intl. Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Washington, DC, September 1999, pp. 58–63 (1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, The University of Georgia, Athens, GA, 30602-7404, USA

    Suchendra M. Bhandarkar & Shiva Sandeep Garlapati

  2. Google Inc., Mountain View, CA 94043, USA

    Siddhartha Chattopadhyay

Authors
  1. Suchendra M. Bhandarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siddhartha Chattopadhyay
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shiva Sandeep Garlapati
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Mathematics and Computer Science, University of Münster, Einsteinstrasse 62, 48149, Münster, Germany

    Xiaoyi Jiang

  2. Scientific Works, 6 Tiffany Court, 08550, Princeton Junction, NJ, USA

    Matthew Y. Ma

  3. Department of Computer Science and Engineering, State University of New York at Buffalo, 201 Bell Hall, 14260-2000, Buffalo, NY, USA

    Chang Wen Chen

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Bhandarkar, S.M., Chattopadhyay, S., Garlapati, S.S. (2010). Hybrid Layered Video Encoding for Mobile Internet-Based Computer Vision and Multimedia Applications. In: Jiang, X., Ma, M.Y., Chen, C.W. (eds) Mobile Multimedia Processing. WMMP 2008. Lecture Notes in Computer Science, vol 5960. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12349-8_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12349-8_7

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12348-1

  • Online ISBN: 978-3-642-12349-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation