Skip to main content
Springer Nature Link
Log in

SpriteCam: virtual camera control using sprite

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Editing or browsing video based on spatial content without distortion or cropping has been challenging because of providing unavailable information (view) in a single frame. Virtual camera control enables the user to view the video from her perspective by using camera functions such as pan, tilt, and zoom on a recorded video. In this paper, we propose our SpriteCam system that provides virtual camera controls by first generating the background sprite or mosaic of the video. We provide the theoretical framework and then explain how pan, tilt, and zoom operations are applied using the sprite. SpriteCam allows centralizing objects, aspect ratio conversion, and fixing the camera view without distortion or information loss for videos which sprite can be generated.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. In ACM SIGGRAPH 2007 papers (SIGGRAPH ′07). ACM, New York, NY, USA, 2007, Article 10 . DOI=10.1145/1275808.1276390 http://doi.acm.org/10.1145/1275808.1276390

  2. Aygün RS, Zhang A (2002) Reducing blurring-effect in high resolution mosaic generation. In Multimedia and Expo, 2002. ICME ′02. Proc. 2002 I.E. Int. Conf., 2, IEEE Computer Society, Washington, DC, pp. 537–540

  3. Aygun RS, Zhang A (2004) Integrating virtual camera controls into video, 2004 I.E. Int Conf on Multimedia and Expo, Tokyo, Japan, August, 2004

  4. Barhoumi W, Bakkay MC, Zagrouba E (2011) An online approach for multi-sprite generation based on camera parameters estimation Multimedia Tools and Applications

  5. Chen Y, Deshpande AA, RS Aygun (2012) Sprite generation using sprite fusion. ACM Trans. Multimedia Comput. Commun. Appl. 8, 2, Article 22 (May 2012), 24 pages DOI=10.1145/2168996.2169002 http://doi.acm.org/10.1145/2168996.2169002

  6. Cheung H-K, Siu W-C (2007) Robust global motion estimation and novel updating strategy for sprite generation. Image Process IET 1(1):13–20

    Article  Google Scholar 

  7. Deng Z-L, Guo Y-D, Gu X-D, Chen Z-B, Chen Q-Q, Wang, C (2008) A Comparative review of aspect ratio conversion methods. Proc. of the 2008 Int. Conf. on Multimedia and Ubiquitous Engineering (MUE ′08). IEEE Computer Society, Washington, DC, USA, pp.114–117

  8. Deshpande A, Aygun RS (2009) Motion-based video classification for sprite generation. Database and expert systems applications, 20th Int. Workshop on Database and Expert Systems Application, pp. 231–235

  9. Dufaux F, Konrad J (2000) Effcient, Robust and fast global motion estimation for video coding. IEEE Trans Image Process 9(3):497–501

    Google Scholar 

  10. Glantz A, Krutz A, Sikora T, Nunes P, Pereira F (2010) Automatic MPEG-4 sprite coding—comparison of integrated object segmentation algorithms. Multimed Tools Appl 49(3):483–512

    Article  Google Scholar 

  11. Guo Y-D, Deng Z-L, Gu X-D, Chen Z-B, Chen Q-Q, Wang C (2008) Aspect ratio conversion based on saliency model. Image and Signal Processing, 2008. CISP ′08. Congress 4, 2008,pp. 92–96

  12. Guo YD, Gu XD, Chen ZB, Chen QQ, Wang C (2007) Adaptive video presentation for small display while maximize visual information, LNCS, Springer. Visual 2007, Shanghai

  13. Hsia SC, Liu BD (1994) An NTSC to HDTV video conversion system by using the block processing concept. J IEEE Trans Consum Electronics 40(3):216–224

    Google Scholar 

  14. http://www.adobe.com/products/premiere.html, accessed June 2013

  15. http://www.cyberlink.com/products/powerdirector/overview_en_US.html, accessed June 2013

  16. Kunter M, Krutz A, Mandal M, Sikora T (2007) Optimal multiple sprite generation based on physical camera parameter estimation. Visual Communications and Image Processing, VCIP, IS&T/SPIE’s Electronic Imaging

  17. Lee MC, Chen WG, Lin CB, Gu C, Markoc T, Zabinsky SI, Szeliski R (1997) A layered video object coding system using sprite and affine motion model. Circ Syst Video Technol IEEE Trans 7(1):130–145

    Article  Google Scholar 

  18. Lu Y, Gao W, Wu F (2001) Fast and robust sprite generation for MPEG-4 video coding. Proc. of the Second IEEE Pacific Rim Conf. on Multimedia: Advances in Multimedia information Processing, October 2001

  19. Lu Y, Gao W, Wu F (2001) Fast and robust sprite generation for MPEG-4 Video Coding. Proc. of the Second IEEE Pacific Rim Conf. on Multimedia: Advances in Multimedia information Processing

  20. Lu Y, Gao W, Wu F (2003) Efficient background video coding with static sprite generation and arbitrary-shape spatial prediction techniques. IEEE Trans Circ Syst Video Technol 13(5):394–405

    Article  Google Scholar 

  21. Mavlankar A, Varodayan D, Girod B (2007) Region-ofinterest prediction for interactively streaming regions of high resolution video. Proc of 16th Intl Packet Video Workshop,Lausanne, Switzerland, pp. 68–77

  22. Sikora T (1997) The mpeg-4 video standard verification model. IEEE Trans Circ Syst Video Technol 7:9–31

    Google Scholar 

  23. Smolic A, Ohm JR (2000) Robust global motion estimation using a simplified m-estimator approach. Proc. ICIP2000, IEEE Int. Conf. on Image Processing

  24. Smolic A, Sikora T, Ohm JR (1999) Long-term global motion estimation and its application for sprite coding, content description and segmentation. IEEE Trans Circ Syst Video Technol 9(8):1227–1242

    Article  Google Scholar 

  25. Sun X, Foote J, Kimber D, Manjunath BS (2005) Region of interest extraction and virtual camera control based on panoramic video capturing. IEEE Trans Multimedia 7(5):981–990

    Google Scholar 

  26. Wilson A, Lin MC, Yeo B, Yeung MM, Manocha D (2000) A video-based rendering acceleration algorithm for interactive walkthroughs. Proc ACM Multimedia:75–83

Download references

Acknowledgments

This material is based upon work supported by the National Science Foundation under Grant No. 0812307.

Author information

Authors and Affiliations

  1. Computer Science Department, University of Alabama in Huntsville, Huntsville, AL, 35899, USA

    Yi Chen & Ramazan S. Aygün

Authors
  1. Yi Chen
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Ramazan S. Aygün
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Ramazan S. Aygün.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chen, Y., Aygün, R.S. SpriteCam: virtual camera control using sprite. Multimed Tools Appl 74, 1067–1089 (2015). https://doi.org/10.1007/s11042-013-1711-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1711-6

Keywords