Skip to main content
SpringerLink
Log in

GPU-friendly warped display for scope-maintained video surveillance

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

In this paper, we propose an efficient technique for warped display of surveillance video signal. Usually, there are regions of interest (ROIs) in video surveillance, such as entrance or exit, and moving objects or persons. The surveillant has two or more conflicting goals in mind. He/She wants to blow up the ROIs, but also wants to have an overview of the whole surveillance scope. The proposed method solves this conflict by warping the input video signal in real time fashion. First, multiple ROIs are detected. Then, the mesh for texture mapping is deformed, according to the position and shape of the ROIs. The original video frame is mapped as a texture on the deformed mesh to produce the warped effect. Mesh deformation and texture mapping are accelerated by modern graphics processing units (GPU). By allocating more display space for ROIs, the proposed technique highlights such important regions and assists the surveillant to locate them effectively. By experiments, we show that the proposed method is effective and efficient.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bederson, B.: Fisheye menus. CS-TR-4138, UMIACS-TR-2000-31 (2000)

  2. Blake A., Isard M. (1998): Active Contours. Springer, London

    Google Scholar 

  3. Carpendale M., Cowperthwaite D., Fracchia F. (1997): Extending distortion viewing from 2D to 3D. Comput. Graph. Appl. IEEE 17(4): 42–51

    Article  Google Scholar 

  4. Carpendale, M.S.T., Cowperthwaite, D.J., Fracchia, F.D.: 3-Dimensional pliable Surfaces: for the effective presentation of visual information. In: Proceedings of the 8th Annual ACM Symposium on User Interface and Software Technology, pp. 217–226 (1995)

  5. Drummond, T., Cipolla, R.: Real-time Tracking of Multiple Articulated Structures in Multiple Views. In: Proceedings of the 6th European Conference on Computer Vision (2000)

  6. Forsyth D.A., Ponce J. (2003): Computer Vision: A Modern. Prentice Hall, New Jersey

    Google Scholar 

  7. Furnas, G.W.: The fisheye view: A new look at structured files. Bell Laboratories Technical Memorandum (1981)

  8. Glassner, A.S.: Cubism and cameras: Free-form optics for computer graphics. Microsoft Research MSR-TR-2000-05 (2000)

  9. Glassner A.S. (2004): Digital cubism. Comput. Graph. Appl. IEEE 24(3): 82–90

    Article  Google Scholar 

  10. Glassner A.S. (2004): Digital cubism, part 2. Comput. Graph. Appl. IEEE 24(4): 84–95

    Article  Google Scholar 

  11. Gonzalez, R.C., Woods, R.E.: Digital Image Processing. Addison-Wesley, Reading (1992)

  12. Haeberli, P., Segal, M.: Texture mapping as a fundamental drawing primitive. http://www.sgi.com/misc/grafica/texmap/ (1993)

  13. Hsu, H.H., Shih, T.K., Tang, C.T., Liao, Y.C.: Real-time multiple tracking using a combined technique. In: Proceedings of the 19th International Conference on Advanced Information Networking and Applications (AINA 2005), pp. 111–116 (2005)

  14. Lamping, J., Rao, R., Pirolli, P.: A focus+context technique based on hyperbolic geometry for visualizing large hierarchies. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 401–408 (1995)

  15. Li B., Chellappa R. (2002): A generic approach to simultaneous tracking and verification in video. IEEE Trans. Image Process. 11(5): 530–544

    Article  Google Scholar 

  16. Lucas, B.D.: An iterative registration technique with an application to stereo vision. In: Proceedings of DARPA Image Understanding Workshop, pp. 121–130 (1981)

  17. Mittal, A., Davis, L.S.: M2tracker: A multi-view approach to segmenting and tracking people in a cluttered scene using region-based stereo. In: Proceedings of the 7th European Conference on Computer Vision (2002)

  18. Nguyen H.T., Smeulders A.W.M. (2004): Fast occluded object tracking by a robust appearance filter. IEEE Trans. Pattern Anal. Mach. Intell. 26(8): 1099–1104

    Article  Google Scholar 

  19. Oka M., Tsutsui K., Ohba A., Kurauchi Y., Tago T. (1987): Real-time manipulation of texture-mapped surfaces. SIGGRAPH Comput. Graph. 21(4): 181–188

    Article  Google Scholar 

  20. Pece, A.E., Worrall, A.D.: Tracking with the EM contour algorithm. In: Proceedings of the 7th European Conference on Computer Vision (2002)

  21. Peri, V., Nayar, S.: Generation of perspective and panoramic video from omnidirectional video. In: Proceedings of DARPA Image Understanding Workshop, pp. 243–246 (1997)

  22. Rauschenbach, U., Weinkauf, T., Schumann, H.: Interactive focus and context display of large raster images. In: Proceedings of WSCG 2000, pp. 267–274 (2000)

  23. Setlur, V.: Optimizing computer imagery for communication. http://www.cs.northwestern.edu/∼vidya/VidyaResearch Description.pdf (2004)

  24. Unal G., Krim H., Yezzi A. (2005): Fast incorporation of optical flow into active polygons. IEEE Trans. Image Process. 14(6): 745–759

    Article  Google Scholar 

  25. Vallance, S., Calder, P.R.: Multi-perspective images for visualisation. In: Proceedings of the Pan-Sydney Area Conference on Visual Information Processing, pp. 69–76 (2001)

  26. Wood, D.N., Finkelstein, A., Hughes, J.F., Thayer, C.E., Salesin, D.H.: Multiperspective panoramas for cel animation. In: Proceedings of SIGGRAPH 97, pp. 243–250 (1997)

  27. Yang, T., Li, S.Z., Pan, Q., Li, J.: Real-time and accurate segmentation of moving objects in dynamic scene. In: Proceedings of the ACM 2nd International Workshop on Video Surveillance & Sensor Networks, pp. 136–143 (2004)

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong, China

    Guangyu Wang, Tien-Tsin Wong & Pheng-Ann Heng

Authors
  1. Guangyu Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tien-Tsin Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pheng-Ann Heng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Guangyu Wang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, G., Wong, TT. & Heng, PA. GPU-friendly warped display for scope-maintained video surveillance. Multimedia Systems 12, 169–178 (2006). https://doi.org/10.1007/s00530-006-0056-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-006-0056-7

Keywords

Search

Navigation