Skip to main content
SpringerLink
Log in

Enhancing the audience experience during sport events: real-time processing of multiple stereoscopic cameras

  • Published:
annals of telecommunications - annales des télécommunications Aims and scope Submit manuscript

Abstract

From video acquisition to 3D rendering, most of the hardware and software modules required for stereoscopy are currently available in academic or industrial R&D laboratories. Some are even features of open-source libraries. However, designing a stereoscopic architecture able to perform this acquisition followed by geometrical calibration and colour correction, disparity maps computation, multi-view coding and transmission for several cameras into one dedicated server remains a challenge. This was achieved for the SkyMedia project which aimed at providing an enhanced experience for the audience, organising staff and performers of an event. Compromises were required, from lower-resolution depth estimation to limited MultiView Coding predictions, but in the end the project system was fit to the task and delivered contents to the various people evolving around the 2012 Turin Marathon.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. ICT FP7 SkyMedia project. http://ict-skymedia.eu

  2. Devernay F, Beardsley P (2010) Stereoscopic cinema. Geometry and computing 5. Image and geometry processing for 3-D cinematography. Banff International Research Station for Mathematical Innovation and Discovery. Springer, Berlin, pp. 11–52

  3. Binocle Website. http://www.binocle.com

  4. Vetro A, McGuire M, Matusik W, Behrens A, Lee J, Pfister H (2005) Multiview test sequences from MERL, Busan, Korea, April 2005. Doc.M12077.

  5. Feldmann I, Müller M, Zilly F, Tanger R, Muller K, Smolic A, Kauff P, Wiegand T (2008) HHI test material for 3D video, Archamps, France, May 2008. ISO/IEC JTC1/SC29/WG11 (MPEG).

  6. Lawrence Zitnick C, Bing Kang S, Uyttendale M, Winder S, Szeliski R (2004) High-quality video view interpolation using layered representation. Interactive Visual Media Group, Microsoft Research, Redmond

  7. Joshi N,Wilburn B, Vaish V, Levoy M, Horowitz M (2005) Automatic colour calibration for large camera arrays. UCSD CSE Tech Report. University of California, San Diego

  8. Dense stereo matching algorithm benchmark. http://vision.middlebury.edu/stereo/eval

  9. Sharstein D, Szelisky R (2001) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis 47:7–42

    Google Scholar 

  10. Birchfield S, Tomasi C (1998) A pixel dissimilarity measure that is insensitive to image sampling. IEEE Trans PAMI 20:401–406

    Google Scholar 

  11. Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans PAMI 23(11):1222–1239

    Article  Google Scholar 

  12. Felzenszwalb P, Huttenlocher D (2006) Efficient belief propagation for early vision. Int J Comput Vis 70(1):41–54

    Article  Google Scholar 

  13. Brown MZ, Burschka D, Hager GD (2003) Advances in computational stereo. IEEE Trans PAMI 25(8):993–1008

    Article  Google Scholar 

  14. Gigevision standard. http://www.machinevision.nl/upload/File/PDF_whitepaper/GigEVisionWhitePaper.pdf

  15. Genicam standard. http://www.emva.org/cms/upload/Standards/GenICam_Downloads/genicam_standard_v1_0.pdf

  16. Bradski G, Kaehler A (2008) Learning OpenCV, computer vision with the OpenCV library. O’Reilly, Sebastopol. ISBN: 978-0-596-51613-0

  17. Tsai RY (1987) A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J Robot Autom 3:323–344

    Article  Google Scholar 

  18. Zhang Z (1999) Flexible camera calibration by viewing a plane from unknown orientations. In: Proceedings of the 7th International Conference on Computer Vision, Corfu, pp. 666–673

  19. Reinhard E, Ashikhmin M, Gooch B, Shirley P (2001) Colour transfer between images. IEEE Computer Graphics and Application. ISSN: 0272–1716

  20. Hirschmüller H (2008) Stereo processing by semiglobal matching and mutual information. IEEE Trans PAMI 30(2):328–341

    Google Scholar 

  21. Mendiburu B (2012) 3DTV and 3D cinema, tools and processes for creative stereoscopy. Focal Press, Waltham

  22. CUDA by nVidia. http://www.nvidia.com/object/cuda_home_new.html

  23. ATI Stream by AMD. http://www.amd.com/us/products/technologies/amd-app/Pages/eyespeed.aspx

  24. OpenCL specifications. http://www.khronos.org/registry/cl/specs/opencl-1.2.pdf

  25. OpenCV Website. http://opencv.willowgarage.com/wiki

  26. ETSI TS 101 547 (V1.1.1). Digital Video Broadcasting (DVB). Frame Compatible Plano-stereoscopic 3DTV

  27. ITU-T Rec. H.264 | ISO/IEC 14496-10 (2009) Advanced Video Coding.

  28. ITU-T Rec. H.264 | ISO/IEC 14496-10 (2009) Advanced Video Coding, Annex G: Scalable Video Coding

  29. ITU-T Rec. H.264 | ISO/IEC 14496-10 (2009) Advanced Video Coding, Annex H: Multiview Video Coding

  30. ITU-T Rec. H.264 | ISO/IEC 14496-10 (2012) Advanced Video Coding, Amendment 2: MVC extensions for inclusion of depth maps

  31. Bernard Mendiburu (2009) 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen, Focal Press

  32. Müller M , Zilly F, Riechert C , Kauff P (2011) Spatio-temporal consistent depth maps from multi-view video, 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON), pp. 1–4, May, doi: 10.1109/3DTV.2011.5877221

  33. Kalarot R, Morris J, Berry D, Dunning J (2011) Analysis of real-time stereo vision algorithms on GPU. In: International Conference on Image and Vision Computing New Zealand (IVCNZ)

  34. Waizenegger W, Atzpadin N, Schreer O, Feldmann I (2011) Patch-sweeping with robust prior for high precision depth estimation in real-time systems. In: Proceedings of 18th International Conference on Image Processing (ICIP 2011), Brussels, Belgium, 11–14 September

  35. Vetro A, Wiegand T, Sullivan GJ (2011) Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC Standard. Proceedings of the IEEE 99(4):626–642

  36. Christoph Fehn (2003) A 3D-TV approach using depth-image-based rendering (DIBR). In: Proceedings of visualization, imaging, and image processing, pp. 482–487

Download references

Author information

Authors and Affiliations

  1. Vitec, Chatillon, France

    Julien Maillard

  2. Ektacom, Les Ulis, France

    Marc Leny

  3. Thales Communications and Security, Gennevilliers, France

    Hélène Diakhaté

Authors
  1. Julien Maillard
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marc Leny
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hélène Diakhaté
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marc Leny.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Maillard, J., Leny, M. & Diakhaté, H. Enhancing the audience experience during sport events: real-time processing of multiple stereoscopic cameras. Ann. Telecommun. 68, 657–671 (2013). https://doi.org/10.1007/s12243-013-0367-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12243-013-0367-6

Keywords

Search

Navigation