Skip to main content
SpringerLink
Log in

Projection matrix by orthogonal vanishing points

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Calculation of camera projection matrix, also called camera calibration, is an essential task in many computer vision and 3D data processing applications. Calculation of projection matrix using vanishing points and vanishing lines is well suited in the literature; where the intersection of parallel lines (in 3D Euclidean space) when projected on the camera image plane (by a perspective transformation) is called vanishing point and the intersection of two vanishing points (in the image plane) is called vanishing line. The aim of this paper is to propose a new formulation for easily computing the projection matrix based on three orthogonal vanishing points. It can also be used to calculate the intrinsic and extrinsic camera parameters. The proposed method reaches to a closed-form solution by considering only two feasible constraints of zero-skewness in the internal camera matrix and having two corresponding points between the world and the image. A nonlinear optimization procedure is proposed to enhance the computed camera parameters, especially when the measurement error of input parameters or the skew factor are not negligible. The proposed method has been run on real and synthetic data for more precise evaluations. The provided experimental results demonstrate the superiority of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Antunes M, Barreto JP (2013) A global approach for the detection of vanishing points and mutually orthogonal vanishing directions. In: IEEE conference on computer vision and pattern recognition (CVPR), 2013. IEEE, pp 1336–1343

  2. Babaee-Kashany V, Pourreza HR (2010) Camera pan and tilt estimation in soccer scenes based on vanishing points. In: 4th UKSim European symposium on computer modeling and simulation (EMS), 2010. IEEE, pp 152–157

  3. Babaee-Kashany V, Pourreza HR (2010) Camera pose estimation in soccer scenes based on vanishing points. In: IEEE international symposium on haptic audio-visual environments and games (HAVE), 2010. IEEE, pp 1–6

  4. Beardsley P, Murray D (1992) Camera calibration using vanishing points. In: BMVC92. Springer, pp 416–425

  5. Beardsley P, Murray D, Zisserman A (1992) Camera calibration using multiple images. In: Computer vision ECCV’92. Springer, pp 312–320

  6. Caprile B, Torre V (1990) Using vanishing points for camera calibration. Int J Comput Vis 4(2):127–139

    Article  Google Scholar 

  7. Cipolla R, Drummond T, Robertson DP (1999) Camera calibration from vanishing points in image of architectural scenes. In: BMVC, vol 99. Citeseer, pp 382–391

  8. Daniilidis K, Ernst J (1996) Active intrinsic calibration using vanishing points. In: Proceedings of 1996 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1996 (CVPR’96). IEEE, pp 708–713

  9. Dong S-P (2003) Determination of 3-d position of particles in perspective picture with vanishing-point theorem. In: Optical technology and image processing fo rfluids and solids diagnostics 2002. International Society for Optics and Photonics, pp 104–112

  10. Duda RO, Hart PE (1972) Use of the hough transformation to detect lines and curves in pictures. Commun ACM 15(1):11–15. Available: doi:10.1145/361237.361242

    Article  MATH  Google Scholar 

  11. Farin D, Krabbe S, Effelsberg W (2003) Robust camera calibration for sport videos using court models. In: Electronic imaging 2004. International Society for Optics and Photonics, pp 80– 91

  12. Grammatikopoulos L, Karras G, Petsa E (2004) Camera calibration combining images with two vanishing points. Int Arch Photogramm Remote Sens Spat Inf Sci 35 (5):99–104

    Google Scholar 

  13. Grammatikopoulos L, Karras G, Petsa E (2007) An automatic approach for camera calibration from vanishing points. ISPRS J Photogramm Remote Sens 62 (1):64–76

    Article  Google Scholar 

  14. Grammatikopoulos L, Karras G, Petsa E, Kalisperakis I (2006) A unified approach for automatic camera calibration from vanishing points. Int Arch Photogramm Remote Sens Spat Inf Sci 5

  15. Guillemaut J-Y, Aguado AS, Illingworth J (2005) Using points at infinity for parameter decoupling in camera calibration. IEEE Trans Pattern Anal Mach Intell 27 (2):265–270

    Article  Google Scholar 

  16. Guillou E, Meneveaux D, Maisel E, Bouatouch K (2000) Using vanishing points for camera calibration and coarse 3d reconstruction from a single image. Vis Comput 16(7):396–410

    Article  MATH  Google Scholar 

  17. Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University Press

  18. He B, Li Y (2007) A novel method for camera calibration using vanishing points. In: 14th international conference on mechatronics and machine vision in practice, 2007. M2VIP 2007. IEEE , pp 44–47

  19. He B, Li YF (2008) Camera calibration from vanishing points in a vision system. Opt Laser Technol 40(3):555–561

    Article  MathSciNet  Google Scholar 

  20. IPL Soccer Dataset IPL Azadi Soccer Dataset. http://ipl.ce.sharif.edu/links.html 2016-01-01

  21. Ito M (1990) Robot vision modelling-camera modelling and camera calibration. Adv Robot 5(3):321–335

    Article  MathSciNet  Google Scholar 

  22. Kanatani K (1992) Statistical analysis of focal-length calibration using vanishing points. IEEE Trans Robot Autom 8(6):767–775

    Article  Google Scholar 

  23. Kong H, Sarma SE, Tang F (2013) Generalizing laplacian of gaussian filters for vanishing-point detection. IEEE Trans Intell Transp Syst 14(1):408–418

    Article  Google Scholar 

  24. Lenz RK, Tsai RY (1988) Techniques for calibration of the scale factor and image center for high accuracy 3-d machine vision metrology. IEEE Trans Pattern Anal Mach Intell 10(5):713–720

    Article  Google Scholar 

  25. Li B, Peng K, Ying X, Zha H (2010) Simultaneous vanishing point detection and camera calibration from single images. In: Advances in visual computing. Springer, pp 151–160

  26. Liang D, Huang Q, Liu Y, Zhu G, Gao W (2007) Video2cartoon: a system for converting broadcast soccer video into 3d cartoon animation. IEEE Trans Consum Electron 53(3):1138–1146

    Article  Google Scholar 

  27. Moghadam P, Starzyk JA, Wijesoma WS (2012) Fast vanishing-point detection in unstructured environments. IEEE Trans Image Process 21(1):425–430

    Article  MathSciNet  Google Scholar 

  28. Orghidan R, Salvi J, Gordan M, Orza B (2012) Camera calibration using two or three vanishing points. IEEE

  29. Pan S, Dong S, Wang H (2008) The calibration of perspective picture based on vanishing point. In: Congress on image and signal processing, 2008. CISP’08, vol 2. IEEE, pp 417–421

  30. Salvi J (1998) An approach to coded structured light to obtain three dimensional information. Ph.D Thesis, Universitat de Girona

  31. Salvi J, Armangué X., Batlle J (2002) A comparative review of camera calibrating methods with accuracy evaluation. Pattern Recogn 35(7):1617–1635

    Article  MATH  Google Scholar 

  32. Seetharaman G, Bao H, Shivaram G (1994) Calibration of camera parameters using vanishing points. J Frankl Inst 331(5):555–585

    Article  MATH  Google Scholar 

  33. Stevenson DE, Fleck MM (1995) Robot aerobics: four easy steps to a more flexible calibration. In: Proceedings of 5th international conference on computer vision, 1995. IEEE, pp 34–39

  34. Sun J, Gu H, Qin X, Zheng J (2008) A new camera calibration based on vanishing point. In: 7th world congress on intelligent control and automation, 2008. WCICA 2008. IEEE, pp 2371–2376

  35. Sun H, Lu J, Chang Z (2016) An efficient camera calibration and optimisation method based on orthogonal vanishing points. Imag Sci J 64(4):232–239. Available. doi:10.1080/13682199.2016.1168143

    Article  Google Scholar 

  36. Triggs B, McLauchlan PF, Hartley RI, Fitzgibbon AW (2000) Bundle adjustment-a modern synthesis. In: Vision algorithms: theory and practice. Springer, pp 298–372

  37. Tsai RY (1987) A versatile camera calibration technique for high-accuracy 3d machine vision metrology using off-the-shelf tv cameras and lenses. IEEE J Robot Autom 3 (4):323–344

    Article  Google Scholar 

  38. Wang L-L, Tsai W-H (1990) Computing camera parameters using vanishing-line information from a rectangular parallelepiped. Mach Vis Appl 3(3):129–141

    Article  Google Scholar 

  39. Wang L-L, Tsai W-H (1991) Camera calibration by vanishing lines for 3-d computer vision. IEEE Trans Pattern Anal Mach Intell 4:370–376

    Article  Google Scholar 

  40. Weng J, Cohen P, Herniou M (1992) Camera calibration with distortion models and accuracy evaluation. IEEE Trans Pattern Anal Mach Intell 10:965–980

    Article  Google Scholar 

  41. Wikipedia. Football pitch. [Online]. Available: https://en.wikipedia.org/wiki/Football_pitch

  42. Wu Y, Hu Z (2006) A robust method to recognize critical configuration for camera calibration. Image Vis Comput 24(12):1313–1318

    Article  Google Scholar 

  43. Xu X, Xia J, Xiong J, Xie X-F (2012) Robust camera calibration with vanishing points. In: 5th international congress on image and signal processing (CISP), 2012. IEEE, pp 931–935

  44. Xu Y, Oh S, Hoogs A (2013) A minimum error vanishing point detection approach for uncalibrated monocular images of man-made environments. In: IEEE conference on computer vision and pattern recognition (CVPR), 2013. IEEE, pp 1376–1383

  45. You X, Zheng Y (2016) An accurate and practical calibration method for roadside camera using two vanishing points. Neurocomputing 204:222–230. Big Learning in Social Media AnalyticsContaining a selection of papers from the 2014 International Conference on Security, Pattern Analysis, and Cybernetics (ICSPAC2014)

    Article  Google Scholar 

  46. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334

    Article  Google Scholar 

  47. Zhu H, Yang J, Liu Z (2009) Fisheye camera calibration with two pairs of vanishing points. In: International conference on information technology and computer science, 2009. ITCS 2009, vol 1. IEEE, pp 321–324

Download references

Acknowledgments

The authors would like to thank Mr. Yasin Zamani for providing the synthetic 3D-rendered dataset of soccer images. Special thanks to Mr. Mostafa Hadian, Mr. Afshin Bozorgpour, and Mrs. Sara Monji-azad for their valuable comments and suggestions to improve this work. We also would like to thank Prof. Mahmoud Reza Pishvaie for his guidance in solving some of the equations. This work has been partly supported by a grant from Iran National Science Foundation (INSF).

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Sharif University of Technology, Tehran, Iran

    Mehran Fotouhi, Sadjad Fouladi & Shohreh Kasaei

Authors
  1. Mehran Fotouhi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sadjad Fouladi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shohreh Kasaei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shohreh Kasaei.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fotouhi, M., Fouladi, S. & Kasaei, S. Projection matrix by orthogonal vanishing points. Multimed Tools Appl 76, 16189–16223 (2017). https://doi.org/10.1007/s11042-016-3904-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3904-2

Keywords

Search

Navigation