Skip to main content
SpringerLink
Log in

An interactive cameraless projector calibration method

  • Original Article
  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

The geometric calibration of projectors is a demanding task in many areas related to computer vision, virtual reality or augmented reality, to name some. Up to date, different methods have been proposed to retrieve the intrinsic and extrinsic parameters of projectors. During the last 20 years, researchers have used cameras as means to calibrate projectors in order to automatize the process. However, this might add: (1) complexity in terms of mathematical formulation; (2) restrictions in terms of camera locations relative to projectors; and (3) additional errors (those due to the camera calibration itself). Most of these camera-based methods make use of planar homographies, and others require an extended calibration process (for both the camera and the projector). In this paper, we present an approach that combines a direct transformation method (DLT) with projected augmented reality to perform an interactive calibration of projectors without the need for cameras. This method is based on non-coplanar points and 2D/3D correspondences, which are interactively established. Intrinsic and extrinsic calibration is achieved in a single step, making use of the DLT. The method rescues old approaches to calibrate projectors, but brings the new capabilities of interactive systems, all integrated in a single software solution. We conduct different experiments by considering two projector setups and two different sets of control points, proving that the accuracy of the method in the real space can be between one and two pixels.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Ashdown M, Sato Y (2005) Steerable projector calibration. In: Computer vision and pattern recognition—workshops, 2005. IEEE computer society conference on CVPR workshops, p 8. https://doi.org/10.1109/cvpr.2005.533

  • Axholt M et al. (2010) Optical see-through head mounted display direct linear transformation calibration robustness in the presence of user alignment noise. In: Proceedings of the human factors and ergonomics society annual meeting, vol 28. SAGE Publications Sage CA: Los Angeles, pp 2427–2431

    Article  Google Scholar 

  • Bimber O, Raskar R (2005) Spatial augmented reality: merging real and virtual worlds. CRC Press, Boca Raton

    Book  Google Scholar 

  • Brown M, Majumder A, Yang R (2005) Camera-based calibration techniques for seamless multiprojector displays. IEEE Trans Vis Comput Gr 11:193–206. https://doi.org/10.1109/tvcg.2005.27

    Article  Google Scholar 

  • Chen H, Sukthankar R, Wallace G, Li K (2002) Scalable alignment of large-format multi-projector displays using camera homography trees. In: Visualization, 2002. VIS 2002. IEEE, pp 339–346. https://doi.org/10.1109/visual.2002.1183793

  • Chen B-S, Zhong Q, Li H-F, Liu X, Xu H-S (2014) Automatic geometrical calibration for multiprojector-type light field three-dimensional display. OPTICE 53:073107. https://doi.org/10.1117/1.oe.53.7.073107

    Article  Google Scholar 

  • Chen R, Xu J, Chen H, Su J, Zhang Z, Chen K (2016) Accurate calibration method for camera and projector in fringe patterns measurement system. Appl Opt 55:4293–4300. https://doi.org/10.1364/ao.55.004293

    Article  Google Scholar 

  • Chien HJ, Chen CY, Chen CF (2010) A target-adapted geometric calibration method for camera-projector system. In: 2010 25th international conference of image and vision computing New Zealand (IVCNZ), 2010, pp 1–8. https://doi.org/10.1109/ivcnz.2010.6148842

  • Deglint J, Cameron A, Scharfenberger C, Sekkati H, Lamm M, Wong A, Clausi DA (2016) Auto-calibration of a projector–camera stereo system for projection mapping. J Soc Inf Disp 24:510–520. https://doi.org/10.1002/jsid.464

    Article  Google Scholar 

  • Dermanis A (1994) Free network solutions with the direct linear transformation method. ISPRS J Photogramm Remote Sens 49:2–12

    Article  Google Scholar 

  • Fernandez S, Salvi J (2011) Planar-based camera-projector calibration. In: 2011 7th international symposium on image and signal processing and analysis (ISPA), 2011, pp 633-638

  • Gockel T, Azad P, Dillmann R (2004) Calibration issues for projector-based 3D-scanning. In: Proceedings of shape modeling applications, 2004. IEEE, pp 367–370

  • Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University Press, Cambridge

    MATH  Google Scholar 

  • Harville M, Culbertson B, Sobel I, Gelb D, Fitzhugh A, Tanguay D (2006) Practical methods for geometric and photometric correction of tiled projector. In: Conference on computer vision and pattern recognition workshop, 2006. CVPRW ‘06, p 5. https://doi.org/10.1109/cvprw.2006.161

  • Hong W, Gelb D, Trott M (2012) Automatic calibration of a projector-camera system with a see-through screen. In: 2012 19th IEEE international conference on image processing (ICIP), 2012 pp 337–340. https://doi.org/10.1109/icip.2012.6466864

  • Huang Z, Xi J, Yu Y, Guo Q (2015) Accurate projector calibration based on a new point-to-point mapping relationship between the camera and projector images. Appl Opt 54:347–356. https://doi.org/10.1364/ao.54.000347

    Article  Google Scholar 

  • Kimura M, Mochimaru M, Kanade T (2007) Projector calibration using arbitrary planes and calibrated camera. In: IEEE conference on computer vision and pattern recognition, 2007. CVPR ‘07, pp 1–2. https://doi.org/10.1109/cvpr.2007.383477

  • Knyaz VA (2006) Automated calibration technique for photogrammetric system based on a multi-media projector and a CCD Camera. In: Maas H-G, Schneider D (eds.) Proceedings of the ISPRS commission V symposium image engineering and vision metrology, Dresden, Germany

  • Kraus K (1997) Photogrammetry. Advanced methods and applications, vol 2. Dümmler/Bonn, Germany

  • Liao J, Cai L (2008) A calibration method for uncoupling projector and camera of a structured light system. In: IEEE/ASME international conference on advanced intelligent mechatronics, 2008. AIM 2008, Xian, China, pp 770–774. https://doi.org/10.1109/aim.2008.4601757

  • MadMapper (2017) MadMapper—The Mapping Software. https://madmapper.com/. Accessed 02 July 2018

  • Martynov I, Kamarainen J-K, Lensu L (2011) Projector calibration by “inverse camera calibration”. In: Scandinavian conference on image analysis, Springer, pp 536–544

  • Moreno D, Taubin G (2012) Simple, accurate, and robust projector-camera calibration. In: 2012 Second international conference on 3D imaging, modeling, processing, visualization and transmission (3DIMPVT), Zürich, Switzerland, pp 464–471. https://doi.org/10.1109/3dimpvt.2012.77

  • Okatani T, Deguchi K (2006) Autocalibration of an Ad Hoc construction of multi-projector displays. In: Conference on computer vision and pattern recognition workshop, 2006. CVPRW ‘06, New York, NY, USA, p 8. https://doi.org/10.1109/cvprw.2006.35

  • Orghidan R, Salvi J, Gordan M, Florea C, Batlle J (2014) Structured light self-calibration with vanishing points. Mach Vis Appl 25:489–500. https://doi.org/10.1007/s00138-013-0517-x

    Article  Google Scholar 

  • Park S-Y, Park GG Active calibration of camera-projector systems based on planar homography. In: 2010 20th international conference on pattern recognition (ICPR), pp 320–323. https://doi.org/10.1109/icpr.2010.87

  • Portalés C, Ribes-Gómez E, Pastor B, Gutiérrez A (2015) Calibration of a camera–projector monochromatic system. Photogramm Rec 30:82–99. https://doi.org/10.1111/phor.12094

    Article  Google Scholar 

  • Portalés C, Casas S, Coma I, Fernández M (2017) A multi-projector calibration method for virtual reality simulators with analytically defined screens. J Imaging 3:19

    Article  Google Scholar 

  • Portalés C, Orduña JM, Morillo P, Gimeno J (2018) An efficient projector calibration method for projecting virtual reality on cylindrical surfaces. Multimed Tools Appl. https://doi.org/10.1007/s11042-018-6253-5

    Article  Google Scholar 

  • Qi W, Li F, Zhenzhong L (2010) Review on camera calibration. In: 2010 Chinese control and decision conference (CCDC). IEEE, pp 3354–3358

  • Qian L, Winkler A, Fuerst B, Kazanzides P, Navab N (2016) Modeling physical structure as additional constraints for stereoscopic optical see-through head-mounted display calibration. In: 2016 IEEE international symposium on mixed and augmented reality (ISMAR-Adjunct), pp 154–155. https://doi.org/10.1109/ismar-adjunct.2016.0065

  • Raij A, Pollefeys M (2004) Auto-calibration of multi-projector display walls. In: Proceedings of the 17th international conference on pattern recognition. ICPR 2004, vol. 11. pp 14–17. https://doi.org/10.1109/icpr.2004.1333994

  • Raskar R et al (1999) Multi-projector displays using camera-based registration. In: Proceedings of visualization ‘99, pp 161–522. https://doi.org/10.1109/visual.1999.809883

  • Sajadi B, Majumder A (2009) Markerless view-independent registration of multiple distorted projectors on extruded surfaces using an uncalibrated camera. IEEE Trans Visual Comput Gr 15:1307–1316. https://doi.org/10.1109/tvcg.2009.166

    Article  Google Scholar 

  • Sajadi B, Majumder A (2010) Auto-calibration of cylindrical multi-projector systems. In: 2010 IEEE virtual reality conference (VR), Waltham, Massachusetts, USA, pp 155–162. https://doi.org/10.1109/vr.2010.5444797

  • Sun W, Sobel I, Culbertson B, Gelb D, Robinson I (2008) Calibrating multi-projector cylindrically curved displays for “wallpaper” projection. In: Paper presented at the proceedings of the 5th ACM/IEEE international workshop on projector camera systems, Marina del Rey, California

  • Tao J, Zhang J, Zhang Z (2004) Calibration of a projector with a planar grid ISPRS. Istanbul, Turkey

    Google Scholar 

  • Tardif JP, Roy S, Trudeau M (2003) Multi-projectors for arbitrary surfaces without explicit calibration nor reconstruction. In: Proceedings Fourth international conference on 3-D digital imaging and modeling, 3DIM 2003, pp 217–224. https://doi.org/10.1109/im.2003.1240253

  • Zhang J, Tao J, Zhang Z A flexible technique for slide projector calibration. In: Third international symposium on multispectral image processing and pattern recognition, 2003. International Society for Optics and Photonics, pp 187–191

  • Zhang B, Li YF, Wu YH (2007) Self-recalibration of a structured light system via plane-based homography. Pattern Recogn 40:1368–1377. https://doi.org/10.1016/j.patcog.2006.04.001

    Article  MATH  Google Scholar 

  • Zhang X, Zhang Z, Cheng W (2015) Iterative projector calibration using multi-frequency phase-shifting method. In: 2015 IEEE 7th international conference on cybernetics and intelligent systems (CIS) and IEEE conference on robotics, automation and mechatronics (RAM), pp 1–6. https://doi.org/10.1109/iccis.2015.7274538

  • Zhao L, Weng D, Li D (2014) The auto-geometric correction of multi-projector for cylindrical surface using Bézier patches. J Soc Inform Display 22:473–481. https://doi.org/10.1002/jsid.264

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Robotics and Information and Communication Technologies (IRTIC), Universitat de València, Valencia, Spain

    Cristina Portalés, Pablo Casanova-Salas, Sergio Casas, Jesús Gimeno & Marcos Fernández

Authors
  1. Cristina Portalés
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pablo Casanova-Salas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sergio Casas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jesús Gimeno
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marcos Fernández
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Cristina Portalés.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Portalés, C., Casanova-Salas, P., Casas, S. et al. An interactive cameraless projector calibration method. Virtual Reality 24, 109–121 (2020). https://doi.org/10.1007/s10055-018-00377-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10055-018-00377-3

Keywords

Search

Navigation