Skip to main content
Log in

CrossbowCam: a handheld adjustable multi-camera system

Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a novel multi-functional, low-cost handheld multi-camera system (one dimensional camera array) - “CrossbowCam”. The CrossbowCam is suitable for multi-viewpoint image acquisition, smooth switching, alignment and seamless stitching applications. The proposed system differs from the traditional fixed image acquisition systems which are large-sized, high-priced, single functional, and can only captured images at specific locations. With the proposed system, the users can push one single button to change the configuration of the camera array rapidly to divergence (convex arc), parallel (linear), or convergence (concave arc). The three camera configurations can each be suitable for applications such as panorama image stitching, autostereoscopic 3D display, bullet-time (time-freeze) visual effect, 3D scene reconstruction, etc. To rapidly acquire the relationship among cameras after configuration change, we propose a two-stage calibration method to compensate the mechanical misalignment. The first stage adopts the traditional checkerboard calibration method to get the intrinsic parameters (focal length, principal point) and the lens distortion for each camera. The second stage requires no auxiliary tool but utilizes a large number of common feature points from multiple viewpoint images to acquire the extrinsic parameters (translation and rotation matrix) and to compensate the vertical misalignment and the horizontal uneven angle distribution due to the mechanical structure. The proposed system can then insert virtual viewpoint images between actual viewpoint images to allow the viewpoint switching more smoothly. The proposed system has eight cameras with maximum viewing angle of 90° in divergence mode, 38 mm spacing in parallel mode, and imaging radius of 10 m ∼ 0.5 m in convergence mode. We believe that the proposed system can potentially change the consumer habits and becomes the new type of home-use handheld camcorder system in the future.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Akechi N, Kitahara I, Sakamoto R, Ohta Y (2014) Multi-resolution bullet-time effect. In: SIGGRAPH Asia posters

  2. Alcantarilla PF, Solutions T (2011) Fast explicit diffusion for accelerated features in nonlinear scale spaces. IEEE Trans Patt Anal Mach Intell 34(7):1281–1298

    Google Scholar 

  3. Breeze-System: Dslr remote pro multi-camera. http://breezesys.com/MultiCamera/ (2015)

  4. Brown M, Lowe DG (2007) Automatic panoramic image stitching using invariant features. Int’l J Comput Vis 74(1):59–73

    Article  Google Scholar 

  5. Chen D, Sakamoto R (2014) Optimizing infinite homography for bullet-time effect. In: ACM SIGGRAPH posters

  6. Debevec P (2012) The light stages and their applications to photoreal digital actors. SIGGRAPH Asia technical briefs

  7. Dickie C, Fellion N, Vertegaal R (2012) Flexcam: using thin-film flexible oled color prints as a camera array. In: CHI Extended abstracts on human factors in computing systems. ACM, pp 1051–1054

  8. Geiger A, Ziegler J, Stiller C (2011) Stereoscan: dense 3d reconstruction in real-time. In: Intelligent vehicles symposium (IV), 2011 IEEE. IEEE, pp 963–968

  9. Ikeya K, Hisatomi K, Katayama M, Mishina T, Iwadate Y (2014) Bullet time using multi-viewpoint robotic camera system. In: Proc. of European conf. on visual media production

  10. Kang YS, Ho YS (2008) Geometrical compensation algorithm of multiview image for arc multi-camera arrays. In: Advances in multimedia information processing-PCM. Springer, pp 543–552

  11. Kang YS, Ho YS (2011) An efficient image rectification method for parallel multi-camera arrangement. IEEE Trans Consum Electron 57(3):1041–1048

    Article  Google Scholar 

  12. Kang YS, Lee C, Ho YS (2008) An efficient rectification algorithm for multi-view images in parallel camera array. In: 3DTV Conf.: the true vision-capture, transmission and display of 3D video. IEEE, pp 61–64

  13. Lee D (2015) Bullet time and the matrix. https://www.youtube.com/watch?v=bKEcElcTUMk

  14. Lipski C, Linz C, Berger K, Sellent A, Magnor M (2010) Virtual video camera: image-based viewpoint navigation through space and time. In: Computer graphics forum, vol 29. Wiley Online Library, pp 2555–2568

  15. Loop C, Zhang Z (1999) Computing rectifying homographies for stereo vision. In: IEEE Computer society conf. on computer vision and pattern recognition, vol 1. IEEE

  16. Lowe DG (1999) Object recognition from local scale-invariant features. In: The proc. of the 7th IEEE int’l conf. on computer vision, vol 2. IEEE, pp 1150–1157

  17. Lytro (2015) Illum. https://illum.lytro.com/illum

  18. Nomura Y, Zhang L, Nayar SK (2007) Scene collages and flexible camera arrays. In: Proc. of the 18th Eurographics conf. on rendering techniques. Eurographics Association, pp 127–138

  19. Nozick V (2013) Camera array image rectification and calibration for stereoscopic and autostereoscopic displays. Ann Telecommun-annales des té,lécommunications 68 (11-12):581–596

    Article  Google Scholar 

  20. Nozick V, Saito H (2008) On-line free-viewpoint video: from single to multiple view rendering. Int J Autom Comput 5(3):257–267

    Article  Google Scholar 

  21. Replay-Technology: FreeD - free dimensional video. http://replay-technologies.com (2015)

  22. Ullman S (1979) The interpretation of structure from motion. Proc R Soc London B: Biol Sci 203(1153):405–426

    Article  Google Scholar 

  23. Venkataraman K, Lelescu D, Duparré J, McMahon A, Molina G, Chatterjee P, Mullis R, Nayar S (2013) Picam: an ultra-thin high performance monolithic camera array. ACM Trans Graph (TOG) 32(6): 166

    Article  Google Scholar 

  24. Wang Y, Wang J, Chang SF (2015) Camswarm: instantaneous smartphone camera arrays for collaborative photography. arXiv:1507.01148

  25. Wang Y, Wang J, Chang SF (2015) Panoswarm: collaborative and synchronized multi-device panoramic photography. arXiv:1507.01147

  26. Wilburn B, Joshi N, Vaish V, Talvala EV, Antunez E, Barth A, Adams A, Horowitz M, Levoy M (2005) High performance imaging using large camera arrays. ACM Trans Graph (TOG) 24(3):765–776

    Article  Google Scholar 

  27. Yang J, Ding Z, Guo F, Wang H (2014) Multiview image rectification algorithm for parallel camera arrays. J Electron Imag 23(3):033,001–033,001

    Article  Google Scholar 

  28. Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported in part by Ministry of Science and Technology, Taiwan via MOST104-2221-E-011-091-MY2 and MOST103-2221-E-011-105.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kai-Lung Hua.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hsu, CH., Cheng, WH., Wu, YL. et al. CrossbowCam: a handheld adjustable multi-camera system. Multimed Tools Appl 76, 24961–24981 (2017). https://doi.org/10.1007/s11042-017-4852-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-017-4852-1

Keywords

Navigation