Abstract
This paper presents a novel multi-functional, low-cost handheld multi-camera system (one dimensional camera array) - “CrossbowCam”. The CrossbowCam is suitable for multi-viewpoint image acquisition, smooth switching, alignment and seamless stitching applications. The proposed system differs from the traditional fixed image acquisition systems which are large-sized, high-priced, single functional, and can only captured images at specific locations. With the proposed system, the users can push one single button to change the configuration of the camera array rapidly to divergence (convex arc), parallel (linear), or convergence (concave arc). The three camera configurations can each be suitable for applications such as panorama image stitching, autostereoscopic 3D display, bullet-time (time-freeze) visual effect, 3D scene reconstruction, etc. To rapidly acquire the relationship among cameras after configuration change, we propose a two-stage calibration method to compensate the mechanical misalignment. The first stage adopts the traditional checkerboard calibration method to get the intrinsic parameters (focal length, principal point) and the lens distortion for each camera. The second stage requires no auxiliary tool but utilizes a large number of common feature points from multiple viewpoint images to acquire the extrinsic parameters (translation and rotation matrix) and to compensate the vertical misalignment and the horizontal uneven angle distribution due to the mechanical structure. The proposed system can then insert virtual viewpoint images between actual viewpoint images to allow the viewpoint switching more smoothly. The proposed system has eight cameras with maximum viewing angle of 90° in divergence mode, 38 mm spacing in parallel mode, and imaging radius of 10 m ∼ 0.5 m in convergence mode. We believe that the proposed system can potentially change the consumer habits and becomes the new type of home-use handheld camcorder system in the future.
Similar content being viewed by others
References
Akechi N, Kitahara I, Sakamoto R, Ohta Y (2014) Multi-resolution bullet-time effect. In: SIGGRAPH Asia posters
Alcantarilla PF, Solutions T (2011) Fast explicit diffusion for accelerated features in nonlinear scale spaces. IEEE Trans Patt Anal Mach Intell 34(7):1281–1298
Breeze-System: Dslr remote pro multi-camera. http://breezesys.com/MultiCamera/ (2015)
Brown M, Lowe DG (2007) Automatic panoramic image stitching using invariant features. Int’l J Comput Vis 74(1):59–73
Chen D, Sakamoto R (2014) Optimizing infinite homography for bullet-time effect. In: ACM SIGGRAPH posters
Debevec P (2012) The light stages and their applications to photoreal digital actors. SIGGRAPH Asia technical briefs
Dickie C, Fellion N, Vertegaal R (2012) Flexcam: using thin-film flexible oled color prints as a camera array. In: CHI Extended abstracts on human factors in computing systems. ACM, pp 1051–1054
Geiger A, Ziegler J, Stiller C (2011) Stereoscan: dense 3d reconstruction in real-time. In: Intelligent vehicles symposium (IV), 2011 IEEE. IEEE, pp 963–968
Ikeya K, Hisatomi K, Katayama M, Mishina T, Iwadate Y (2014) Bullet time using multi-viewpoint robotic camera system. In: Proc. of European conf. on visual media production
Kang YS, Ho YS (2008) Geometrical compensation algorithm of multiview image for arc multi-camera arrays. In: Advances in multimedia information processing-PCM. Springer, pp 543–552
Kang YS, Ho YS (2011) An efficient image rectification method for parallel multi-camera arrangement. IEEE Trans Consum Electron 57(3):1041–1048
Kang YS, Lee C, Ho YS (2008) An efficient rectification algorithm for multi-view images in parallel camera array. In: 3DTV Conf.: the true vision-capture, transmission and display of 3D video. IEEE, pp 61–64
Lee D (2015) Bullet time and the matrix. https://www.youtube.com/watch?v=bKEcElcTUMk
Lipski C, Linz C, Berger K, Sellent A, Magnor M (2010) Virtual video camera: image-based viewpoint navigation through space and time. In: Computer graphics forum, vol 29. Wiley Online Library, pp 2555–2568
Loop C, Zhang Z (1999) Computing rectifying homographies for stereo vision. In: IEEE Computer society conf. on computer vision and pattern recognition, vol 1. IEEE
Lowe DG (1999) Object recognition from local scale-invariant features. In: The proc. of the 7th IEEE int’l conf. on computer vision, vol 2. IEEE, pp 1150–1157
Lytro (2015) Illum. https://illum.lytro.com/illum
Nomura Y, Zhang L, Nayar SK (2007) Scene collages and flexible camera arrays. In: Proc. of the 18th Eurographics conf. on rendering techniques. Eurographics Association, pp 127–138
Nozick V (2013) Camera array image rectification and calibration for stereoscopic and autostereoscopic displays. Ann Telecommun-annales des té,lécommunications 68 (11-12):581–596
Nozick V, Saito H (2008) On-line free-viewpoint video: from single to multiple view rendering. Int J Autom Comput 5(3):257–267
Replay-Technology: FreeD - free dimensional video. http://replay-technologies.com (2015)
Ullman S (1979) The interpretation of structure from motion. Proc R Soc London B: Biol Sci 203(1153):405–426
Venkataraman K, Lelescu D, Duparré J, McMahon A, Molina G, Chatterjee P, Mullis R, Nayar S (2013) Picam: an ultra-thin high performance monolithic camera array. ACM Trans Graph (TOG) 32(6): 166
Wang Y, Wang J, Chang SF (2015) Camswarm: instantaneous smartphone camera arrays for collaborative photography. arXiv:1507.01148
Wang Y, Wang J, Chang SF (2015) Panoswarm: collaborative and synchronized multi-device panoramic photography. arXiv:1507.01147
Wilburn B, Joshi N, Vaish V, Talvala EV, Antunez E, Barth A, Adams A, Horowitz M, Levoy M (2005) High performance imaging using large camera arrays. ACM Trans Graph (TOG) 24(3):765–776
Yang J, Ding Z, Guo F, Wang H (2014) Multiview image rectification algorithm for parallel camera arrays. J Electron Imag 23(3):033,001–033,001
Zhang Z (2000) A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell 22(11):1330–1334
Acknowledgements
This work was supported in part by Ministry of Science and Technology, Taiwan via MOST104-2221-E-011-091-MY2 and MOST103-2221-E-011-105.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hsu, CH., Cheng, WH., Wu, YL. et al. CrossbowCam: a handheld adjustable multi-camera system. Multimed Tools Appl 76, 24961–24981 (2017). https://doi.org/10.1007/s11042-017-4852-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-017-4852-1