Abstract
Systems using numerous cameras are emerging in many fields due to their ease of production and reduced cost, and one of the fields where they are expected to be used more actively in the near future is in image-based rendering (IBR). Color correction between views is necessary to use multi-view systems in IBR to make audiences feel comfortable when views are switched or when a free viewpoint video is displayed. Color correction usually involves two steps: the first is to adjust camera parameters such as gain, brightness, and aperture before capture, and the second is to modify captured videos through image processing. This paper deals with the latter, which does not need a color pattern board. The proposed method uses scale invariant feature transform (SIFT) to detect correspondences, treats RGB channels independently, calculates lookup tables with an energy-minimization approach, and corrects captured video with these tables. The experimental results reveal that this approach works well.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
K. Yamamoto, U. James. Color Calibration for Multi-camera System by Using Color Pattern Board, Technical Report MECSE-3-2006, Monash University DECSE, 2006.
K. Yamamoto, U. James. Color Calibration for Multi-camera System without Color Pattern Board, Technical Report MECSE-4-2006, Monash University DECSE, 2006.
K. Yamamoto, T. Yendo, T. Fujii, M. Tanimoto, D. Suter. Colour Correction for Multiple-camera System by Using Correspondences. Journal of the Institute of Image Information and Television Engineers, vol. 61, no. 2, pp. 213–222, 2007.
M. P. Tehrani, A. Ishikawa, S. Sakazawa, A. Koike. Color Correction of Multiview Camera System Using Matched Feature Points. In Proceedings of Forum on Information Technology, Toyota, Japan, pp. 371–372, 2007.
A. Ilie, G. Welch. Ensuring Color Consistency across Multiple Cameras. In Proceedings of the 10th IEEE International Conference on Computer Vision, IEEE Press, Beijing, PRC, pp. 1268–1275, 2005.
N. Joshi, B. Wilburn, V. Vaish, M. Levoy, M. Horowitz. Automatic Color Calibration for Large Camera Arrays, Technical Report CS2005-0821, Department of Computer Science and Engineering, UCSD Jacobs School, 2005.
U. Fecker, M. Barkowsky, A. Kaup. Improving the Prediction Efficiency for Multi-view Video Coding Using Histogram Matching. In Proceedings of Picture Coding Symposium, Beijing, PRC, pp. 2–16, 2006.
K. Sohn, Y. Kim, J. Seo, J. Yoon, C. Park, J. Lee. H.264/AVC-compatible Multi-view Video Coding, ISO/IEC JTC1/SC29/WG11, M12874, 2006.
Y. Kawai, F. Tomita. Intensity Calibration for Stereo Images Based on Segment Correspondence. In Proceedings of IAPR Workshop on Machine Vision Applications, Chiba, Japan, pp. 331–334, 1998.
Y. Chen, J. Chen, C. Cai. Luminance and Chrominance Correction for Multi-view Video Using Simplified Color Error Model. In Proceedings of Picture Coding Symposium, Beijing, PRC, pp. 2–17, 2006.
M. P. Tehrani, P. N. Bangchang, T. Fujii, M. Tanimoto. The Optimization of Distributed Processing for Arbitrary View Generation in Camera Sensor Networks. IEICE Transactions on Fundamentals of Electronics, Communication and Computer Sciences, vol. E87-A, no. 8, pp. 1863–1870, 2004.
D. G. Lowe. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, vol. 60, no. 2, pp. 91–110, 2004.
K. Yamamoto, T. Yendo, T. Fujii, M. Tanimoto. Colour Correction of Multi-view Video by Using Correspondences. In Proceedings of the 4th Symposium on Intelligent Media Integration for Social Information, Nagoya, Japan, pp. 65–66, 2006.
Call for Proposals on Multi-view Video Coding, ISO/IEC JTC1/SC29/WG11, N7327, 2005.
Author information
Authors and Affiliations
Corresponding author
Additional information
Kenji Yamamoto received his B.Eng. and M.Eng. degrees in electrical and mechanical engineering, and Ph.D. degree in information electronics from Nagoya University, Nagoya, Japan, in 1993, 1995, and 2007, respectively. He is currently an expert researcher at the National Institute of Information and Communications Technology in Japan.
His research interests include 3D image capture, free viewpoint video generation, multi-view video coding, 3D display, and digital holography systems.
Ryutaro Oi received his Ph.D. degree in science from the University of Tokyo, Japan, in 2004. From 2004 to 2006, he was a visiting fellow researcher at the Science and Technical Research Laboratories of the Japan Broadcasting Corporation (NHK), Tokyo, Japan. He joined the National Institute of Information and Communications Technology, Japan, in 2006, where he is currently a researcher at the Universal Media Research Center.
His research interests include computational image sensor VLSI, multi-camera processing, ray-based 3D display systems, and digital holography systems.
Rights and permissions
About this article
Cite this article
Yamamoto, K., Oi, R. Color correction for multi-view video using energy minimization of view networks. Int. J. Autom. Comput. 5, 234–245 (2008). https://doi.org/10.1007/s11633-008-0234-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11633-008-0234-5