Skip to main content
SpringerLink
Log in

Color correction algorithm based on camera characteristics for multi-view video coding

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Various types of multi-view camera systems have been proposed for capturing three dimensional scenes. Yet, color distributions among multi-view images remain inconsistent in most cases, degrading multi-view video coding performance. In this paper, we propose a color correction algorithm based on the camera characteristics to effectively solve such a problem. Initially, we model camera characteristics and estimate their coefficients by means of correspondences between views. To consider occlusion in multi-view images, correspondences are extracted via feature-based matching. During coefficient estimation with nonlinear regression, we remove outliers in the extracted correspondences. Consecutively, we generate lookup tables for each camera using the model and estimated coefficients. Such tables are employed for fast color converting in the final color correction process. The experimental results show that our algorithm enhances coding efficiency with gains of up to 0.9 and 0.8 dB for luminance and chrominance components, respectively. Further, the method also improves subjective viewing quality and reduces color distance between views.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Abbreviations

P ref :

Pixel values of reference

P tar :

Pixel values of target cameras

C gain :

Coefficients for gain

C offset :

Coefficients for offset

C gamma :

Coefficients for gamma

2bitdepth :

The total number of gray levels

y :

Pixel value of the reference image in the sample set

x :

Pixel value of the target image corresponding to y

\({\bar{\beta}}\) :

Vector consisting of coefficients for each camera property

\({\bar{{J}}_{\bar{e}}}\) :

m × 3 Jacobian matrix whose ith row equals to \({\partial (e_i (\bar{\beta}))/\partial \bar{\beta} }\)

x e :

Estimated value from the camera characteristic curve

a :

Controlling parameter to distinguish outliers

References

  1. Bernardini F., Rushmeier H.: The 3D model acquisition pipeline. Comput. Graph. Forum 21(2), 149–172 (2002)

    Article  Google Scholar 

  2. Majumder, A., Seales, W., Gopi, M., Fuchs, H.: Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery. In: Proceedigns of 7th ACM International Conference Multimedia, Orlando, USA, pp. 169–178 (Oct. 30–Nov. 5, 1999)

  3. Lee E., Ho Y.: Generation of multi-view video using a fusion camera system for 3D displays. In: IEEE Trans. Consum. Electron. 56(4), 2797–2805 (2010)

    Google Scholar 

  4. Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of SIGGRAPH 96, New Orleans, USA, pp. 33–42 (Aug. 4–9, 1996)

  5. Chen, X., Luthra, A.: MPEG-2 multiview profile and its application in 3D TV. In: Proceedings of SPIE Multimedia Hardware Architectures, San Jose, USA, Feb. 10–14, pp. 212–223 (Feb. 10–14, 1997)

  6. Karim, H., Worrall, S., Sadka, A., Kondoz, A.: 3D Video compression using MPEG-4-multiple Auxiliary Component (MPEG4-MAC). In: Presented at IEE 2nd International Conference Visual Information Engineering, Glasgow, Scotland (April 4–6, 2005)

  7. Smolic, A., Mueller, K., Merkle, P., Fehn, C., Kauff, P., Eisert, P., Wiegand, T.: 3D video and free viewpoint video—technologies, applications and MPEG standards. In: Proceedings of IEEE International Conference Multimedia and Expo, Toronto, Canada, pp. 2161–2164 (July 9–12, 2006)

  8. Smolic A., McCutchen D.: 3DAV exploration of video-based rendering technology in MPEG. In: IEEE Trans. Circuits Syst. Video Technol. 14(3), 348–356 (2004)

    Google Scholar 

  9. Kang Y., Ho Y.: An efficient image rectification method for parallel multi-camera arrangement. In: IEEE Trans. Consum. Electron. 57(3), 1041–1048 (2011)

    Google Scholar 

  10. Finlayson G., Hordley S., Hubel P.: Color by correlation: a simple, unifying, framework for color constancy. In: IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1209–1221 (2001)

    Google Scholar 

  11. Forsyth D.: A novel algorithm for Colour Constancy. Int. J. Comput. Vis. 5(1), 5–36 (1990)

    Article  MathSciNet  Google Scholar 

  12. Ilie, A., Welch, G.: Ensuring color consistency across multiple cameras. In: Proceedings of IEEE Internatioal Conference Computer Vision, Vol. 2, Beijing, China, pp. 1268–1275 (Oct. 17–21, 2005)

  13. Joshi, N., Wilburn, B., Vaish, V., Levoy, M., Horowitz, M.: Automatic color calibration for large camera arrays. UCSD CSE Technical Report CS2005-0821 (May 2005)

  14. Fecker U., Barkowsky M., Kaup A.: Histogram-based prefiltering for luminance and chrominance compensation of multiview video. In: IEEE Trans. Circuits Syst. Video Technol. 18(9), 1258–1267 (2008)

    Google Scholar 

  15. Chen, Y., Chen, J., Cai, C.: Luminance and chrominance correction for multi-view video using simplified color error model. In: Proceedings of Picture Coding Symposium, Hangzhou, China, pp. 2–17 (Nov. 2–4, 2006)

  16. Jiang, G., Shao, F., Yu, M., Chen, K., Chen, X.: New color correction approach to multi-view images with region correspondence. Lecture Notes Comput. Sci., Vol. 4113, 1224–1228 (2006)

  17. Yamamoto K., Kitahara M., Kimata H., Yendo T., Fujii T., Tanimoto M., Shimizu S., Kamikura K., Yashima Y.: Multiview video coding using view interpolation and color correction. In: IEEE Trans. Circuits Syst. Video Technol. 17(11), 1436–1449 (2007)

    Google Scholar 

  18. Lowe D.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  19. Gill E., Murray W.: Algorithms for the solution of the nonlinear least-squares Problem. SIAM J. Numer. Anal. 15(5), 977–992 (1978)

    Article  MATH  MathSciNet  Google Scholar 

  20. Shim, W., Park, G., Yang, J.: CE5: Illumination compensation. In: Presented at 31st Meeting of Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, Marrakech, Morocco, Doc. JVT-V305 (Jan. 13–19, 2007)

  21. Pateux, S., Jung, J.: An excel add-in for computing Bjontegaard metric and its evolution. In: Presented at 31st VCEG Meeting of ITU-T Q6/SG16, Marrakech, Morocco, Doc. VCEG-AE07 (Jan. 15–16, 2007)

  22. ITU-R Recommendation BT.500-11: Methodology for the Subjective Assessment of the Quality of Television Pictures. ITU Technical Report, Geneva, Switzerland (2002)

Download references

Author information

Authors and Affiliations

  1. Department of Information and Communications (C-412), Gwangju Institute of Science and Technology (GIST), 123 Cheomdangwagi-ro, Buk-gu, Gwangju, 500-712, Korea

    Jae-Il Jung & Yo-Sung Ho

Authors
  1. Jae-Il Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yo-Sung Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jae-Il Jung.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jung, JI., Ho, YS. Color correction algorithm based on camera characteristics for multi-view video coding. SIViP 8, 955–966 (2014). https://doi.org/10.1007/s11760-012-0341-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-012-0341-1

Keywords

Search

Navigation