Skip to main content
Log in

Hybrid fusion and interpolation algorithm with near-infrared image

Frontiers of Computer Science Aims and scope Submit manuscript

Abstract

Silicon-based digital cameras can record visible and near-infrared (NIR) information, in which the full color visible image (RGB) must be restored from color filter array (CFA) interpolation. In this paper, we propose a unified framework for CFA interpolation and visible/NIR image combination. To obtain a high quality color image, the traditional color interpolation from raw CFA data is improved at each pixel, which is constrained by the corresponding monochromatic NIR image in gradient difference. The experiments indicate the effectiveness of this hybrid scheme to acquire joint color and NIR information in real-time, and show that this hybrid process can generate a better color image when compared to treating interpolation and fusion separately.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Guarnera M, Messina G, Tomaselli V. Adaptive color demosaicing and false color removal. Journal of Electronic Imaging, 2010, 19(2): 1–16

    Article  Google Scholar 

  2. Menon D, Andriani S, Calvagno G. Demosaicing with directional filtering and a posteriori decision. IEEE Transactions on Image Processing, 2007, 16(1): 132–141

    Article  MathSciNet  Google Scholar 

  3. Su C Y, Kao W C. Effective demosaicing using subband correlation. IEEE Transactions on Consumer Electronics, 2009, 55(1): 199–204

    Article  Google Scholar 

  4. Chung K H, Chan Y H. Low-complexity color demosaicing algorithm based on integrated gradients. Journal of Electronic Imaging, 2010, 19(2): 1–15

    Article  Google Scholar 

  5. Itoh Y. Similarity-based demosaicing algorithm using unified highfrequency map. IEEE Transactions on Consumer Electronics, 2011, 57(2): 597–605

    Article  Google Scholar 

  6. Hirakawa K, Parks T W. Adaptive homogeneity-directed demosaicing algorithm. IEEE Transactions on Image Processing, 2005, 14(3): 360–369

    Article  Google Scholar 

  7. Wu X, Zhang N. Primary-consistent soft-decision color demosaicking for digital cameras. IEEE Transactions on Image Processing, 2004,13(9): 1263–1274

    Article  Google Scholar 

  8. Gunturk B K, Altunbasak Y, Mersereau R M. Color plane interpolation using alternating projections. IEEE Transactions on Image Process, 2002, 11(9): 997–1013

    Article  Google Scholar 

  9. Lian N, Chang L, Tan Y, Zagorodnov V. Adaptive filtering for color filter array demosaicking. IEEE Transactions on Image Processing, 2007,16(10): 2515–2525

    Article  MathSciNet  Google Scholar 

  10. Lu Y M, Karzand M, Vetterli M. Demosaicking by alternating projections: theory and fast one-step implementation. IEEE Transactions on Image Processing, 2010, 19(8): 2085–2098

    Article  MathSciNet  Google Scholar 

  11. Bennett E P, Mason J L, McMillan L. Multispectral bilateral video fusion. IEEE Transactions on Image Processing, 2007, 16(5): 1185–1194

    Article  MathSciNet  Google Scholar 

  12. Zhang X, Sim T, Miao X. Enhancing photographs with near infrared images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2008, 1–8

    Google Scholar 

  13. Schaul L, Fredembach C, Süsstrunk S. Color image dehazing using near-infrared. In: Proceedings of the 16th IEEE International Conference on Image Processing. 2009, 1629–1632

    Google Scholar 

  14. Süsstrunk S, Fredembach C, Tamburrino D. Automatic skin enhancement with visible and near-infrared image fusion. In: Proceedings of the International Conference on Multimedia. 2010, 1693–1696

    Google Scholar 

  15. Fredembach C, Süsstrunk S. Illuminant estimation and detection using near-infrared. In: Proceedings of the International Society for Optics and Photonics Digital Photography. 2009

    Google Scholar 

  16. Salamati N, Fredembach C, Süsstrunk S. Material classification using color and NIR images. In: Proceedings of the 17th Color Imaging Conference Final Program and Proceedings. 2009, 216–227

    Google Scholar 

  17. Fredembach C, Süsstrunk S. Colouring the near-infrared. In: Proceedings of the 16th Color Imaging Conference Final Program and Proceedings. 2008, 176–182

    Google Scholar 

  18. Krishnan D, Fergus R. Dark flash photography. ACM Transactions on Graphics, 2009, 28(3), Artile No. 96

    Google Scholar 

  19. Matsui S, Okabe T, Shimano M, Sato Y. Image enhancement of lowlight scenes with near-infrared flash images. Lecture Notes in Computer Science, 2010, 5994: 213–223

    Article  Google Scholar 

  20. Hirakawa K, Parks TW. Joint demosaicing and denoising. IEEE Transactions on Image Processing, 2006, 15(8): 2146–2157

    Article  Google Scholar 

  21. Donoho D L. Sparse components of images and optimal atomic decomposition. Constructive Approximation, 2001, 17(3): 353–382

    Article  MATH  MathSciNet  Google Scholar 

  22. Donoho D L. Compressed sensing. IEEE Transactions on Information Theory, 2006, 52(4): 1289–1306

    Article  MATH  MathSciNet  Google Scholar 

  23. Wang Y, Yang J, Yin W, Zhang Y. A new alternating minimization algorithm for total variation image reconstruction. SIAM Journal on Imaging Sciences, 2008, 1(3): 248–272

    Article  MATH  MathSciNet  Google Scholar 

  24. Lu Y M, Fredembach C, Vetterli M, Süsstrunk S. Designing color filter arrays for the joint capture of visible and near-infrared images. In: Proceedings of the 16th IEEE International Conference on Image Processing. 2009, 3797–3800

    Google Scholar 

  25. Smith P R. Bilinear interpolation of digital images. Ultramicroscopy, 1981, 6(2): 201–204

    Article  Google Scholar 

  26. Hamilton J F, Adams J E. Adaptive color plane interpolation in single sensor color electronic camera. US Patent, 5 629 734, 1997-07-29

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiaoyan Luo.

Additional information

Xiaoyan Luo received her BS degree from Taiyuan University of Technology, China in 2004, and her MS and PhD degrees from Beihang University, China in 2007 and 2012, respectively. She is currently a lecturer in the Image Processing Center, School of Astronautics, Beihang University, China. Her research interests include image processing, computer vision and pattern recognition.

Jun Zhang received his BS, MS, and PhD degrees from Beihang University, China in 1987, 1991 and 2001, respectively. He is currently a professor and vice-president of Beihang University, China. His research interests lie in the areas of signal processing, integrated and heterogeneous networks, and wireless communications.

Qionghai Dai received his BS degree in mathematics from Shanxi Normal University, China in 1987, and his ME and PhD degrees in computer science and automation from Northeastern University, China in 1994 and 1996, respectively. Since 1997, he has been with the faculty of Tsinghua University, China, where he is currently a professor and the director of the Broadband Networks and Digital Media Laboratory. His research areas include signal processing, broad-band networks, video processing, and communication.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Luo, X., Zhang, J. & Dai, Q. Hybrid fusion and interpolation algorithm with near-infrared image. Front. Comput. Sci. 9, 375–382 (2015). https://doi.org/10.1007/s11704-014-4230-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11704-014-4230-3

Keywords

Navigation