Skip to main content

Advertisement

SpringerLink
Log in

Digital Image Fusion Using HVS in Block Based Transforms

  • Published:
Journal of Signal Processing Systems Aims and scope Submit manuscript

Abstract

The main aim of image fusion is to integrate the qualitative visual information from multiple images into a single image. Image fusion is implemented in spatial and transform domains. The implementation of algorithm in spatial domain is simple. But, the images are stored/transmitted using popular methods like JPEG and JPEG2000, which are implemented in the transform domain. Therefore fusion algorithms in spatial domain are not suitable for real time application. Image transforms are categorized as block-based and multi resolution-based transforms. In this study, block-based transforms such as Hadamard Transform (HT), Discrete Cosine Transform (DCT), Haar Transform (HrT), and Slant Transform (ST) are considered for image fusion. The DCT based approaches are suffering from undesirable side effects such as blurring and blocking artifacts that reduce the quality of the fused image. In this paper, the Human Visual System (HVS) model is considered to select the appropriate block from multiple images to obtain the fused image. The proposed approach is applied to all the block-based transforms to assess the performance. Methods such as Mutual Information (MI), Edge Strength and Orientation Preservation (ESOP), Feature Similarity Index (FSIM), Normalized Cross Correlation (NCC) and Score are used to assess the performance of the proposed algorithms. The experimental results indicate that the proposed method is better in terms of improved quality and reduced blocking artifacts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6

Similar content being viewed by others

References

  1. Li, S., Yang, B., & Hu, J. (2011). Performance comparison of different multi-resolution transforms for image fusion. Information Fusion., 12(2), 74–84.

    Article  Google Scholar 

  2. Rockinger, O. (1995). Image sequence fusion using a shift – Invariant wavelet transform. Proceedings of IEEE International Conference on Image Processing, 3, 288–291.

    Article  Google Scholar 

  3. Stathaki, T. (2008). Image fusion algorithms and applications. US: Academic Press.

    Google Scholar 

  4. Blum, R. S., & Liu, Z. (2006). Multi-sensor image fusion and its applications. Boca Raton: CRC Press, Taylor & Francis Group.

    Google Scholar 

  5. Garzelli, A. (2002). Possibilities and limitations of the use of wavelets in image fusion. IEEE Geosciences and remote sensing symposium., 1, 66–68.

    Article  Google Scholar 

  6. Liu, X., & Wang, J. (2013). Image fusion based on shearlet transform and regional features. International Journal of Electronics and Communications (AEÜ)., 51132, 1–7.

    Google Scholar 

  7. Darwish, S. M. (2013). Multi-level fuzzy contourlet-based image fusion for medical applications. Image Processing IET., 7(7), 694–700.

    Article  Google Scholar 

  8. Veeraswamy, K., Srinivaskumar, S., & Chatterji, B. N. (2007). Designing quantization table for Hadamard transform based on human visual system for image compression. ICGST-GVIP journal., 7(3), 31–38.

    Google Scholar 

  9. Hu, J., & Luo, Y. (2014). Single-image super resolution based on local regression and nonlocal self-similarity. Journal of Electronic Imaging, 23(3), 033014.

    Article  MathSciNet  Google Scholar 

  10. Ben-Shoshan, Y., & Yitzhaky, Y. (2014). Improvements of image fusion methods. Journal of Electronic Imaging, 23(2), 023021.

    Article  Google Scholar 

  11. Liu, H., Yang, J., Wu, Z., & Zhang, Q. (2015). Fast single image dehazing based on image fusion. Journal of Electronic Imaging, 24(1), 013020.

    Article  Google Scholar 

  12. Wang, C., Lee, S., & Chang, L. (2001). Designing JPEG quantization tables based on human visual system. Signal Processing: Image Communication, 16(5), 501–506.

    Google Scholar 

  13. Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2011). Multi-focus image fusion for visual sensor networks in DCT domain. Computers and Electrical Engineering, 37(5), 789–797.

    Article  MATH  Google Scholar 

  14. Tang, J. (2004). A contrast based image fusion technique in the DCT domain. Digital Signal Processing, 14(3), 218–226.

    Article  Google Scholar 

  15. Veeraswamy, K., Mohan, B. C., Reddy, B. Y. V., & Radhika, V. (2010). A Robust Digital Image Watermarking Scheme using Human Visual System. Paper presented at the International conference on VLSI design & Communication Systems.

  16. Pratt, W. K., Chen, W., & Welch, L. R. (1974). Slant transform image coding. IEEE Transactions on Communications, 22(8), 1075–1093.

    Article  Google Scholar 

  17. Veeraswamy, K., Mohan, B. C., & Kumar, S. S. (2010). HVS based Robust Image Watermarking Scheme using Slant Transform. Paper presented at the International conference on Digital Image Processing.

  18. Gonzalez, R. C., Woods, R. E., & Eddins, S. L. (2006). Digital Image Processing Using MATLAB. (Low price ed.).

  19. Assa, A., & Janabi-Sharifi, F. (2014). A Robust vision-based sensor fusion approach for real-time pose estimation. IEEE Transaction on Cybernetics., 44(2), 217–228.

    Article  Google Scholar 

  20. Sannen, D., & Brussel, H. V. (2012). A multilevel information fusion approach for visual quality inspection. Information Fusion., 13(1), 48–59.

    Article  Google Scholar 

  21. Xia, Y., & Leung, H. (2014). A fast learning algorithm for blind data fusion using a novel L2-norm estimation. IEEE Sensors Journal, 14(3), 666–672.

    Article  Google Scholar 

  22. Yuan, Q., Zhang, L., & Shen, H. (2014). Hyperspectral image Denoising with a spatial–spectral view fusion strategy. IEEE Transactions on Geoscience and Remote Sensing, 52(5), 2314–2325.

    Article  Google Scholar 

  23. Mahyari, A. G., & Yazdi, M. (2011). Panchromatic and multispectral image fusion based on maximization of both spectral and spatial similarities. IEEE Transaction on Geosciences and Remote Sensing., 49(6), 1976–1986.

    Article  Google Scholar 

  24. Mannos, J. L., & Sakrison, D. J. (1974). The effect of a visual fidelity criterion in the encoding of images. IEEE Transactions on Information Theory, 20(4), 525–536.

    Article  MATH  Google Scholar 

  25. Levicky, D., & Foris, P. (2004). Human Visual System Models in Digital Image Watermarking. Radio Engineering., 13(4), 38–43.

    Google Scholar 

  26. Panetta, K. A., Wharton, E. J., & Agaian, S. S. (2008). Human visual system–based image enhancement and logarithmic contrast measure. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, 38(1), 174–188.

    Article  Google Scholar 

  27. Jung, S., Ha, L. T., & Ko, S. (2011). A new histogram modification based reversible data hiding algorithm considering the human visual system. IEEE Signal Processing Letters, 18(2), 95–98.

    Article  Google Scholar 

  28. Lee, K., Moorthy, A. K., Lee, S., & Bovik, A. C. (2014). 3D visual activity assessment based on natural scene statistics. IEEE Transactions on Image Processing, 23(1), 450–465.

    Article  MathSciNet  MATH  Google Scholar 

  29. Vadhi, R., Veeraswamy, K., & Kumar, S. S. (2014). Performance evaluation of statistical measures for image fusion in spatial domain. Paper presented at the First International Conference on Networks & Soft Computing (ICNSC).

  30. Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2010). Real-time fusion of multi-focus images for visual sensor networks. Paper presented at the 6th Iranian Conference on Machine Vision and Image Processing (MVIP), Isfahan, Iran.

  31. Piella, G. (2004) New quality measures for image fusion. In 7th International Conference on Information Fusion, Stockholm, Sweden (pp. 542–546).

  32. Vadhi, R., Kilari, V. S., & Srinivas Kumar, S. (2016). An Image Fusion Technique Based on Hadamard Transform and HVS, Engineering, Technology & Applied Science Research, 6(4), 1075–1079.

  33. Xydeas, C. S., & Petrovic, V. (2000). Objective image fusion performance measure. Electronics Letters, 36(4), 308–309.

    Article  Google Scholar 

  34. Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2011). A non-reference image fusion metric based on mutual information of image features. Computers and Electrical Engineering, 37(5), 744–756.

    Article  MATH  Google Scholar 

  35. Qu, G. H., & Zhang, D. L. (2002). Information measure for performance of image. Electronics Letters, 38(7), 313–315.

    Article  Google Scholar 

  36. Zhang, L., & Mou, X. (2011). FSIM: A feature similarity index for image quality Assesment. IEEE Transactions on Image Processing, 20(8), 2378–2386.

    Article  MathSciNet  MATH  Google Scholar 

  37. Wang, Z., Sheikh, H. R., & Bovik, A. C. (2002) No-Reference perceptual quality assessment of JPEG compressed images. In IEEE international conference on Image processing (Vol. 1, pp. 477–480).

  38. Wei, C., & Blum, R. S. (2010). Theoretical analysis of correlation – Based quality measures for weighted averaging image fusion. Information Fusion., 11(4), 301–310.

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank www.fusion.org for their support in providing the required data base to execute the simulations.

Author information

Authors and Affiliations

  1. Jawaharlal Nehru Technological University Kakinada (JNTUK), Department of Electronics and Communication Engineering, University College of Engineering, Kakinada, Andhra Pradesh, 533003, India

    Vadhi Radhika & Samayamantula Srinivas Kumar

  2. QIS College of Engineering and Technology, Ongole, Andhra Pradesh, 523272, India

    Kilari Veeraswamy

Authors
  1. Vadhi Radhika
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kilari Veeraswamy
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samayamantula Srinivas Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vadhi Radhika.

Ethics declarations

Funding

There was no funding for this study.

Conflict of Interest

The authors declare that they have no conflict of interest.

Electronic supplementary material

Figure S1

Graphical representation of results measured with MI (GIF 7 kb)

High Resolution Image (TIFF 838 kb)

Figure S2

Graphical representation of results measured with ESOP (GIF 8 kb)

High Resolution Image (TIFF 892 kb)

Figure S3

Graphical representation of comparisons between existing approach to proposed approach (GIF 6 kb)

High Resolution Image (TIFF 901 kb)

Figure S4

Graphical representation of comparisons between existing approach to proposed approach (GIF 10 kb)

High Resolution Image (TIFF 904 kb)

Figure S5

Graphical representation to the comparisons between existing approach to proposed approaches (GIF 11 kb)

High Resolution Image (TIFF 916 kb)

Figure S6

Graphical representation for ESOP results of medical images (GIF 8 kb)

High Resolution Image (TIFF 874 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Radhika, V., Veeraswamy, K. & Srinivas Kumar, S. Digital Image Fusion Using HVS in Block Based Transforms. J Sign Process Syst 90, 947–957 (2018). https://doi.org/10.1007/s11265-017-1252-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11265-017-1252-8

Keywords

Search

Navigation