Skip to main content
SpringerLink
Log in

Multifocus image fusion using adaptive block compressive sensing by combining spatial frequency

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image fusion is an important branch of the image processing field that makes fuse different information of multiple optical sensors images from the same scene into one complete image. The fused image includes a more dependable and informative description of the scene. With the development of compressive sensing (CS) theory, the compressive domain image fusion method attracts more and more attention. The sampling rate assignment policy for measurement matrix is one of the most important steps in CS and plays a critical role in compression and reconstruction. In this paper, we present a novel multifocus image fusion technique using adaptive sampling rate for block compressive sensing based on textural feature. Firstly, the spatial frequency is utilized to extract the textural features of image blocks. This was then used for adaptive measurement and combining rule. Secondly, the blocks which have large spatial frequency values (e.g., blocks with edges and textures) were assigned high sampling rates. Finally, the combined image was reconstructed with the smooth projected Landweber algorithm. The simulation results show that the proposed method has better performance, in both subjective and objective terms, with respect to the conventional methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Alsmirat MA, Al-Alem F, Al-Ayyoub M, Jararweh Y, Gupta B (2019) Impact of digital fingerprint image quality. Multimedia tools and applications. Multimedia Tools Appl 78(3):3649–3688

    Article  Google Scholar 

  2. AlZu’bi S, Shehab M, Al-Ayyoub M, Jararweh Y, Gupta B (2020) Parallel implementation for 3D medical volume fuzzy segmentation. Pattern Recogn Lett 130:312–318

    Article  Google Scholar 

  3. Candes E, Romberg J, Tao T (2006) Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans Inf Theory 52(2):489–509

    Article  MathSciNet  Google Scholar 

  4. Candès EJ (2006) Compressive sampling. In: Proceedings of the international congress of mathematicians , pp. 1433–1452. Madrid, Spain

  5. Cheng, F., Yang, B., Huang, Z. (2014) Compressive sensing multi-focus image fusion. In: Chinese conference on pattern recognition. 107–116. Springer

  6. Cui G, Feng H, Xu Z, Li Q, Chen Y (2015) Detail preserved fusion of visible and infrared images using regional saliency extraction and multi-scale image decomposition. Opt Commun 341:199–209

    Article  Google Scholar 

  7. Donoho DL (2006) Compressed sensing. IEEE Trans Inf Theory 52(4):1289–1306

    Article  MathSciNet  Google Scholar 

  8. Eldar YC, Kutyniok G (2012) Compressed sensing: theory and applications. Cambridge university press

  9. Gan, L.: Block compressed sensing of natural images. In: 2007 15th international conference on digital signal processing 2007, pp. 403–406. IEEE

  10. Han JJ, Loffeld O, Hartmann K et al (2010) Multi image fusion based on compressive sensing[C]// proc of Int’ I. Conf Audio LanguageImage Process:1463–1469

  11. Kaur G, Kaur P (2016) Survey on multifocus image fusion techniques. In: 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT). 1420–1424. IEEE

  12. Kazemi V, Seyedarabi H, Aghagolzadeh A (2014) Multifocus image fusion based on compressive sensing for visual sensor networks. In: 2014 22nd Iranian Conference on Electrical Engineering (ICEE). 1668–1672. IEEE

  13. Kutyniok G (2013) Theory and applications of compressed sensing. GAMM-Mitteilungen 36(1):79–101

    Article  MathSciNet  Google Scholar 

  14. Li D, Deng L, Bhooshan Gupta B, Wang H, Choi C (2019) A novel CNN based security guaranteed image watermarking generation scenario for smart city applications. Inf Sci 479:432–447

    Article  Google Scholar 

  15. Li H, Manjunath B, Mitra SK (1995) Multisensor image fusion using the wavelet transform. Graphic Models Image Process 57(3):235–245

    Article  Google Scholar 

  16. Li S, Yang B (2008) Multifocus image fusion using region segmentation and spatial frequency. Image Vis Comput 26(7):971–979

    Article  Google Scholar 

  17. Li W-W, Jiang T, Ning W (2014) Clustering compressed sensing based on image block similarities. J China Univ Posts Telecomm 21(4):68–76

    Article  MathSciNet  Google Scholar 

  18. Li X, Qin SY (2011) Efficient fusion for infrared and visible images based on compressive sensing principle[J]. Proc of IET Image Processing 5(2):141–147

    Article  Google Scholar 

  19. Lin, B., Tao, X., Li, S., Dong, L., Lu, J.: Variational Bayesian image fusion based on combined sparse representations. 2016 IEEE Int Conf Acoustics, Speech Signal Process (ICASSP) 2016, pp. 1432–1436. IEEE

  20. Liu F (2013) Image fusion using compressed sensing in nonsubsampled Contourlet transform domain. In: proceedings of 2013 Chinese intelligent automation conference. pp. 803–810. Springer

  21. Liu S-S, Zhang X-H, Zheng A (2013) Image fusion algorithm based on wavelet sparse represented compressed sensing. In: proceedings of the 2nd international conference on computer science and electronics engineering . Atlantis Press

  22. Luo X, Zhang J, Yang J, Dai Q2009 Image fusion in compressed sensing. In: 2009 16th IEEE international conference on image processing (ICIP). pp. 2205–2208. IEEE

  23. Luo X, Zhang J, Yang J, Dai Q (2010) Classification-based image-fusion framework for compressive imaging. J Electr Imaging 19(3):033009

    Article  Google Scholar 

  24. Mun, S., Fowler, J.E.: Block compressed sensing of images using directional transforms. In: 2009 16th IEEE international conference on image processing (ICIP) (2009), pp. 3021–3024. IEEE

  25. Petrović V, Dimitrijević V (2015) Focused pooling for image fusion evaluation. Inform Fusion 22:119–126

    Article  Google Scholar 

  26. Qaisar S, Bilal RM, Iqbal W, Naureen M, Lee S (2013) Compressive sensing: from theory to applications, a survey. J Comm Networks 15(5):443–456

    Article  Google Scholar 

  27. Qiao W, Liu B, Xiong Z, Arce GR, Garcia-Frias J, Zhu W, Yan Z(2012) Block-based variable density compressed image sampling. In: 2012 19th IEEE international conference on image processing , pp. 909–912. IEEE

  28. Qu G, Zhang D, Yan P (2002) Information measure for performance of image fusion. Electron Lett 38(7):313–315

    Article  Google Scholar 

  29. Wan T, Qin ZC (2011) An application of compressive sensing for image fusion[J]. Int J Comput Math 88(18):3–9

    Article  Google Scholar 

  30. Wan T, Canagarajah N, Achim A (2008) Compressive image fusion. In: 2008 15th IEEE international conference on image processing , pp. 1308–1311. IEEE

  31. Wang H, Li Z, Li Y, Gupta BB, Choi C (2020) Visual saliency guided complex image retrieval. Pattern Recogn Lett 130:64–72

    Article  Google Scholar 

  32. Yang B, Li S (2012) Pixel-level image fusion with simultaneous orthogonal matching pursuit[J]. Inform Fusion 13(1):10–19

    Article  Google Scholar 

  33. Yang C, Zheng Q (2015) Gradient-based compressive image fusion[J]. Front Inform Technol Electron Eng 16(3):227–237

    Article  Google Scholar 

  34. Yang S-L, Wan G-B, Zhang B-L, Chong X (2013) Remote sensing images fusion based on block compressed sensing. Imaging Spectrometer Technol Appl:891017

  35. Yang S-L, Wan G-B, Gao J-H, Zhang B-L, Chong X Images fusion based on block compressed sensing and multiwavelet transform. In: international symposium on Photoelectronic detection and imaging 2013: optical storage and display technology 2013, p. 89130R. Int Soc Optics Photonics

  36. Yin H, Li S (2011) Multimodal image fusion with joint sparsity model[J]. Opt Eng 50(6):067007–067010

    Article  Google Scholar 

  37. Yu C, Li J, Li X, Ren X, Gupta BB (2018) Four-image encryption scheme based on quaternion Fresnel transform, chaos and computer generated hologram. Multimed Tools Appl 77(4):4585–4608

    Article  Google Scholar 

  38. Zhang J, Xiang Q, Yin Y, Chen C, Luo X (2017) Adaptive compressed sensing for wireless image sensor networks. Multimed Tools Appl 76(3):4227–4242

    Article  Google Scholar 

  39. Zhang Q, Maldague X (2016) An adaptive fusion approach for infrared and visible images based on NSCT and compressed sensing[J]. Infrared Physics Technol 74:11–20

    Article  Google Scholar 

  40. Zheng H, Zhu X (2013) Sampling adaptive block compressed sensing reconstruction algorithm for images based on edge detection. J China Univ Posts Telecomm 20(3):97–103

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Electrical & Computer Engineering, Semnan University, Semnan, Iran

    Vahdat Kazemi & Ali Shahzadi

  2. Department of Electrical and Computer Engineering, Malek Ashtar University of Technology, Tehran, Iran

    Hossein Khaleghi Bizaki

Authors
  1. Vahdat Kazemi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ali Shahzadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hossein Khaleghi Bizaki
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vahdat Kazemi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kazemi, V., Shahzadi, A. & Bizaki, H.K. Multifocus image fusion using adaptive block compressive sensing by combining spatial frequency. Multimed Tools Appl 81, 15153–15170 (2022). https://doi.org/10.1007/s11042-022-12072-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12072-2

Keywords

Search

Navigation