Skip to main content
SpringerLink
Log in

Multi-focus image fusion method using S-PCNN optimized by particle swarm optimization

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

This paper proposed a novel image fusion method based on simplified pulse-coupled neural network (S-PCNN), particle swarm optimization (PSO) and block image processing method. In general, the parameters of S-PCNN are set manually, which is complex and time-consuming and usually causes inconsistence. In this paper, the parameters of S-PCNN are set by PSO algorithm to overcome these shortcomings and improve fusion performance. Firstly, source images are divided into several equidimension sub-blocks, and then, spatial frequency is calculated as the characteristic factor of the sub-block to get the whole source image’s characterization factor matrix (CFM), and by this way the operand can be effectively reduced. Secondly, S-PCNN is used for the analysis of the CFM to get its oscillation frequency graph (OFG). Thirdly, the fused CFM will be got according to the OFG. Finally, the fused image will be reconstructed according to the fused CFM and block rule. In this process, the parameters of S-PCNN are set by PSO algorithm to get the best fusion effect. By CFM and block method, the operand of the proposed method will be effectively reduced. The experiments indicate that the multi-focus image fusion algorithm is more efficient than other traditional image fusion algorithms, and it proves that the automatically parameters setting method is effective as well.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Barbieri R, Barbieri N, de Lima KF (2015a) Some applications of the PSO for optimization of acoustic filters. Appl Acoust 89(1298):62–70

    Article  Google Scholar 

  • Barbieri R, Barbieri N, de Lima KF (2015b) Some applications of the PSO for optimization of acoustic filters. Appl Acoust 89(1298):62–70

    Article  Google Scholar 

  • Chai Y, Li H, Li Z (2011) Multifocus image fusion scheme using focused region detection and multiresolution. Opt Commun 284(19):4376–4389

    Article  Google Scholar 

  • Deng XY, De MAY (2012) PCNN model automatic parameters determination and its modified model. Acta Electron Sin 5(5):955–964

    Google Scholar 

  • Eberhart R, Kennedy J (1995) A new optimizer using particle swarm theory. In: International symposium on MICRO machine and human science 1995, pp 39–43

  • Ekblad U, Kinser JM, Atmer J et al (2004) The intersecting cortical model in image processing. Nucl Instrum Methods Phys Res 525(1):392–396

    Article  Google Scholar 

  • Eskandari M, Toygar O (2015) Selection of optimized features and weights on face-iris fusion using distance images. Comput Vis Image Understand 137(C):63–75

    Article  Google Scholar 

  • Gu X, Fang Y, Wang Y (2013) Attention selection using global topological properties based on pulse coupled neural network. Comput Vis Image Understand 117(10):1400–1411

    Article  Google Scholar 

  • Guo JM, Prasetyo H, Su HS (2013a) Image indexing using the color and bit pattern feature fusion. J Vis Commun Image Represent 24:1360–1379

    Article  Google Scholar 

  • Guo JM, Prasetyo H, Su HS (2013b) Image indexing using the color and bit pattern feature fusion. J Vis Commun Image Represent 24:1360–1379

    Article  Google Scholar 

  • He K, Zhou D, Zhang X, Nie R et al (2017) Infrared and visible image fusion based on target extraction in the nonsubsampled contourlet transform domain. J Appl Remote Sens 11(1):015011

    Article  Google Scholar 

  • Jin H et al (2015) Fusion of remote sensing images based on pyramid decomposition with Baldwinian Clonal Selection Optimization. Infrared Phys Technol 73:204–211

    Article  Google Scholar 

  • Jin X, Nie R, Zhou D, Wang Q, He K (2016a) Multifocus color image fusion based on NSST and PCNN. J Sens 2016:8359602. doi:10.1155/2016/8359602

  • Jin X, Nie R, Zhou D et al (2016b) A novel DNA sequence similarity calculation based on simplified pulse-coupled neural network and Huffman coding. Phys A Stat Mech Appl 461:325–338

    Article  MathSciNet  Google Scholar 

  • Jin X, Zhou D, Yao S et al (2016c) Remote sensing image fusion method in CIELab color space using nonsubsampled shearlet transform and pulse coupled neural networks. J Appl Remote Sens 10(2):025023

    Article  Google Scholar 

  • Johnson JL, Padgett ML (1999) PCNN models and applications. IEEE Trans Neural Netw 10(3):480–498

    Article  Google Scholar 

  • Johnson JL, Ritter D (1993) Observation of periodic waves in a pulse-coupled neural network. Opt Lett 18(15):1253–1255

    Article  Google Scholar 

  • Kavitha S, Thyagharajan KK (2016) Efficient DWT-based fusion techniques using genetic algorithm for optimal parameter estimation. Soft Comput 2016:1–10. doi:10.1007/s00500-015-2009-6

    Google Scholar 

  • Li H, Chai Y, Li Z (2013) Multi-focus image fusion based on nonsubsampled contourlet transform and focused regions detection. Optik Int J Light Electron Opt 124(1):40–51

    Article  Google Scholar 

  • Li J, Zou B, Ding L et al (2013) Image segmentation with S-PCNN model and immune algorithm. J Comput 8(9):2429–2436

    Google Scholar 

  • Luo XQ, Zhang ZC, Wu XJ (2014) Adaptive multistrategy image fusion method. J Electron Imaging 23(5):053011

    Article  Google Scholar 

  • Maurya L, Mahapatra PK, Kumar A (2017) A social spider optimized image fusion approach for contrast enhancement and brightness preservation. Appl Soft Comput 52:575–592

    Article  Google Scholar 

  • Ozcan E, Mohan CK (2000) Particle swarm optimization: surfing the waves. In: Proceedings of the international conference on the practice and theory of automated timetabling 2000, pp 6–9

  • Palsson F et al (2015) Model-based fusion of multi-and hyperspectral images using PCA and wavelets. IEEE Trans Geosci Remote Sens 53(5):2652–2663

    Article  Google Scholar 

  • Peng J (2013) Image fusion with nonsubsampled contourlet transform and sparse representation. J Electron Imaging 22(4):6931–6946

    MathSciNet  Google Scholar 

  • Peng G, Wang Z, Liu S, Zhuang S (2015) Image fusion by combining multiwavelet with nonsubsampled direction filter bank. Soft Comput 2015:1–13. doi:10.1007/s00500-015-1893-0

    Google Scholar 

  • Raghavendra R, Dorizzi B, Rao A et al (2011) Particle swarm optimization based fusion of near infrared and visible images for improved face verification. Pattern Recognit 44(2):401–411

    Article  Google Scholar 

  • Saeedi J, Faez K (2012) Infrared and visible image fusion using fuzzy logic and population-based optimization. Appl Soft Comput 12:1041–1054

    Article  Google Scholar 

  • Saha A, Bhatnagar G, Wu QMJ (2013) Mutual spectral residual approach for multifocus image fusion. Digit Signal Process 23(4):1121–1135

    Article  MathSciNet  Google Scholar 

  • Shi Y, Eberhart R (1998) “A modified particle swarm”. In: Proceeding of 1998 IEEE international conference on evolutionary computation IEEE, Piscataway, NJ, USA, pp 69–73

  • Shi Y, Eberhart RC (1998) Parameter selection in particle swarm optimization. In: International conference on evolutionary programming Vii Springer-Verlag 1998, pp 591–600

  • Shi M, Jiang S, Wang H et al (2009) A Simplified pulse-coupled neural network for adaptive segmentation of fabric defects. Mach Vis Appl 20(22):131–138

    Article  Google Scholar 

  • Subashini MM, Sahoo SK (2014) Pulse coupled neural networks and its applications. Expert Syst Appl 41(8):3965–3974

    Article  Google Scholar 

  • Szekely AG, Lindblad T (1999) Parameter adaptation in a simplified pulse-coupled neural network. In: The workshop on virtual intelligence/dynamic neural networks: neural networks fuzzy systems. International society for optics and photonics 1999, pp 278–285

  • Tian T, Sun S, Li N (2016) Multi-sensor information fusion estimators for stochastic uncertain systems with correlated noises. Inf Fus 27:126–137

    Article  Google Scholar 

  • Wang G, Xu X, Jiang X, Nie R (2015) A modified model of pulse coupled neural networks with adaptive parameters and its application on image fusion. ICIC Express Lett 6(9):2523–2530

    Google Scholar 

  • Wang Q, Zhou D, Nie R et al (2016) Medical image fusion using pulse coupled neural network and multi-objective particle swarm optimization. In: Eighth international conference on digital image processing. 2016, p 100334K

  • www.metapix/toolbox.htm

  • Xu X, Shan D, Wang G et al (2016) Multimodal medical image fusion using PCNN optimized by the QPSO algorithm. Appl Soft Comput 46:588–595

    Article  Google Scholar 

  • Yang H, Jin X, Zhou D (2015) Block medical image fusion based on adaptive PCNN. In: IEEE international conference on software engineering and service science. IEEE 2015, pp. 330–333

  • Yi LI, Wu XJ (2014) A novel image fusion method using self-adaptive dual-channel pulse coupled neural networks based on PSO evolutionary learning. Acta Electron Sin 42(2):217–222

    Google Scholar 

  • Yu B et al (2015) Hybrid dual-tree complex wavelet transform and support vector machine for digital multi-focus image fusion. Neurocomputing 182:1–9

    Article  Google Scholar 

  • Zhang B et al (2016) Multi-focus image fusion algorithm based on focused region extraction. Neurocomputing 174:733–748

    Article  Google Scholar 

  • Zhang Y, Ge L (2009) Efficient fusion scheme for multi-focus images by using blurring measure. Digit Signal Process 19(2):186–193

    Article  Google Scholar 

  • Zheng J, Liu Y, Ren J et al (2016) Fusion of block and keypoints based approaches for effective copy-move image forgery detection. Multidimens Syst Signal Process 27(4):989–1005

    Article  MathSciNet  Google Scholar 

  • Zhou D, Nie R, Zhao D (2009) Analysis of autowave characteristics for competitive pulse coupled neural network and its application. Neurocomputing 72(10–12):2331–2336

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank the editors and the anonymous reviewers for their careful works and valuable suggestions for this study. This study was supported by the National Natural Science Foundation of China (No. 61365001, No. 61463052 and No. 61640306). We thank the support of Scientific Research Fund of Education Department of Yunnan Province (No. 2017YJS108) and Doctoral Candidate Academic Award of Yunnan Province. We also thank Dr. Jingyu Hou and Dr. Shin-Jye Lee for their valuable advises.

Author information

Authors and Affiliations

  1. School of Information, Yunnan University, Cuihu Road, Kunming, 650091, China

    Xin Jin, Dongming Zhou, Rencan Nie, Qian Jiang, Kangjian He & Quan Wang

  2. School of Software, Yunnan University, Cuihu Road, Kunming, 650091, China

    Shaowen Yao

Authors
  1. Xin Jin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dongming Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shaowen Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rencan Nie
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Qian Jiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Kangjian He
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Quan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Dongming Zhou or Shaowen Yao.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interests regarding the publication of this manuscript.

Human and animal rights

This article does not contain any studies with human participants performed by any of the authors.

Informed consent

Informed consent was obtained from all individual participants included in the study.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jin, X., Zhou, D., Yao, S. et al. Multi-focus image fusion method using S-PCNN optimized by particle swarm optimization. Soft Comput 22, 6395–6407 (2018). https://doi.org/10.1007/s00500-017-2694-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-017-2694-4

Keywords

Search

Navigation