Abstract
Image fusion has been a hotspot in the area of image processing. How to extract and fuse the main and detailed information as accurately as possible from the source images into the single one is the key to resolving the above problem. Convolutional neural network (CNN) has been proved to be an effective tool to cope with many issues of image processing, such as image classification. In this paper, a novel image fusion method based on pulse-coupled neural network (PCNN) and CNN is proposed. CNN is used to obtain a series of convolution and linear layers which represent the high-frequency and low-frequency information, respectively. The traditional PCNN is improved to be responsible for selecting the coefficients of the sub-images. Experimental results indicate that the proposed method has obvious superiorities over the current main-streamed ones in terms of fusion performance and computational complexity.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Yang, Y., Que, Y., Huang, S., Lin, P.: Multimodal sensor medical image fusion based on type-2 fuzzy logic in NSCT domain. IEEE Sens. J. 16, 3735–3745 (2016)
Ghahremani, M., Ghassemian, H.: Remote sensing image fusion using ripplet transform and compressed sensing. IEEE Geosci. Remote Sens. Lett. 12, 502–506 (2015)
Ali, F.E., El-Dokany, I.M., Saad, A.A., El-Samie, F.E.A.: Curvelet fusion of MR and CT images. Progr. Electromagn. Res. C 3, 215–224 (2008)
Pertuz, S., Puig, D., Garcia, M.A., Fusiello, A.: Generation of all-in-focus images by noise-robust selective fusion of limited depth-of-field images. IEEE Trans. Image Process. 22, 1242–1251 (2013)
Do, M.N., Vetterli, M.: The finite ridgelet transform for image representation. IEEE Trans. Image Process. 12, 16–28 (2003)
Candes, E.J., Donoho, D.L.: Curvelets: A Surprisingly Effective Non-adaptive Representation for Objects with Edges. Stanford University, Stanford (1999)
Cao, L., Jin, L., Tao, H., Li, G., Zhang, Z., Zhang, Y.: Multi-focus image fusion based on spatial frequency in discrete cosine transform domain. IEEE Signal Process. Lett. 22, 220–224 (2015)
Do, M.N., Vetterli, M.: The contourlet transform: an efficient directional multi-resolution image representation. IEEE Trans. Image Process. 14, 2091–2106 (2005)
Miao, Q.G., Shi, C., Xu, P.F., Yang, M., Shi, Y.B.: A novel algorithm of image fusion using shearlets. Opt. Commun. 284, 1540–1547 (2011)
Bhatnagar, G., Wu, Q.M.J., Liu, Z.: Directive contrast based multimodal medical image fusion in NSCT domain. IEEE Trans. Multimedia 15, 1014–1024 (2013)
Easley, G., Labate, D., Lim, W.Q.: Sparse directional image representation using the discrete shearlet transforms. Appl. Comput. Harmon. Anal. 25, 25–46 (2008)
Burt, P.J., Kolcznski, R.J.: Enhanced image capture through fusion. Proc. Conf. Computer Vis. 1, 173–182 (1993)
Palsson, F., Sveinsson, J.R., Ulfarsson, M.O., Benediktsson, J.A.: Model-based fusion of multi- and hyperspectral images using PCA and wavelets. IEEE Trans. Geosci Remot. Sen. 53, 2652–2663 (2015)
Mitianoudis, N., Stathaki, T.: Optimal contrast correction for ICA-based fusion of multimodal images. IEEE Sens. J. 8, 2016–2026 (2008)
Broussard, R.P., Rogers, S.K., Oxley, M.E., Tarr, G.L.: Physiologically motivated image fusion for object detection using a pulse coupled neural network. IEEE Trans. Neur. Net. 10, 554–563 (1999)
Kinser, J.M.: Simplified pulse-coupled neural network. Proc. Conf. Appl. Arti. Neur. Net. 1, 563–567 (1996)
Abdullah, A., Omar, A.J., Inad, A.A.: Image mosaicing using binary edge detection algorithm in a cloud-computing environment. Int. J. Inf. Technol. Web. Eng. 11, 1–14 (2016)
Sathiyamoorthi, V.: A novel cache replacement policy for web proxy caching system using web usage mining. Int. J. Inf. Technol. Web. Eng. 11, 1–13 (2016)
Sylvaine, C., Insaf, K.: Reputation, image, and social media as determinants of e-reputation: the case of digital natives and luxury brands. Int. J. Technol. Hum. Interact. 12, 48–64 (2016)
Wu, Z.M., Lin, T., Tang, N.J.: Explore the use of handwriting information and machine learning techniques in evaluating mental workload. Int. J. Technol. Hum. Interact. 12, 18–32 (2016)
Kong, W.W., Lei, Y., Ren, M.M.: Fusion method for infrared and visible images based on improved quantum theory model. Neurocomputing 212, 12–21 (2016)
Kong, W.W., Wang, B.H., Lei, Y.: Technique for infrared and visible image fusion based on non-subsampled shearlet transform and spiking cortical model. Infrared Phys. Technol. 71, 87–98 (2015)
Kong, W.W., Lei, Y., Zhao, H.X.: Adaptive fusion method of visible light and infrared images based on non-subsampled shearlet transform and fast non-negative matrix factorization. Infrared Phys. Technol. 67, 161–172 (2014)
Kong, W.W., Liu, J.P.: Technique for image fusion based on NSST domain improved fast non-classical RF. Infrared Phys. Technol. 61, 27–36 (2013)
Kong, W.W., Lei, Y.J., Lei, Y., Zhang, J.: Technique for image fusion based on non-subsampled contourlet transform domain improved NMF. Sci. China Ser. F-Inf. Sci. 53, 2429–2440 (2010)
Kong, W.W., Lei, Y., Ma, J.: Virtual machine resource scheduling algorithm for cloud computing based on auction mechanism. Optik 127, 5099–5104 (2016)
Kong, W.W., Lei, Y., Zhao, R.: Fusion technique for multi-focus images based on NSCT-ISCM. Optik 126, 3185–3192 (2015)
Kong, W.W.: Technique for image fusion based on NSST domain INMF. Optik 125, 2716–2722 (2014)
Kong, W.W., Lei, Y.: Technique for image fusion between gray-scale visual light and infrared images based on NSST and improved RF. Optik 124, 6423–6431 (2013)
Kong, W.W., Lei, Y.: Multi-focus image fusion using biochemical ion exchange model. Appl. Soft Comput. 51, 314–327 (2017)
Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313, 504–507 (2006)
Gu, X.D., Zhang, L.M., Yu, D.H.: General design approach to Unit-linking PCNN for image processing. Proc. Conf. Neur. Net. 1, 1836–1842 (2005)
Liu, Q., Ma, Y.D.: A new algorithm for noise reducing of image based on PCNN time matrix. J. Electron. Inf. Technol. 30, 1869–1873 (2008)
Guillamet, D., Vitria, J., Scheile, B.: Introducing a weighted non-negative matrix factorization for image classification. Pattern Recogn. Lett. 24, 2447–2454 (2003)
Li, S.Z., Hou, X.W., Zhang, H.J.: Learning spatially localized, parts-based representation. Proc. Int. Conf. Comput. Vis. Pattern Recogn. 1, 207–212 (2001)
Acknowledgements
The authors thank all the reviewers and editors for their valuable comments and works. The work was supported in part by the National Natural Science Foundations of China under Grant 61309008 and 61309022, in part by Natural Science Foundation of Shannxi Province of China under Grant 2014JQ8349, in part by Foundation of Science and Technology on Information Assurance Laboratory under Grant KJ-15-102, and the Natural Science Foundations of the Engineering University of the Armed Police Force of China under Grant WJY-201414.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Kong, W., Lei, Y., Ma, J. (2018). Technique for Image Fusion Based on PCNN and Convolutional Neural Network. In: Barolli, L., Zhang, M., Wang, X. (eds) Advances in Internetworking, Data & Web Technologies. EIDWT 2017. Lecture Notes on Data Engineering and Communications Technologies, vol 6. Springer, Cham. https://doi.org/10.1007/978-3-319-59463-7_38
Download citation
DOI: https://doi.org/10.1007/978-3-319-59463-7_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59462-0
Online ISBN: 978-3-319-59463-7
eBook Packages: EngineeringEngineering (R0)