skip to main content
10.1145/3573942.3574058acmotherconferencesArticle/Chapter ViewAbstractPublication PagesaiprConference Proceedingsconference-collections
research-article

Image Fusion Based on Improved Multi-seed Region Growing and Dual Channel SCM

Published: 16 May 2023 Publication History

Abstract

A fusion algorithm based on Improved Multi-seed Region Growing combined with Dual Channel Spiking Cortical Model (DCSCM) is proposed to improve the problem of incomplete and unstable target extraction in traditional infrared and visible image fusion algorithm. Firstly, the source infrared image and the source visible light image are decomposed into their own high and low frequency subband coefficients by using the Nonsubsampled Shear-let Transform (NSST). Then, the target information of the source infrared image is extracted by using the improved multi-seed region growing, and the low-frequency fusion coefficient is obtained by comparing the information entropy. The high-frequency fusion coefficient is obtained by using DCSCM. Finally, the fused image is obtained by inverse NSST transform. Simulation results show that the fused image obtained by the algorithm proposed in this paper is rich in infrared target information and detailed texture information, and has good visual effect. In objective evaluation, the fused image has higher standard deviation, information entropy, mutual information and edge preservation coefficient, it has obvious advantages over other methods in subjective and objective aspects.

References

[1]
SHEN Y, HUANG C H, HUANG F, Research progress of infrared and visible image fusion technology[J]. Infrared and Laser Engineering, 2021,50(09):152-169.
[2]
XIANG T Z, GAO R R,YAN L, Region Feature Based Multi-scale Fusion Method for Thermal Infrared and Visible Images[J]. Geomatics and Information Science of Wuhan University,2017,42(07):911-917.
[3]
DING W B, BI D Y, HE L Y, Fusion of Infrared and Visible Images Based on Shearlet Transform and Neighborhood Structure Features[J]. Acta Optica Sinica, 2017, 37(10): 115-123.
[4]
WU D P, BI D Y, HE L Y, MA S P, FAN Z L.A fusion algorithm of infrared and visible image based on NSSCT[J]. Acta Optica Sinica. 2017,37(07):106-114.
[5]
WANG F, CHENG Y M. A false color image fusion method based on KFE and DUM-PCNN in NSST domain[J]. Journal of Northwestern Polytechnical University, 2017,35(04):698-703.
[6]
LUO J, KONG W W, LIU R. An infrared and visible image fusion method based on NSST and region growing algorithm[J]. China Sciencepaper, 2016, 11(14): 1673-1678.
[7]
JIANG J D, LIU Y D,MAO X Y, Infrared and visible image fusion based on FDST and dual-channel PCNN[J]. Infrared and Laser Engineering, 2019, 48(02): 67-74.
[8]
ZHOU Y, MA J Y, HUANG J. Infrared and Visible Image Fusion based on Mutually Guided Filtering and Saliency Map[J]. Remote Sensing Technology and Application, 2020, 35(06): 1404-1413.
[9]
WAN L T, XIONG N F, WANG D, Application of trust region method in infrared image sequence processing[J]. Infrared and Laser Engineering, 2020, 49(07): 258-264.
[10]
DENG Y P, CAO M Y, LAXMISHA R. Horizontal Fracture Recognition of Borehole Image Based on Improved Region Growing and Hough Transform[J]. Science Technology and Engineering, 2019, 19(31): 239-245.
[11]
LI X L, ZENG S G, ZHENG S, Surface crack detection of ceramic tile based on sliding filter and automatic region growth[J]. Laser & Optoelectronics Progress, 2019, 56(21): 49-55.
[12]
CHEN W X, ZHAO W D, LIU Y J, A flame segmentation algorithm based on automatic seeded region growing[J]. Fire Safety Science, 2018, 27(04): 197-204.
[13]
JIANG Z T, WU H, ZHOU X L. Infrared and Visible Image Fusion Algorithm Based on Improved Guided Filtering and Dual-Channel Spiking Cortical Model[J]. Acta Optica Sinica, 2018, 38(02): 0210002.
[14]
Cheng Zhao, Yongdong Huang,Shi Qiu. Infrared and visible image fusion algorithm based on saliency detection and adaptive double-channel spiking cortical model[J]. Infrared Physics and Technology, 2019, 102: 102976.
[15]
Ding Z S, Zhou D M, Li H Y, Siamese networks and multi-scale local extrema scheme for multimodal brain medical image fusion[J]. Biomedical Signal Processing and Control, 2021, 68: 102697.
[16]
DAI W Z, WANG Q. Research on fusion method of visible and infrared image based on PCNN and IFS[J]. Journal of Optoelectronics·Laser, 2020, 31(07): 738-744.
[17]
GONG J M, XUE M L, REN F, Infrared and visible image fusion based on nonsubsampled shearlet transform and fuzzy C-means clustering[J]. Journal of Electronic Imaging, 2018, 27(4): 043042-043042.
[18]
WANG Z, DU Q Z,DONG A Y, Infrared and visible image fusion based on nonsubsampled shearlet transform[J]. Journal of Optoelectronics·Laser, 2020, 31(10): 1062-1073.
[19]
NIU L, WANG X H. Adaptive Medical Image Fusion Method Based on Spiking Cortical Model[J]. Journal of Southwest China Normal University(Natural Science Edition), 2017, 42(02): 159-165.
[20]
Chen J, Li X J, Luo L B, Infrared and visible image fusion based on target-enhanced multiscale transform decomposition[J]. Information Sciences, 2020, 508: 64-78.
[21]
Zhang Y, Zhang L J, Bai X Z, Infrared and visual image fusion through infrared feature extraction and visual information preservation[J]. Infrared Physics and Technology, 2017, 83: 227-237.
[22]
KONG W W, ZHANG L J, LEI Y. Novel fusion method for visible light and infrared images based on NSST-SF-PCNN[J]. Infrared Physics & Technology, 2014, 65(7): 103-112.

Index Terms

  1. Image Fusion Based on Improved Multi-seed Region Growing and Dual Channel SCM

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    AIPR '22: Proceedings of the 2022 5th International Conference on Artificial Intelligence and Pattern Recognition
    September 2022
    1221 pages
    ISBN:9781450396899
    DOI:10.1145/3573942
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 16 May 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Dual channel spiking cortical model
    2. Improved multi-seed region growing
    3. Infrared and visible image fusion
    4. Nonsubsampled shearlet transform

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • The National Natural Science Foundation of China
    • The International Science and Technology Cooperation Program Project Shaanxi Province Key Research and Development Program

    Conference

    AIPR 2022

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 17
      Total Downloads
    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 01 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media