skip to main content
10.1145/3629264.3629270acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccdaConference Proceedingsconference-collections
research-article

Remote Sensing Image Change Detection of Buildings Based on Improved Swin-Transformer

Published:19 December 2023Publication History

ABSTRACT

Traditional change detection methods suffer from limited precision and inadequate feature discriminability in images. Although deep learning has considerably advanced the building change detection field, challenges persist due to the diverse change types in remote sensing imagery across distinct epochs, leading to complex backdrops and arduous feature extraction. To address this issue, we propose a novel approach that combines convolutional neural networks (CNNs) with Swin Transformers to further enhance the accuracy of building change detection in remote sensing images. Firstly, CNNs are employed for preliminary feature extraction from input images. Subsequently, the Transformer's self-attention mechanism is utilized to obtain more comprehensive semantic information about the building structures within the feature maps. Lastly, leveraging the multi-level feature extraction advantages of Swin Transformers, we construct a network capable of fusing and extracting building change features in remote sensing images. By introducing a differential feature fusion module during the decoding phase, the model's receptive field in multi-scale feature fusion processes is enhanced, along with the reinforcement of local details and improvement of segmentation precision. Experimental comparisons on the WUH-CD dataset reveal that, compared to the classic change detection network FC-EF, our proposed method has yielded improvements of 1.7%, 23.7%, 18.7%, 13.5%, and 27.5% in overall accuracy, precision, F1, recall rate, and IoU, respectively.

References

  1. H. SUI, W. FENG, W. LI, K. SUN, and C. XU, “Review of change detection methods for multi-temporal remote sensing imagery,” Geomatics and Information Science of Wuhan Universit, vol. 43, no. 12, pp. 1885-1898, 2018.Google ScholarGoogle Scholar
  2. Q. REN, W. YANG, C. WANG, W. WEI, and Y. QIAN, “Review of remote sensing image change detection,” Journal of Computer Applications, vol. 41, no. 8, pp. 2294, 2021.Google ScholarGoogle Scholar
  3. Z. Zhiqiang, Z. Xinchang, X. Qinchuan, and Y. Xiaoling, “Combining the pixel-based and object-based methods for building change detection using high-resolution remote sensing images,” Acta Geodaetica et Cartographica Sinica, vol. 47, no. 1, pp. 102, 2018.Google ScholarGoogle Scholar
  4. W. Pan, S. Xu, H. Guo, Y. Wan, T. Wu, and C. Wang, “Building change detection in high-definition remote sensing imagery based on D-S evidence theory,” Journal of Electronic Measurement and Instrumentation, vol. 36, no. 08, pp. 194-203, 2022.Google ScholarGoogle Scholar
  5. L. Haifei, Y. Minhua, W. Jing, X. Gang, and C. Jie, “High-resolution remote sensing image building change detection using structural objects,” Bulletin of Surveying and Mapping, no. 6, pp. 16.Google ScholarGoogle Scholar
  6. R. C. Daudt, B. Le Saux, A. Boulch, and Ieee, "FULLY CONVOLUTIONAL SIAMESE NETWORKS FOR CHANGE DETECTION," IEEE International Conference on Image Processing ICIP. pp. 4063-4067, 2018.Google ScholarGoogle Scholar
  7. H. Chen, Z. Qi, and Z. Shi, “Remote sensing image change detection with transformers,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-14, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  8. C. J. Zhang, R. An, and L. Ma, “Building change detection in remote sensing image based on improved U-net,” Comput. Eng. Appl, vol. 57, pp. 239-246, 2021.Google ScholarGoogle Scholar
  9. M. Yin, C. Ni, P. Wang, and G. Zhang, “Remote sensing image building change detection based on semantic segmentation,” Journal of Applied Sciences, vol. 41, no. 03, pp. 448-460, 2023.Google ScholarGoogle Scholar
  10. H. Chen, and Z. Shi, “A spatial-temporal attention-based method and a new dataset for remote sensing image change detection,” Remote Sensing, vol. 12, no. 10, pp. 1662, 2020.Google ScholarGoogle ScholarCross RefCross Ref
  11. K. Q. Song, and J. Jiang, “AGCDetNet:An Attention-Guided Network for Building Change Detection in High-Resolution Remote Sensing Images,” Ieee Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 4816-4831, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  12. J. Zheng, Y. Tian, C. Yuan, K. Yin, F. Zhang, F. Chen, and Q. Chen, “MDESNet: Multitask Difference-Enhanced Siamese Network for Building Change Detection in High-Resolution Remote Sensing Images,” Remote Sensing, vol. 14, no. 15, pp. 3775, 2022.Google ScholarGoogle ScholarCross RefCross Ref
  13. A. G. Howard, M. Sandler, G. Chu, L.-C. Chen, B. Chen, M. Tan, W. Wang, Y. Zhu, R. Pang, V. Vasudevan, Q. V. Le, and H. Adam, “Searching for MobileNetV3,” 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1314-1324, 2019.Google ScholarGoogle ScholarCross RefCross Ref
  14. Y. Liu, Z. Shao, and N. Hoffmann, “Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions,” ArXiv, vol. abs/2112.05561, 2021.Google ScholarGoogle Scholar
  15. S. H. Woo, J. Park, J. Y. Lee, and I. S. Kweon, "CBAM: Convolutional Block Attention Module," Lecture Notes in Computer Science. pp. 3-19, 2018.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Ji, S. Wei, and M. Lu, “Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, pp. 574-586, 2019.Google ScholarGoogle ScholarCross RefCross Ref
  17. Y. Liu, C. Pang, Z. Q. Zhan, X. M. Zhang, and X. Yang, “Building Change Detection for Remote Sensing Images Using a Dual-Task Constrained Deep Siamese Convolutional Network Model,” Ieee Geoscience and Remote Sensing Letters, vol. 18, no. 5, pp. 811-815, May, 2021.Google ScholarGoogle ScholarCross RefCross Ref
  18. Z. X. Wang, Y. Zhang, L. Luo, and N. Wang, “CSA-CDGAN: channel self-attention-based generative adversarial network for change detection of remote sensing images,” Neural Computing & Applications, vol. 34, no. 24, pp. 21999-22013, Dec, 2022.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Remote Sensing Image Change Detection of Buildings Based on Improved Swin-Transformer

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICCDA '23: Proceedings of the 2023 7th International Conference on Computing and Data Analysis
      September 2023
      137 pages
      ISBN:9798400700576
      DOI:10.1145/3629264

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 December 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited
    • Article Metrics

      • Downloads (Last 12 months)14
      • Downloads (Last 6 weeks)6

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format