ABSTRACT
Traditional change detection methods suffer from limited precision and inadequate feature discriminability in images. Although deep learning has considerably advanced the building change detection field, challenges persist due to the diverse change types in remote sensing imagery across distinct epochs, leading to complex backdrops and arduous feature extraction. To address this issue, we propose a novel approach that combines convolutional neural networks (CNNs) with Swin Transformers to further enhance the accuracy of building change detection in remote sensing images. Firstly, CNNs are employed for preliminary feature extraction from input images. Subsequently, the Transformer's self-attention mechanism is utilized to obtain more comprehensive semantic information about the building structures within the feature maps. Lastly, leveraging the multi-level feature extraction advantages of Swin Transformers, we construct a network capable of fusing and extracting building change features in remote sensing images. By introducing a differential feature fusion module during the decoding phase, the model's receptive field in multi-scale feature fusion processes is enhanced, along with the reinforcement of local details and improvement of segmentation precision. Experimental comparisons on the WUH-CD dataset reveal that, compared to the classic change detection network FC-EF, our proposed method has yielded improvements of 1.7%, 23.7%, 18.7%, 13.5%, and 27.5% in overall accuracy, precision, F1, recall rate, and IoU, respectively.
- H. SUI, W. FENG, W. LI, K. SUN, and C. XU, “Review of change detection methods for multi-temporal remote sensing imagery,” Geomatics and Information Science of Wuhan Universit, vol. 43, no. 12, pp. 1885-1898, 2018.Google Scholar
- Q. REN, W. YANG, C. WANG, W. WEI, and Y. QIAN, “Review of remote sensing image change detection,” Journal of Computer Applications, vol. 41, no. 8, pp. 2294, 2021.Google Scholar
- Z. Zhiqiang, Z. Xinchang, X. Qinchuan, and Y. Xiaoling, “Combining the pixel-based and object-based methods for building change detection using high-resolution remote sensing images,” Acta Geodaetica et Cartographica Sinica, vol. 47, no. 1, pp. 102, 2018.Google Scholar
- W. Pan, S. Xu, H. Guo, Y. Wan, T. Wu, and C. Wang, “Building change detection in high-definition remote sensing imagery based on D-S evidence theory,” Journal of Electronic Measurement and Instrumentation, vol. 36, no. 08, pp. 194-203, 2022.Google Scholar
- L. Haifei, Y. Minhua, W. Jing, X. Gang, and C. Jie, “High-resolution remote sensing image building change detection using structural objects,” Bulletin of Surveying and Mapping, no. 6, pp. 16.Google Scholar
- R. C. Daudt, B. Le Saux, A. Boulch, and Ieee, "FULLY CONVOLUTIONAL SIAMESE NETWORKS FOR CHANGE DETECTION," IEEE International Conference on Image Processing ICIP. pp. 4063-4067, 2018.Google Scholar
- H. Chen, Z. Qi, and Z. Shi, “Remote sensing image change detection with transformers,” IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-14, 2021.Google ScholarCross Ref
- C. J. Zhang, R. An, and L. Ma, “Building change detection in remote sensing image based on improved U-net,” Comput. Eng. Appl, vol. 57, pp. 239-246, 2021.Google Scholar
- M. Yin, C. Ni, P. Wang, and G. Zhang, “Remote sensing image building change detection based on semantic segmentation,” Journal of Applied Sciences, vol. 41, no. 03, pp. 448-460, 2023.Google Scholar
- H. Chen, and Z. Shi, “A spatial-temporal attention-based method and a new dataset for remote sensing image change detection,” Remote Sensing, vol. 12, no. 10, pp. 1662, 2020.Google ScholarCross Ref
- K. Q. Song, and J. Jiang, “AGCDetNet:An Attention-Guided Network for Building Change Detection in High-Resolution Remote Sensing Images,” Ieee Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 14, pp. 4816-4831, 2021.Google ScholarCross Ref
- J. Zheng, Y. Tian, C. Yuan, K. Yin, F. Zhang, F. Chen, and Q. Chen, “MDESNet: Multitask Difference-Enhanced Siamese Network for Building Change Detection in High-Resolution Remote Sensing Images,” Remote Sensing, vol. 14, no. 15, pp. 3775, 2022.Google ScholarCross Ref
- A. G. Howard, M. Sandler, G. Chu, L.-C. Chen, B. Chen, M. Tan, W. Wang, Y. Zhu, R. Pang, V. Vasudevan, Q. V. Le, and H. Adam, “Searching for MobileNetV3,” 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp. 1314-1324, 2019.Google ScholarCross Ref
- Y. Liu, Z. Shao, and N. Hoffmann, “Global Attention Mechanism: Retain Information to Enhance Channel-Spatial Interactions,” ArXiv, vol. abs/2112.05561, 2021.Google Scholar
- S. H. Woo, J. Park, J. Y. Lee, and I. S. Kweon, "CBAM: Convolutional Block Attention Module," Lecture Notes in Computer Science. pp. 3-19, 2018.Google ScholarDigital Library
- S. Ji, S. Wei, and M. Lu, “Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, pp. 574-586, 2019.Google ScholarCross Ref
- Y. Liu, C. Pang, Z. Q. Zhan, X. M. Zhang, and X. Yang, “Building Change Detection for Remote Sensing Images Using a Dual-Task Constrained Deep Siamese Convolutional Network Model,” Ieee Geoscience and Remote Sensing Letters, vol. 18, no. 5, pp. 811-815, May, 2021.Google ScholarCross Ref
- Z. X. Wang, Y. Zhang, L. Luo, and N. Wang, “CSA-CDGAN: channel self-attention-based generative adversarial network for change detection of remote sensing images,” Neural Computing & Applications, vol. 34, no. 24, pp. 21999-22013, Dec, 2022.Google ScholarDigital Library
Index Terms
- Remote Sensing Image Change Detection of Buildings Based on Improved Swin-Transformer
Recommendations
Dual-branch network for change detection of remote sensing image
AbstractChange detection is important in remote sensing image analysis. In recent years, significant breakthroughs have been made in change detection algorithms based on deep learning. However, due to continuous downsampling, the detection results of ...
Adaptive enhanced swin transformer with U-net for remote sensing image segmentation
Highlights- In this paper, a UAV remote sensing segmentation method based on CNN and transformer is proposed. On the basis of the U-Net structure, we introduce a CNN ...
AbstractSemantic segmentation of remote sensing images often faces complex situations, such as variable scale objects, large intra-class differences, and imbalanced distribution among classes. Convolutional Neural Network (CNN) based models ...
Recognition and extraction of high-resolution satellite remote sensing image buildings based on deep learning
AbstractExtracting and recognizing buildings from high-resolution remote sensing images faces many problems due to the complexity of the buildings on the surface. The purpose is to improve the recognition and extraction capabilities of remote sensing ...
Comments