Hybrid Attention-Aware Transformer Network Collaborative Multiscale Feature Alignment for Building Change Detection | IEEE Journals & Magazine | IEEE Xplore

Hybrid Attention-Aware Transformer Network Collaborative Multiscale Feature Alignment for Building Change Detection


Abstract:

Building change detection (BCD) is essential for urban dynamic measurement. Deep learning has demonstrated significant potential in image processing, providing powerful f...Show More

Abstract:

Building change detection (BCD) is essential for urban dynamic measurement. Deep learning has demonstrated significant potential in image processing, providing powerful feature extraction capabilities for BCD tasks. However, existing methods do not adequately mine multiscale feature information and ignore the importance of multiscale feature alignment, leading to an inadequate representation of the internal structure. Therefore, we propose a hybrid attention-aware transformer network (HATNet) designed to effectively extract and interact with multiscale context information. Specifically, HATNet first incorporates a hybrid attention-aware feature extractor (HAFE) module that integrates self-attention (SA) and coordinate-attention (CA) to effectively extract complementary multiscale features. The SA establishes long-range dependencies between multiscale features, while the CA captures spatial dependencies and preserves positional details. Then, we devise a building saliency detection enhancement (BSDE) module that utilizes three independent channels to facilitate the identification and localization of changed buildings, fostering a symbiotic relationship between unchanged and changed areas. Furthermore, we adopt a coarse-to-fine feature interaction (CFFI) module to progressively fuse multiscale features using a hierarchical strategy. In order to better locate the changed detail features, we introduce a global feature alignment (GFA) module to achieve global multiscale feature alignment. HATNet surpasses eight BCD methods on LEVIR-CD, WHU-CD, and S2Looking-CD datasets. The experimental results provide compelling evidence of our method to precisely detect and measure building changes. The codes are available at https://github.com/yzygit1230/HATNet.
Article Sequence Number: 5012914
Date of Publication: 12 March 2024

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.