Learning Spatial–Temporal Consistency for Satellite Image Sequence Prediction | IEEE Journals & Magazine | IEEE Xplore

Learning Spatial–Temporal Consistency for Satellite Image Sequence Prediction


Abstract:

As an extremely challenging spatial–temporal sequence prediction task, satellite image sequence prediction has various and significant applications in real-world scenario...Show More

Abstract:

As an extremely challenging spatial–temporal sequence prediction task, satellite image sequence prediction has various and significant applications in real-world scenarios. Although a lot of deep learning prediction models are developed for spatial–temporal sequence prediction, the methods still deliver unsatisfactory performance in terms of keeping spatial–temporal consistency, which leads to inaccurate and blurry satellite image sequence predictions. To maintain spatial–temporal consistency and achieve high-quality satellite image sequence prediction, we propose a novel and effective spatial–temporal consistency network (STCNet). In STCNet, a multilevel motion memory-based predictor is proposed to accurately predict motion patterns of satellite image sequences to ensure temporal consistency. Then, a time-variant frame discriminator is carefully designed and proposed, which can enhance the perception quality of predicted frames to guarantee spatial consistency and simultaneously maintain the motion coherency of predicted sequences. Moreover, a scheduled sampling strategy is proposed to reduce the optimizing difficulty and better train the proposed method. Comprehensive experiments conducted on satellite image sequences from the FY-4A meteorological satellite verify the effectiveness, applicability, and adaptability of our proposed method compared to state-of-the-art approaches under challenging scenarios.
Article Sequence Number: 4104517
Date of Publication: 10 August 2023

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.