Abstract
In recent years, deep learning has been widely employed in the field of image compression, the most significant of which is the lossy image compression method on the basis of convolutional neural networks. And we study the application of convolutional neural networks to remote sensing image compression. Consequently, we implement an enhanced residual attention module (ERAM) on the primary and hyper coders. ERAM can apply a spatial attention mechanism to generate importance masks for potential features of the original image. And the importance mask can adaptively adjust the bit distribution and allocate more bits to substantial target regions and fewer bits to unimportant background regions. Additionally, ERAM has the capacity to lessen the channel redundancy of potential features. Furthermore, an accurate probability estimate of a potential feature can affect to a great degree the effectiveness of entropy coding and hence image compression. We propose to utilise the discrete mixed Laplace entropy model to parameterize the probability distribution of latent features, which can improve the compression efficiency of latent features in the entropy encoding process. In the field of remote sensing image compression, the experiments demonstrate that the algorithm described in this paper has good subjective effects as well as good objective effects.
Similar content being viewed by others
References
Cheng X, Li Z (2021) Predicting the lossless compression ratio of remote sensing images with configurational entropy. IEEE J Sel Top Appl Earth Obs Remote Sens 14:11936–11953
Wallace Gregory K (1992) The JPEG still picture compression standard. IEEE Trans Consum Electron 38(1):xviii–xxxiv
Rabbani M, Joshi R (2002) An overview of the JPEG 2000 still image compression standard. Signal Process Image Commun 17(1):3–48
Sullivan GJ, Ohm JR, Han WJ et al (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668
Ballé J, Laparra V, Simoncelli EP (2017) End-to-end optimized image compression. In: 5th International conference on learning representations, ICLR 2017
Ballé J, Minnen D, Singh S et al (2018) Variational image compression with a scale hyperprior. In: International conference on learning representations
Minnen D, Ballé J, Toderici GD (2018) Joint autoregressive and hierarchical priors for learned image compression. Adv Neural Inf Process Syst 31:10771–10780
Li M, Zuo W, Gu S et al (2018) Learning convolutional networks for content-weighted image compression. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3214–3223
Liu H, Chen T, Shen Q et al (2019) Practical stacked non-local attention modules for image compression. In: CVPR Workshops
Chen T, Liu H, Ma Z et al (2021) End-to-end learnt image compression via non-local attention optimization and improved context modeling. IEEE Trans Image Process 30:3179–3191
Cheng Z, Sun H, Takeuchi M et al (2020) Learned image compression with discretized gaussian mixture likelihoods and attention modules. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 7939–7948
Liu J, Lu G, Hu Z et al (2020) A unified end-to-end framework for efficient deep image compression. arXiv preprint arXiv:2002.03370
Zhong Z, Akutsu H, Aizawa K (2021) Channel-level variable quantization network for deep image compression. In: Proceedings of the twenty-ninth international conference on international joint conferences on artificial intelligence, pp 467–473
Kong F, Hu K, Li Y et al (2020) Spectral-spatial feature partitioned extraction based on CNN for multispectral image compression. Remote Sens 13(1):9
Sujitha B, Parvathy VS, Lydia EL et al (2021) Optimal deep learning based image compression technique for data transmission on industrial Internet of things applications. Trans Emerg Telecommun Technol 32(7):e3976
Zhao S, Yang S, Gu J et al (2021) Symmetrical lattice generative adversarial network for remote sensing images compression. ISPRS J Photogramm Remote Sens 176:169–181
Alves de Oliveira V, Chabert M, Oberlin T et al (2021) Reduced-complexity end-to-end variational autoencoder for on board satellite image compression. Remote Sens 13(3):447
Zhai G, Liu G, He X et al (2021) Adaptive scene-aware deep attention network for remote sensing image compression. J Electron Imaging 30(5):053008
Van Oord A, Kalchbrenner N, Kavukcuoglu K (2021) Pixel recurrent neural networks. In: International conference on machine learning. PMLR, pp 1747–1756
Xia GS, Hu J, Hu F et al (2017) AID: A benchmark data set for performance evaluation of aerial scene classification. IEEE Trans Geosci Remote Sens 55(7):3965–3981
Szegedy C, Liu W, Jia Y et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
Lee J, Cho S, Beack SK (2019) Context-adaptive entropy model for end-to-end optimized image compression. In: International conference on learning representations
Acknowledgements
This work was supported by the National Natural Science Foundation of China under Grant 62271336 & 62211530110.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gao, J., Teng, Q., He, X. et al. Mixed Entropy Model Enhanced Residual Attention Network for Remote Sensing Image Compression. Neural Process Lett 55, 10117–10129 (2023). https://doi.org/10.1007/s11063-023-11241-0
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11063-023-11241-0