Skip to main content

SAR Image Authentic Assessment with Bayesian Deep Learning and Counterfactual Explanations

  • Conference paper
  • First Online:
Pattern Recognition and Computer Vision (PRCV 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14428))

Included in the following conference series:

  • 854 Accesses

Abstract

Synthetic Aperture Radar (SAR) targets vary significantly with observation angles, which leads to the deep neural network being over-confident and unreliable under the condition of limited measurements. This issue can be addressed by means of data augmentation such as simulation or exemplar synthesis for unknown observations, however, the authenticity of simulated/synthesized data is critical. In this study, we propose a Bayesian convolutional neural network (BayesCNN) for SAR target recognition to attain better generalization and assess predictive uncertainty. Based on the measured uncertainty of BayesCNN’s prediction, we further propose to obtain the counterfactual explanation of an unrealistic SAR target generated by the unreliable simulation method. The experiments preliminarily demonstrates the proposed BayesCNN outperforms the counterpart frequentist neural network in terms of accuracy and confidence calibration when observation angles are constrained. In addition, the counterfactual explanation can reveal the non-authenticity of the augmented SAR target, which inspires us to filter the high-quality data, as well as to understand and improve the fidelity of generated SAR image in the future study.

This work was supported by the National Natural Science Foundation of China under Grant 62101459, and the China Postdoctoral Science Foundation under Grant BX2021248.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Antorán, J., Bhatt, U., Adel, T., Weller, A., Hernández-Lobato, J.M.: Getting a clue: a method for explaining uncertainty estimates. arXiv preprint arXiv:2006.06848 (2020)

  2. Blundell, C., Cornebise, J., Kavukcuoglu, K., Wierstra, D.: Weight uncertainty in neural network. In: International Conference on Machine Learning, pp. 1613–1622. PMLR (2015)

    Google Scholar 

  3. Datcu, M., Huang, Z., Anghel, A., Zhao, J., Cacoveanu, R.: Explainable, physics-aware, trustworthy artificial intelligence: a paradigm shift for synthetic aperture radar. IEEE Geosci. Remote Sens. Mag. 11(1), 8–25 (2023). https://doi.org/10.1109/MGRS.2023.3237465

    Article  Google Scholar 

  4. Goodfellow, I., et al.: Generative adversarial networks. Commun. ACM 63(11), 139–144 (2020)

    Article  MathSciNet  Google Scholar 

  5. Guo, C., Pleiss, G., Sun, Y., Weinberger, K.Q.: On calibration of modern neural networks. In: International Conference on Machine Learning, pp. 1321–1330. PMLR (2017)

    Google Scholar 

  6. Huang, Z., Liu, Y., Yao, X., Ren, J., Han, J.: Uncertainty exploration: toward explainable SAR target detection. IEEE Trans. Geosci. Remote Sens. 61, 1–14 (2023). https://doi.org/10.1109/TGRS.2023.3247898

    Article  Google Scholar 

  7. Zhongling, H., Xiwen, Y.: Progress and perspective on physically explainable deep learning for synthetic aperture radar image interpretation. J. Radar 11(1), 107–125 (2021)

    Google Scholar 

  8. Keydel, E.R., Lee, S.W., Moore, J.T.: MSTAR extended operating conditions: a tutorial. Algorithms Synth. Aperture Radar Imagery III(2757), 228–242 (1996)

    Google Scholar 

  9. Kingma, D.P., Welling, M., et al.: An introduction to variational autoencoders. Found. Trends® Mach. Learn. 12(4), 307–392 (2019)

    Google Scholar 

  10. Kwon, Y., Won, J.H., Kim, B.J., Paik, M.C.: Uncertainty quantification using Bayesian neural networks in classification: application to biomedical image segmentation. Comput. Stat. Data Anal. 142, 106816 (2020)

    Article  MathSciNet  Google Scholar 

  11. Liu, B., Ben Ayed, I., Galdran, A., Dolz, J.: The devil is in the margin: margin-based label smoothing for network calibration. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 80–88 (2022)

    Google Scholar 

  12. Shridhar, K., Laumann, F., Liwicki, M.: A comprehensive guide to Bayesian convolutional neural network with variational inference. arXiv preprint arXiv:1901.02731 (2019)

  13. Wilson, A.G., Izmailov, P.: Bayesian deep learning and a probabilistic perspective of generalization. Adv. Neural. Inf. Process. Syst. 33, 4697–4708 (2020)

    Google Scholar 

  14. Xu Feng, W.H., Yaqiu, J.: Deep learning as applied in SAR target recognition and terrain classification. J. Radar 6(2), 136–148 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhongling Huang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhuang, Y., Huang, Z. (2024). SAR Image Authentic Assessment with Bayesian Deep Learning and Counterfactual Explanations. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14428. Springer, Singapore. https://doi.org/10.1007/978-981-99-8462-6_36

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-8462-6_36

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-8461-9

  • Online ISBN: 978-981-99-8462-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics