Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Blind Quality Assessment Method to Evaluate Cloud Removal Performance of Aerial Image

  • Conference paper
  • First Online:
Pattern Recognition and Computer Vision (PRCV 2020)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12305))

Included in the following conference series:

  • 2499 Accesses

Abstract

People often use image-inpainting-based methods to remove cloud from aerial images, but it lacks a targeted quantitative evaluator to assess the removal result. In order to solve this issue to some extent, we propose an assessment method that combines ranking learning and regression learning. The main framework consists of several CNN down-sampling steps layer-by-layer. Firstly, to learn the distortion features of the inpainted image, an image classification task is conducted to train the network. Secondly, we use the proposed joint loss function to regress the features into the FR-IQA evaluator SSIM by retraining the whole network. Through end-to-end training, the proposed model learns a priori of the aerial image and realizes the approximation of SSIM. Experimental results demonstrate that our method has achieved better performance on SROCC, RMSE and PLCC in comparison with other blind image quality assessment methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Siravenha, A.C., Sousa, D., Bispo, A., Pelaes, E.: Evaluating inpainting methods to the satellite images clouds and shadows removing. In: International Conference on Signal Processing, Image Processing, and Pattern Recognition, pp. 56–65 (2011)

    Google Scholar 

  2. Lorenzi, L., Melgani, F., Mercier, G.: Inpainting strategies for reconstruction of missing data in VHR images. IEEE Geosci. Remote Sens. Lett. 8(5), 914–918 (2011)

    Article  Google Scholar 

  3. Singh, P., Komodakis, N.: Cloud-Gan: cloud removal for sentinel-2 imagery using a cyclic consistent generative adversarial networks. In: IGARSS 2018–2018 IEEE International Geoscience and Remote Sensing Symposium, pp. 1772–1775 (2018)

    Google Scholar 

  4. Song, C., Xiao, C.: Single aerial photo cloud removal. J. Comput. Aided Des. Comput. Graph. 31(1), 76 (2019)

    Google Scholar 

  5. Yeh, R.A., Chen, C., Yian Lim, T., Schwing, A.G., Hasegawa-Johnson, M., Do, M.N.: Semantic image inpainting with deep generative models. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5485–5493 (2017)

    Google Scholar 

  6. Pathak, D., Krahenbuhl, P., Donahue, J., Darrell, T., Efros, A.: Context encoders: feature learning by inpainting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2536–2544 (2016)

    Google Scholar 

  7. Yu, J., Lin, Z., Yang, J., Shen, X., Lu, X., Huang, T.S.: Generative image inpainting with contextual attention. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 5505–5514 (2018)

    Google Scholar 

  8. Darabi, S., Shechtman, E., Barnes, C., Goldman, D.B., Sen, P.: Image melding: combining inconsistent images using patch-based synthesis. ACM Trans. Graph. 31(4), 1–10 (2012)

    Article  Google Scholar 

  9. Wang, Z., Sheikh, H.R., Bovik, A.C.: No-reference perceptual quality assessment of JPEG compressed images. In: Proceedings of the International Conference on Image Processing, p. 1 (2002)

    Google Scholar 

  10. Wang, Z., Simoncelli, E.P.: Local phase coherence and the perception of blur. In: Advances in Neural Information Processing Systems, pp. 1435–1442 (2004)

    Google Scholar 

  11. Mittal, A., Soundararajan, R., Bovik, A.C.: Making a “completely blind” image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2012)

    Article  Google Scholar 

  12. Zhang, L., Zhang, L., Bovik, A.C.: A feature-enriched completely blind image quality evaluator. IEEE Trans. Image Process. 24(8), 2579–2591 (2015)

    Article  MathSciNet  Google Scholar 

  13. Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)

    Article  MathSciNet  Google Scholar 

  14. Saad, M.A., Bovik, A.C., Charrier, C.: Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans. Image Process. 21(8), 3339–3352 (2012)

    Article  MathSciNet  Google Scholar 

  15. Hassen, R., Wang, Z., Salama, M.M.: Image sharpness assessment based on local phase coherence. IEEE Trans. Image Process. 22(7), 2798–2810 (2013)

    Article  Google Scholar 

  16. Ye, P., Kumar, J., Kang, L., Doermann, D.: Unsupervised feature learning framework for no-reference image quality assessment. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1098–1105 (2012)

    Google Scholar 

  17. Xue, W., Zhang, L., Mou, X.D.: Learning without human scores for blind image quality assessment. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 995–1002 (2013)

    Google Scholar 

  18. Kang, L., Ye, P., Li, Y., Doermann, D.: Convolutional neural networks for no-reference image quality assessment. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1733–1740 (2014)

    Google Scholar 

  19. Bosse, S., Maniry, D., Müller, K.R., Wiegand, T., Samek, W.: Deep neural networks for no-reference and full-reference image quality assessment. IEEE Trans. Image Process. 27(1), 206–219 (2017)

    Article  MathSciNet  Google Scholar 

  20. Kim, J., Lee, S.: Deep learning of human visual sensitivity in image quality assessment framework. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1676–1684 (2017)

    Google Scholar 

  21. Kim, J., Nguyen, A.D., Lee, S.: Deep CNN-based blind image quality predictor. IEEE Trans. Neural Netw. Learn. Syst. 30(1), 11–24 (2018)

    Article  Google Scholar 

  22. Kim, J., Lee, S.: Fully deep blind image quality predictor. IEEE J. Sel. Top. Sig. Process. 11(1), 206–220 (2016)

    Article  Google Scholar 

  23. Liu, X., van de Weijer, J., Bagdanov, A.D.: RankIQA: learning from rankings for no-reference image quality assessment. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1040–1049 (2017)

    Google Scholar 

  24. Ma, K., Liu, W., Liu, T., Wang, Z., Tao, D.: dipIQ: blind image quality assessment by learning-to-rank discriminable image pairs. IEEE Trans. Image Process. 26(8), 3951–3964 (2017)

    Article  MathSciNet  Google Scholar 

  25. Ma, K., Liu, W., Zhang, K., Duanmu, Z., Wang, Z., Zuo, W.: End-to-end blind image quality assessment using deep neural networks. IEEE Trans. Image Process. 27(3), 1202–1213 (2017)

    Article  MathSciNet  Google Scholar 

  26. Zhang, W., Ma, K., Yan, J., Deng, D., Wang, Z.: Blind image quality assessment using a deep bilinear convolutional neural network. IEEE Trans. Circuits Syst. Video Technol. 30(1), 36–47 (2020)

    Article  Google Scholar 

  27. Lin, K. Y., and Wang, G.: Hallucinated-IQA: no-reference image quality assessment via adversarial learning. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 732–741 (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. PLA Army Academy of Artillery and Air Defense, Hefei, Anhui, China

    Zhe Wei, Yongfeng Liu, Mengjie Li, Congli Li & Song Xue

Authors
  1. Zhe Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongfeng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mengjie Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Congli Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Song Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Congli Li .

Editor information

Editors and Affiliations

  1. Peking University, Beijing, China

    Yuxin Peng

  2. Nanjing University of Information Science and Technology, Nanjing, China

    Qingshan Liu

  3. Dalian University of Technology, Dalian, China

    Huchuan Lu

  4. Chinese Academy of Sciences, Beijing, China

    Zhenan Sun

  5. Chinese Academy of Sciences, Beijing, China

    Chenglin Liu

  6. Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

    Xilin Chen

  7. Peking University, Beijing, China

    Hongbin Zha

  8. Nanjing University of Science and Technology, Nanjing, China

    Jian Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wei, Z., Liu, Y., Li, M., Li, C., Xue, S. (2020). Blind Quality Assessment Method to Evaluate Cloud Removal Performance of Aerial Image. In: Peng, Y., et al. Pattern Recognition and Computer Vision. PRCV 2020. Lecture Notes in Computer Science(), vol 12305. Springer, Cham. https://doi.org/10.1007/978-3-030-60633-6_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-60633-6_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-60632-9

  • Online ISBN: 978-3-030-60633-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation