Skip to main content
SpringerLink
Log in

Large-area damage image restoration algorithm based on generative adversarial network

  • S.I. : Higher Level Artificial Neural Network Based Intelligent Systems
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Given that the traditional image restoration algorithm cannot generate high-quality false images and the restoration accuracy for the large-area damaged images is low, this study proposed the restoration algorithm of large-area damaged images based on the generative adversarial network. First of all, this study extracted multi-scale edge detailed information in image damage area through building the smooth function. Secondly, this study built the generative adversarial network model by using the multi-scale edge detailed information as the original information of large-area damaged images and then trained the model to generate the best false images through the continuous game between the generator and discriminator. Finally, this study obtained the existing information of the false images by combining the contextual information and the perceptual information, calculated the priority of information and restored the information according to the optimal sequencing results and continuously updated the damaged edge information until the large-area damaged image restoration is completed. The results show that the accuracy of extracting the detailed information with the proposed algorithm is high, and peak signal-to-noise ratio of the false images generated by the generative adversarial network model is high, the structural similarity index with the real image is not less than 0.93, the quality of the false images is high, the accuracy rate of priority calculation of the restoration information is high, and the restoration accuracy for large-area damaged images is far ahead of other algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Alfaro-Almagro F, Jenkinson M, Bangerter NK et al (2018) Image processing and quality control for the first 10,000 brain imaging datasets from UK Biobank. Neuroimage 166:400–424

    Article  Google Scholar 

  2. Lee CW, Tsai WH (2011) A secret-sharing-based method for authentication of grayscale document images via the use of the PNG image with a data repair capability. IEEE Trans Image Process 21(1):207–218

    MathSciNet  MATH  Google Scholar 

  3. Xie Z, Ma H, Bo Q et al (2016) Wavefront sensing and image restoration with spatially overlapping diversity technology. IEEE Photon Technol Lett 28(17):1882–1885

    Article  Google Scholar 

  4. Zeng W, Chen G, Ju R et al (2018) The combined application of database and three-dimensional image registration technology in the restoration of total nose defect. J Craniofac Surg 29(5):1–6

    Article  Google Scholar 

  5. Chen SH (2016) Inspecting lens collars for defects using discrete cosine transformation based on an image restoration scheme. IET Image Proc 10(6):474–482

    Article  Google Scholar 

  6. Yu J, Li J, Yu Z, Huang Q (2019) Multimodal transformer with multi-view visual representation for image captioning. IEEE Trans Circuits Syst Video Technol. https://doi.org/10.1109/tcsvt.2019.2947482

    Article  Google Scholar 

  7. Yu J, Tan M, Zhang H, Tao D, Rui Y (2019) Hierarchical deep click feature prediction for fine-grained image recognition. IEEE Trans Pattern Anal Mach Intell. https://doi.org/10.1109/.2019.2932058

    Article  Google Scholar 

  8. Yujie L, Changhong D, Qilu Z et al (2017) Hand drawn image retrieval based on condition generated adversary network. J Comput Aided Des Graph 29(12):186–192

    Google Scholar 

  9. Siquan Y, Zhi H, Yandong T et al (2018) Texture synthesis method based on confrontation generation network. Infrared Laser Eng 5(2):43–48

    Google Scholar 

  10. Jiwei T, Jinsong W, Kai S (2019) POI location algorithm based on PU and generative network. Comput Res Dev 9:1843–1850

    Google Scholar 

  11. Qinglin Z, Jiachen D, Ruifeng X (2019) Research on irony recognition based on confrontation learning. J Peking Univ (Nat Sci Ed) 55(1):29–36

    Google Scholar 

  12. Kehui S, Ying Z, Jiangwei Z et al (2019) Structured data table generation model based on generative adversary network. Comput Res Dev 56(9):1832–1842

    Google Scholar 

  13. Mattei F, Franceschini S, Scardi M (2018) A depth-resolved artificial neural network model of marine phytoplankton primary production. Ecol Model 382:51–62

    Article  Google Scholar 

  14. Yu L, Houquan L (2019) Facial image restoration based on confrontation training and convolution neural network. Comput Eng Appl 55(2):110–115

    Google Scholar 

  15. Kai H, Junqiao G, Wenxia L (2017) Image restoration algorithm based on improved confidence function and matching criteria. J Tianjin Univ (Nat Sci Eng Technol Ed) 50(4):399–404

    Google Scholar 

  16. Chaohui L, Yinghua S, Jinghua L (2016) Kinect based depth image inpainting method. J Jilin Univ (Eng Ed) 46(5):1697–1703

    Google Scholar 

  17. Chenchao D, Hongyuan W, Tongguang N, Shoubing C (2019) Pedestrian recognition based on deep convolution generation of confrontation network and expanding nearest neighbor reordering. Comput Res Dev 56(8):1632–1641

    Google Scholar 

  18. Bo W, Bo H, Kai C et al (2016) Improving spatiotemporal reflectance fusion using image inpainting and steering kernel regression techniques. Int J Remote Sens 38(3):706–727

    Google Scholar 

  19. Li S, Yang X (2017) Novel image inpainting algorithm based on adaptive fourth-order partial differential equation. IET Image Proc 11(10):870–879

    Article  Google Scholar 

  20. Yang X, Guo B (2017) Fractional-order tensor regularisation for image inpainting. IET Image Proc 11(9):734–745

    Article  Google Scholar 

  21. Sanders T, Dwyer C (2017) Subsampling and inpainting approaches for electron tomography. Ultramicroscopy 182:292–302

    Article  Google Scholar 

  22. Jun Y, Zhu C, Zhang J et al (2020) Spatial pyramid-enhanced NetVLAD with and weighted triplet loss for place recognition. IEEE Trans Neural Netw Learn Syst 31(2):661–674

    Article  Google Scholar 

  23. Jeong J, Lee JY, Son Y (2018) A study of partial image classification of vehicles using finger gestures. Int J Grid Distrib Comput 11(2):111–122

    Article  Google Scholar 

  24. Xianbin O, Liping S, Zhifang L (2017) Unequal backup and dual authentication self-healing limited domain image sharing. J Softw 28(12):3306–3346

    Google Scholar 

  25. Wang X, Fang S, Zhu X (2017) Weighted least-squares phase unwrapping algorithm based on a non-interfering image of an object. Appl Opt 56(15):45–53

    Google Scholar 

  26. Selmani A, Seddik H (2018) Anisotropic smart shape-adapted image smoothing without conductance function efficient for impulse noise removal. Digit Signal Proc 75:S1051200418300010

    MathSciNet  Google Scholar 

  27. Yin Y, Xia J, Li Y et al (2019) Group-wise itinerary planning in temporary mobile social network. IEEE Access 7:83682–83693

    Article  Google Scholar 

  28. Lim S, Cho YI (2018) Development and validation study of the korean genital image scale; focused on korean married women. Int J Multimed Ubiquitous Eng 13(2):7–12

    Article  Google Scholar 

  29. Chaudhari N, Sharma A, Lal AM (2017) Crack detection using image processing for automobiles and aircrafts. Int J Eng Technol Automob Secur 1(1):17–28

    Article  Google Scholar 

  30. Zhang H, Liu L, Long Y et al (2018) Unsupervised deep hashing with pseudo labels for scalable image retrieval. IEEE Trans Image Process 27(4):1626–1638

    Article  MathSciNet  Google Scholar 

  31. Jin Y, Guo X, Li Y et al (2020) Towards stabilizing facial landmark detection and tracking via hierarchical filtering: a new method. J Frankl Inst 357(5):3019–3037

    Article  Google Scholar 

  32. Ding D, Ram S, Rodriguez J (2018) Perceptually aware image in painting. Pattern Recogn 83:174–184

    Article  Google Scholar 

  33. Li JX, Zhang XK, Wang Z et al (2019) Dual-band eight-antenna array design for MIMO applications in 5G mobile terminals. IEEE Access 7(1):71636–71644

    Article  Google Scholar 

  34. Dutta S, Manideep BCS, Basha SM et al (2018) Classification of diabetic retinopathy images by using deep learning models. Int J Grid Distrib Comput 11(1):99–106

    Article  Google Scholar 

  35. Karchi RP, Munusamy N (2018) Exploration of unmixing and classification of hyperspectral imagery. Int J Future Gen Commun Netw 11(6):13–32

    Google Scholar 

  36. Shiwen H, Lin L, Yongqiang Z et al (2016) Image restoration method for improving TV-H model. J Harbin Univ Technol 48(2):167–172

    Google Scholar 

  37. Gao H, Xu Y, Yin Y et al (2019) Context-aware QoS prediction with neural collaborative filtering for internet-of-things services. IEEE Internet Things J. https://doi.org/10.1109/JIOT.2019.2956827

    Article  Google Scholar 

  38. Mushtaq S, Mir AH (2018) Image copy move forgery detection: a review. Int J Future Gen Commun Netw 11(2):11–22

    Google Scholar 

  39. Yin Y, Chen L, Xu Y et al (2020) QoS prediction for service recommendation with deep feature learning in edge computing environment. Mob Netw Appl 25:391–401

    Article  Google Scholar 

  40. Rao KS, Satyanarayana KV, Rao PS (2018) Segmentation of images using two parameter logistic type distribution and K-means clustering. Int J Grid Distrib Comput 11(12):1–20

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Humanities and Social Sciences Research Planning Fund Project in Ministry of Education under Grant Number 19YJAZH053 and the Opening Project of State Key Laboratory of Digital Publishing Technology under Grant Number cndplab-2020-M003 and Ministry of Education Science and Technology Development Center Industry-University Research Innovation Fund under Grant Number 2018A01002.

Author information

Authors and Affiliations

  1. College of Computer Science and Technology, Harbin Engineering University, Harbin, 150001, China

    Gang Liu

  2. Department of Information Engineering, Heilongjiang International University, Harbin, 150025, China

    Xiaofeng Li

  3. School of Computer Science and Technology, Beijing Institute of Technology, Beijing, 100081, China

    Jin Wei

Authors
  1. Gang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaofeng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jin Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xiaofeng Li.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest. No conflict of interest exits in the submission of this manuscript, and manuscript is approved by all authors for publication.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, G., Li, X. & Wei, J. Large-area damage image restoration algorithm based on generative adversarial network. Neural Comput & Applic 33, 4651–4661 (2021). https://doi.org/10.1007/s00521-020-05308-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-05308-5

Keywords

Search

Navigation