Dongyang Ye
ABSTRACT
Nowadays, the automatic detection of harmful organisms in power places has attracted attention due to the extensive unattended way of power places. However, surveillance pictures are prone to motion blurring and harmful organisms cannot be effectively detected due to their frequent and fast movements in power places. On the basis of the improved Cycle-Consistent Adversarial Networks (CycleGAN) model, we propose a method for removing motion blur from the images of harmful biological organisms in power places. This method does not require paired blurred and real sharp images for training, which is consistent with actual requirements. In addition, our method improves the classical CycleGAN model by combining cycle consistency and perceptual loss to enhance the detail authenticity of image texture restoration and improve the detection accuracy. The model uses Wasserstein GAN with gradient penalty (WGAN-GP) as a loss function to train the depth model. Given the existence of the GAN itself, the entire real image distribution space is difficult to fill with the generated image distribution space. Experimental results show that the proposed method effectively improves the detection accuracy of harmful organisms in power places.
- Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... and Bengio, Y. 2014. Generative adversarial nets. In Advances in neural information processing systems, 2672--2680.Google Scholar
- Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. 2018. Deblurgan: Blind motion deblurring using conditional adversarial networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 8183--8192. DOI= http://doi.org/10.1109/CVPR.2018.00854Google Scholar
- Isola, P., Zhu, J. Y., Zhou, T., and Efros, A. A. 2017. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 125--1134. DOI=http://doi.org/10.1109/CVPR.2017.632Google Scholar
- Zhu, J. Y., Park, T., Isola, P., and Efros, A. A. 2017. Unpaired image-to-image translation using cycle-consistent adversarial networks. In Proceedings of the IEEE international conference on computer vision, 2223--2232.DOI= http://doi.org/10.1109/ICCV.2017.244Google Scholar
- Lu, B., Chen, J. C., and Chellappa, R. 2019. Unsupervised domain-specific deblurring via disentangled representations. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 10225--10234.Google Scholar
- Arjovsky, M., Chintala, S., and Bottou, L. 2017. Wasserstein gan. arXiv preprint arXiv:1701.07875.Google Scholar
- Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A. C. 2017. Improved training of wasserstein gans. In Advances in neural information processing systems, 5767--5777.Google Scholar
- Engin, D., Genç, A., and Kemal Ekenel, H. 2018. Cycle-dehaze: Enhanced cyclegan for single image dehazing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 825--833.DOI= http://doi.org/10.1109/CVPRW.2018.00127Google ScholarCross Ref
- Shan, Q., Jia, J., and Agarwala, A. 2008. High-quality motion deblurring from a single image. Acm transactions on graphics (tog), 27(3), 73.DOI= http://doi.org/10.1145/1360612.1360672Google Scholar
- Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., and Freeman, W. T. 2006, July. Removing camera shake from a single photograph. In ACM transactions on graphics (TOG) Vol. 25, No. 3, pp. 787--794. ACM.DOI= http://doi.org/10.1145/1179352.1141956Google Scholar
- Xu, L., Zheng, S., and Jia, J. 2013. Unnatural l0 sparse representation for natural image deblurring. In Proceedings of the IEEE conference on computer vision and pattern recognition 1107--1114, DOI= http://doi.org/10.1109/CVPR.2013.147Google Scholar
- Krishnan, D., Tay, T., and Fergus, R. 2011, June. Blind deconvolution using a normalized sparsity measure. In CVPR 2011--233-240. IEEE.DOI= http://doi.org/10.1109/CVPR.2011.5995521Google ScholarDigital Library
- Pan, J., Sun, D., Pfister, H., and Yang, M. H. 2016. Blind image deblurring using dark channel prior. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 1628--1636.DOI= http://doi.org/10.1109/CVPR.2016.180Google Scholar
- Xu, L., Ren, J. S., Liu, C., and Jia, J. 2014. Deep convolutional neural network for image deconvolution. In Advances in neural information processing systems 1790--1798.Google Scholar
- Eigen, D., Krishnan, D., and Fergus, R. 2013. Restoring an image taken through a window covered with dirt or rain. In Proceedings of the IEEE International Conference on Computer Vision 633--640.DOI= http://doi.org/10.1109/ICCV.2013.84Google Scholar
- Schuler, C. J., Hirsch, M., Harmeling, S., and Schölkopf, B. 2015. Learning to deblur. IEEE transactions on pattern analysis and machine intelligence, 38(7), 1439--1451.DOI= http://doi.org/10.1109/ICCV.2013.84Google Scholar
- Sun, J., Cao, W., Xu, Z., and Ponce, J. 2015. Learning a convolutional neural network for non-uniform motion blur removal. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 769--777. DOI= http://doi.org/10.1109/CVPR.2015.7298677Google Scholar
- Chakrabarti, A. 2016, October. A neural approach to blind motion deblurring. In European conference on computer vision 221--235. Springer, Cham. DOI= http://doi.org/10.1007/978-3-319-46487-9_14Google Scholar
- Gong, D., Yang, J., Liu, L., Zhang, Y., Reid, I., Shen, C., ... and Shi, Q. 2017. From motion blur to motion flow: a deep learning solution for removing heterogeneous motion blur. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2319--2328.DOI= http://doi.org/10.1109/CVPR.2017.405Google Scholar
- Nah, S., Hyun Kim, T., and Mu Lee, K. 2017. Deep multi-scale convolutional neural network for dynamic scene deblurring. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3883--3891.DOI= http://doi.org/10.1109/CVPR.2017.35Google ScholarCross Ref
- Ancuti, C., Ancuti, C. O., and Timofte, R. 2018. Ntire 2018 challenge on image dehazing: Methods and results. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 891--901.DOI= http://doi.org/10.1109/CVPRW.2018.00134Google Scholar
- Karras, T., Aila, T., Laine, S., and Lehtinen, J. 2017. Progressive growing of gans for improved quality, stability, and variation. arXiv preprint arXiv:1710.10196.Google Scholar
Index Terms
- Method for Removing Motion Blur from Images of Harmful Biological Organisms in Power Places Based on Improved Cyclegan
Recommendations
BIDGAN: Blind Image Deblurring with Improved CycleGAN and Frequency Filtering
Intelligent Computing Theories and ApplicationAbstractThe details of images can be severely impaired when they are captured in motion . To overcome such a blind image deblurring problem, we propose a deblurring method based on improved CycleGAN. This method can remarkably improve the definition of ...
Restoration of occluded face image based on improved CycleGAN model
RobCE '21: Proceedings of the 2021 International Conference on Robotics and Control EngineeringWith the rapid development of VR technology in the past two years, VR has been applied to many fields such as communication, video, game and so on. But for VR wearers, their faces are largely obscured, which hinders access to complete facial ...
Graded Image Generation Using Stratified CycleGAN
Medical Image Computing and Computer Assisted Intervention – MICCAI 2020AbstractIn medical imaging, CycleGAN has been used for various image generation tasks, including image synthesis, image denoising, and data augmentation. However, when pushing the technical limits of medical imaging, there can be a substantial variation ...
Comments