Skip to main content
Springer Nature Link
Log in

Majorization Resource for Visual Communication Effect of Multiframe Low-Resolution Photograph Sequence

  • Published:
Automatic Control and Computer Sciences Aims and scope Submit manuscript

Abstract

In contemporary society, individuals have elevated expectations for visual communication. Low-resolution images can negatively impact image quality and viewing experience. As a result, enhancing the visual communication of multiframe, low-resolution image sequences has become a primary focus of current research. This study optimized the visual communication effect of multiframe, low-resolution photo sequences using deep photo superresolution reconstruction technology based on low-resolution, color-guided photos. Meanwhile, the visual communication effect of multiframe low-resolution image sequences has also been improved. The experimental results indicated that from the perspective of infrared spectroscopy, multiframe video photo visual communication resources could have a harvest probability of 99% and a tracking efficiency of 96%. The reconstruction results of deep photos from various sources indicated that sparse encoding-based superresolution resources are suitable for doll images. Among different color photo superresolution algorithms, gradient-based upsampling network and adaptive separable data-specific transformation resources can better recover guided photos. Optimization algorithms can effectively enhance the visual communication of multiframe low-resolution image sequences by removing noise and improving image details while maintaining the natural style of the image and enhancing clarity. The proposed image strength enhancement method can address the issue of poor visual communication performance in multiframe low-resolution image sequences. The resources for optimizing visual connection effects in multiframe, low-resolution photo sequences can solve the problem of multiframe and low-resolution simultaneously. This approach has greater potential for development compared to a single solution. Therefore, this application holds significant reference value.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.

Similar content being viewed by others

REFERENCES

  1. Gultekin, G.K. and Saranli, A., Multi-frame motion deblurring of video using the natural oscillatory motion of dexterous legged robots, IET Image Process., 2019, vol. 13, no. 9, pp. 1502–1508. https://doi.org/10.1049/iet-ipr.2018.6678

    Article  Google Scholar 

  2. Chen, Zh., Shao, X., Sun, W., Zhao, J., and He, X., Optimization of multiscale digital speckle patterns for multiscale deformation measurement using stereo-digital image correlation, Appl. Opt., 2021, vol. 60, no. 16, pp. 4680–4689. https://doi.org/10.1364/ao.423350

    Article  Google Scholar 

  3. Masutani, E.M., Bahrami, N., and Hsiao, A., Deep learning single-frame and multiframe super-resolution for cardiac MRI, Radiology, 2020, vol. 295, no. 3, pp. 552–561. https://doi.org/10.1148/radiol.2020192173

    Article  Google Scholar 

  4. Gong, R., Wang, Yi., Cai, Yi., and Shao, X., How to deal with color in super resolution reconstruction of images, Opt. Express, 2017, vol. 25, no. 10, pp. 11144–11156. https://doi.org/10.1364/oe.25.011144

    Article  Google Scholar 

  5. He, H., Chen, T., Chen, M., Li, D., and Cheng, P., Remote sensing image super-resolution using deep–shallow cascaded convolutional neural networks, Sensor Rev., 2019, vol. 39, no. 5, pp. 629–635. https://doi.org/10.1108/sr-11-2018-0301

    Article  Google Scholar 

  6. Hamis, S., Zaharia, T., and Rousseau, O., Optimizing image compression with deep super-resolution techniques, IEEE Consum. Electron. Mag., 2020, vol. 9, no. 5, pp. 91–101. https://doi.org/10.1109/mce.2020.2986994

    Article  Google Scholar 

  7. Ren, J., Yang, W., Yang, X., Deng, X., Zhao, H., Wang, F., and Wang, L., Optimization of fusion method for GF-2 satellite remote sensing images based on the classification effect, Earth Sci. Res. J., 2019, vol. 23, no. 2, pp. 163–169. https://doi.org/10.15446/esrj.v23n2.80281

    Article  Google Scholar 

  8. Limam, H., Zouhair, A., and Oueslati, W., A new hybrid multiclass approach based on KNN and SVM, J. Inf. Knowl. Manage., 2022, vol. 21, no. 04, p. 2250061. https://doi.org/10.1142/s0219649222500617

    Article  Google Scholar 

  9. Ganaie, M.A. and Tanveer, M., KNN weighted reduced universum twin SVM for class imbalance learning, Knowl.-Based Syst., 2007, vol. 245, p. 108578. https://doi.org/10.1016/j.knosys.2022.108578

    Article  Google Scholar 

  10. Dong, W., Huang, T., Shi, G., Ma, Yi., and Li, X., Robust tensor approximation with Laplacian scale mixture modeling for multiframe image and video denoising, IEEE J. Sel. Top. Signal Process., 2018, vol. 12, no. 6, pp. 1435–1448. https://doi.org/10.1109/jstsp.2018.2873047

    Article  Google Scholar 

  11. Sonogashira, M., Funatomi, T., Iiyama, M., and Minoh, M., Variational Bayesian approach to multiframe image restoration, IEEE Trans. Image Process., 2017, vol. 26, no. 5, pp. 2163–2178. https://doi.org/10.1109/tip.2017.2678171

    Article  Google Scholar 

  12. Habib, W., Sarwar, T., Siddiqui, A.M., and Touqir, I., Wavelet denoising of multiframe optical coherence tomography data using similarity measures, IET Image Process., 2017, vol. 11, no. 1, pp. 64–79. https://doi.org/10.1049/iet-ipr.2016.0160

    Article  Google Scholar 

  13. Guo, R., Shi, X., Zhu, Yi., and Yu, T., Super-resolution reconstruction of astronomical images using time-scale adaptive normalized convolution, Chin. J. Aeronaut., 2018, vol. 31, no. 8, pp. 1752–1763. https://doi.org/10.1016/j.cja.2018.06.002

    Article  Google Scholar 

  14. Li, C., Zhang, B., Hu, H., and Dai, J., Enhanced bird detection from low-resolution aerial image using deep neural networks, Neural Process. Lett., 2019, vol. 49, no. 3, pp. 1021–1039. https://doi.org/10.1007/s11063-018-9871-z

    Article  Google Scholar 

  15. Yang, F., Yang, W., Gao, R., and Liao, Q., Discriminative multidimensional scaling for low-resolution face recognition, IEEE Signal Process. Lett., 2017, vol. 25, no. 3, pp. 388–392. https://doi.org/10.1109/lsp.2017.2746658

    Article  Google Scholar 

  16. Chen, Sh., Chen, Sh., Guo, Zh., and Zuo, Yu., Low-resolution palmprint image denoising by generative adversarial networks, Neurocomputing, 2019, vol. 358, pp. 275–284. https://doi.org/10.1016/j.neucom.2019.05.046

    Article  Google Scholar 

  17. Chevalier, M., Thome, N., Hénaff, G., and Cord, M., Classifying low-resolution images by integrating privileged information in deep CNNs, Pattern Recognit. Lett., 2018, vol. 116, pp. 29–35. https://doi.org/10.1016/j.patrec.2018.09.007

    Article  Google Scholar 

  18. Zareapoor, M., Jain, D.K., and Yang, J., Local spatial information for image super-resolution, Cognit. Syst. Res., 2018, vol. 52, pp. 49–57. https://doi.org/10.1016/j.cogsys.2018.06.007

    Article  Google Scholar 

  19. Tahmasebi, P., Nanoscale and multiresolution models for shale samples, Fuel, 2018, vol. 217, pp. 218–225. https://doi.org/10.1016/j.fuel.2017.12.107

    Article  Google Scholar 

  20. Kumar, V., Choudhury, T., Satapathy, S.Ch., Tomar, R., and Aggarwal, A., Video super resolution using convolutional neural network and image fusion techniques, Int. J. Knowl.-based Intell. Eng. Syst., 2020, vol. 24, no. 4, pp. 279–287. https://doi.org/10.3233/kes-190037

    Article  Google Scholar 

  21. Li, S., Fan, R., Lei, G., Yue, G., and Hou, Ch., A two-channel convolutional neural network for image super-resolution, Neurocomputing, 2018, vol. 275, pp. 267–277. https://doi.org/10.1016/j.neucom.2017.08.041

    Article  Google Scholar 

  22. Muthukrishnan, A., Charles Rajesh Kumar, J., Vinod Kumar, D., and Kanagaraj, M., Internet of image things-discrete wavelet transform and Gabor wavelet transform based image enhancement resolution technique for IoT satellite applications, Cognit. Syst. Res., 2019, vol. 57, pp. 46–53. https://doi.org/10.1016/j.cogsys.2018.10.010

    Article  Google Scholar 

  23. Yuan, R., Liu, G., He, J., Ma, Ch., Cheng, L., Fan, N., Ban, J., Li, Yu., and Sun, Yo., Determination of metmyoglobin in cooked tan mutton using Vis/NIR hyperspectral imaging system, J. Food Sci., 2020, vol. 85, no. 5, pp. 1403–1410. https://doi.org/10.1111/1750-3841.15137

    Article  Google Scholar 

  24. Lotfi, H. and Smara, Y., A comparative study on SAR images speckle reduction in a wavelet transform framework, Geoinformation for European-Wide Integration, Rotterdam: Millpress, 2022, vol. 1, no. 2, pp. 99–106.

    Google Scholar 

  25. Rostianingsih, S., Setiawan, A., and Halim, Ch.I., COCO (Creating Common Object in Context) dataset for chemistry apparatus, Procedia Comput. Sci., 2020, vol. 171, pp. 2445–2452. https://doi.org/10.1016/j.procs.2020.04.264

    Article  Google Scholar 

Download references

Funding

The research is supported by 2023 Guangdong Province Digital Factory Engineering Technology Research Center open project: Research and implementation of digitizing factory multi-system whole process interconnection (project no. 2023-KJXJ027).

Author information

Authors and Affiliations

  1. College of Intelligent Manufacture, Shunde Polytechnic, 528300, Foshan, China

    Zhipeng Yu

  2. School of Computer Science and Engineering, South China University of Technology, 510000, Guangzhou, China

    Qiang Wan

Authors
  1. Zhipeng Yu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Qiang Wan
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Qiang Wan.

Ethics declarations

The authors declare that they have no conflicts of interest.

Additional information

Publisher’s Note.

Allerton Press remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhipeng Yu, Qiang Wan Majorization Resource for Visual Communication Effect of Multiframe Low-Resolution Photograph Sequence. Aut. Control Comp. Sci. 58, 459–471 (2024). https://doi.org/10.3103/S0146411624700573

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S0146411624700573

Keywords: