Skip to main content
SpringerLink
Log in

Content semantic image analysis and storage method based on intelligent computing of machine learning annotation

  • Deep Learning & Neural Computing for Intelligent Sensing and Control
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

With the popularity of computers and the rapid development of various application platforms, the explosive growth of data poses a huge challenge to data analysis and storage. For large-scale image analysis applications, the time delay in storing read data becomes an important issue that constrains this application. The semantic information asymmetry between image application and storage is the root cause of this problem. In view of content semantic analysis, in recent years, intelligent computing has become the main research direction. Among them, machine learning has become a research hot spot because of its offline learning and online generation characteristics. For the semantics of image content, machine learning can complete tasks such as content semantic association, classification, annotation and hash mapping, and provide algorithm support for applying image semantics and improving semantic analysis ability in large-scale environment. Image annotation is an important topic in the semantic analysis of image content. Annotation can establish a classification relationship between image content and semantics. In order to solve the problem of extracting a large amount of data in large-scale image analysis, a content semantic image content analysis and storage scheme based on intelligent computer learning image annotation is proposed. Combined with DSTH work, the program introduces deep learning, visual lexicon and map metadata. Hash semantic metadata supplemental metadata is obtained through deep learning, and semantic metadata is constructed and managed in a hierarchical structure. In addition, according to the characteristics of the graph structure, by improving the PageRank algorithm, the SemRank node ranking algorithm based on Hamming distance is proposed. Experimental results demonstrate the effectiveness and reliability of the algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Szegedy C et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 22–30

  2. Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60

    Article  Google Scholar 

  3. Mehmood Z, Mahmood T, Javid MA (2018) Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine. Appl Intell 48(1):166–181

    Article  Google Scholar 

  4. Gong Y et al (2017) Ranking approach to train deep neural nets for multilabel image annotation. U.S. Patent No. 9,552,549, 24 Jan 2017, pp 34–50

  5. Li X et al (2016) Socializing the semantic gap: a comparative survey on image tag assignment, refinement, and retrieval. ACM Comput Surv (CSUR) 49(1):14

    Article  Google Scholar 

  6. Meng J, Jiang Y, Xu X et al (2017) Support top irrelevant machine: learning similarity measures to maximize top precision for image retrieval. Neural Comput Appl 28(Suppl 1):1145. https://doi.org/10.1007/s00521-016-2431-4

    Article  Google Scholar 

  7. Alzu’bi A, Amira A, Ramzan N (2015) Semantic content-based image retrieval: a comprehensive study. J Vis Commun Image Represent 32:20–54

    Article  Google Scholar 

  8. Wang T, Wang W (2016) Research on new multi-feature large-scale image retrieval algorithm based on semantic parsing and modified kernel clustering method. Int J Secur Appl 10(1):139–154

    Google Scholar 

  9. Yao X et al (2016) Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Trans Geosci Remote Sens 54(6):3660–3671

    Article  Google Scholar 

  10. Yousuf M et al (2018) A novel technique based on visual words fusion analysis of sparse features for effective content-based image retrieval. Math Probl Eng. https://doi.org/10.1155/2018/2134395

    Article  Google Scholar 

  11. Zhang H et al (2016) Adaptive incremental learning of image semantics with application to social robot. Neurocomputing 173:93–101

    Article  Google Scholar 

  12. Demir B, Bruzzone L (2015) A novel active learning method in relevance feedback for content-based remote sensing image retrieval. IEEE Trans Geosci Remote Sens 53(5):2323–2334

    Article  Google Scholar 

  13. Loukas C (2018) Video content analysis of surgical procedures. Surg Endosc 32(2):553–568

    Article  Google Scholar 

  14. Zhao F et al (2015) Deep semantic ranking based hashing for multi-label image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 34–50

  15. Yuan L, Yao E, Tan G (2018) Automated and precise event detection method for big data in biomedical imaging with support vector machine. Comput Syst Sci Eng 33(2):105–114

    Google Scholar 

  16. Münzer B, Schoeffmann K, Böszörmenyi L (2018) Content-based processing and analysis of endoscopic images and videos: a survey. Multimed Tools Appl 77(1):1323–1362

    Article  Google Scholar 

  17. Bhaumik H et al (2016) Hybrid soft computing approaches to content based video retrieval: a brief review. Appl Soft Comput 46:1008–1029

    Article  Google Scholar 

  18. Celik C, Bilge HS (2017) Content based image retrieval with sparse representations and local feature descriptors: a comparative study. Pattern Recognit 68:1–13

    Article  Google Scholar 

  19. Xu Z, Hu C, Mei L (2016) Video structured description technology based intelligence analysis of surveillance videos for public security applications. Multimed Tools Appl 75(19):12155–12172

    Article  Google Scholar 

  20. Gharbia R, Hassanien AE, El-Baz AH, Elhoseny M, Gunasekaran M (2018) Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications. Future Gener Comput Syst 88:501–511

    Article  Google Scholar 

  21. Xie X et al (2018) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Gr 25:2362–2377

    Article  Google Scholar 

  22. Capuozzo G, Borghini M, Mammoliti F (2016) Computer-implemented method, a computer program product and a computer system for image processing. U.S. Patent No. 9,349,077, 24 May 2016, pp 1–10

  23. Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, Singapore, pp 29–48

Download references

Funding

This work was supported by Chongqing Big Data Engineering Laboratory for Children, Chongqing Electronics Engineering Technology Research Center for Interactive Learning, the Science and Technology Research Project of Chongqing Municipal Education Commission of China (No. KJ1601401), the Science and Technology Research Project of Chongqing University of Education (No. KY201725C), Basic Research and Frontier Exploration of Chongqing Science and Technology Commission (CSTC2014jcyjA40019) and Project of Science and Technology Research Program of Chongqing Education Commission of China (No. KJZD-K201801601).

Author information

Authors and Affiliations

  1. School of Mathematics and Information Engineering, Chongqing University of Education, Chongqing, China

    PengCheng Wei & Yang Zou

  2. College of Foreign Languages Literature, Chongqing University of Education, Chongqing, China

    Fangcheng He

Authors
  1. PengCheng Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fangcheng He
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yang Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to PengCheng Wei.

Ethics declarations

Conflict of interest

There are no conflicts of interests in this work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wei, P., He, F. & Zou, Y. Content semantic image analysis and storage method based on intelligent computing of machine learning annotation. Neural Comput & Applic 32, 1813–1822 (2020). https://doi.org/10.1007/s00521-020-04739-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-020-04739-4

Keywords

Search

Navigation