Abstract
With the popularity of computers and the rapid development of various application platforms, the explosive growth of data poses a huge challenge to data analysis and storage. For large-scale image analysis applications, the time delay in storing read data becomes an important issue that constrains this application. The semantic information asymmetry between image application and storage is the root cause of this problem. In view of content semantic analysis, in recent years, intelligent computing has become the main research direction. Among them, machine learning has become a research hot spot because of its offline learning and online generation characteristics. For the semantics of image content, machine learning can complete tasks such as content semantic association, classification, annotation and hash mapping, and provide algorithm support for applying image semantics and improving semantic analysis ability in large-scale environment. Image annotation is an important topic in the semantic analysis of image content. Annotation can establish a classification relationship between image content and semantics. In order to solve the problem of extracting a large amount of data in large-scale image analysis, a content semantic image content analysis and storage scheme based on intelligent computer learning image annotation is proposed. Combined with DSTH work, the program introduces deep learning, visual lexicon and map metadata. Hash semantic metadata supplemental metadata is obtained through deep learning, and semantic metadata is constructed and managed in a hierarchical structure. In addition, according to the characteristics of the graph structure, by improving the PageRank algorithm, the SemRank node ranking algorithm based on Hamming distance is proposed. Experimental results demonstrate the effectiveness and reliability of the algorithm.





Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Szegedy C et al (2016) Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 22–30
Piras L, Giacinto G (2017) Information fusion in content based image retrieval: a comprehensive overview. Inf Fusion 37:50–60
Mehmood Z, Mahmood T, Javid MA (2018) Content-based image retrieval and semantic automatic image annotation based on the weighted average of triangular histograms using support vector machine. Appl Intell 48(1):166–181
Gong Y et al (2017) Ranking approach to train deep neural nets for multilabel image annotation. U.S. Patent No. 9,552,549, 24 Jan 2017, pp 34–50
Li X et al (2016) Socializing the semantic gap: a comparative survey on image tag assignment, refinement, and retrieval. ACM Comput Surv (CSUR) 49(1):14
Meng J, Jiang Y, Xu X et al (2017) Support top irrelevant machine: learning similarity measures to maximize top precision for image retrieval. Neural Comput Appl 28(Suppl 1):1145. https://doi.org/10.1007/s00521-016-2431-4
Alzu’bi A, Amira A, Ramzan N (2015) Semantic content-based image retrieval: a comprehensive study. J Vis Commun Image Represent 32:20–54
Wang T, Wang W (2016) Research on new multi-feature large-scale image retrieval algorithm based on semantic parsing and modified kernel clustering method. Int J Secur Appl 10(1):139–154
Yao X et al (2016) Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Trans Geosci Remote Sens 54(6):3660–3671
Yousuf M et al (2018) A novel technique based on visual words fusion analysis of sparse features for effective content-based image retrieval. Math Probl Eng. https://doi.org/10.1155/2018/2134395
Zhang H et al (2016) Adaptive incremental learning of image semantics with application to social robot. Neurocomputing 173:93–101
Demir B, Bruzzone L (2015) A novel active learning method in relevance feedback for content-based remote sensing image retrieval. IEEE Trans Geosci Remote Sens 53(5):2323–2334
Loukas C (2018) Video content analysis of surgical procedures. Surg Endosc 32(2):553–568
Zhao F et al (2015) Deep semantic ranking based hashing for multi-label image retrieval. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 34–50
Yuan L, Yao E, Tan G (2018) Automated and precise event detection method for big data in biomedical imaging with support vector machine. Comput Syst Sci Eng 33(2):105–114
Münzer B, Schoeffmann K, Böszörmenyi L (2018) Content-based processing and analysis of endoscopic images and videos: a survey. Multimed Tools Appl 77(1):1323–1362
Bhaumik H et al (2016) Hybrid soft computing approaches to content based video retrieval: a brief review. Appl Soft Comput 46:1008–1029
Celik C, Bilge HS (2017) Content based image retrieval with sparse representations and local feature descriptors: a comparative study. Pattern Recognit 68:1–13
Xu Z, Hu C, Mei L (2016) Video structured description technology based intelligence analysis of surveillance videos for public security applications. Multimed Tools Appl 75(19):12155–12172
Gharbia R, Hassanien AE, El-Baz AH, Elhoseny M, Gunasekaran M (2018) Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications. Future Gener Comput Syst 88:501–511
Xie X et al (2018) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Gr 25:2362–2377
Capuozzo G, Borghini M, Mammoliti F (2016) Computer-implemented method, a computer program product and a computer system for image processing. U.S. Patent No. 9,349,077, 24 May 2016, pp 1–10
Tyagi V (2017) Content-based image retrieval techniques: a review. In: Content-based image retrieval. Springer, Singapore, pp 29–48
Funding
This work was supported by Chongqing Big Data Engineering Laboratory for Children, Chongqing Electronics Engineering Technology Research Center for Interactive Learning, the Science and Technology Research Project of Chongqing Municipal Education Commission of China (No. KJ1601401), the Science and Technology Research Project of Chongqing University of Education (No. KY201725C), Basic Research and Frontier Exploration of Chongqing Science and Technology Commission (CSTC2014jcyjA40019) and Project of Science and Technology Research Program of Chongqing Education Commission of China (No. KJZD-K201801601).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
There are no conflicts of interests in this work.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wei, P., He, F. & Zou, Y. Content semantic image analysis and storage method based on intelligent computing of machine learning annotation. Neural Comput & Applic 32, 1813–1822 (2020). https://doi.org/10.1007/s00521-020-04739-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-020-04739-4