Skip to main content
SpringerLink
Log in

Content-Based Image Recognition and Tagging by Deep Learning Methods

  • Published:
Wireless Personal Communications Aims and scope Submit manuscript

Abstract

Deep learning techniques is growing wider day by day in the process of Content based Image retrieval (CBIR). The recognition of the image is based on its shape, attributes, and tag. It is challenging to establish the connection between semantic ideas in the vast real-world applications. The social media is dominating the globe by throwing its wide range of features where the people are finding difficulty in choosing their suitable objects or images because of any redundancy. So the proposed method is based on Content-based image recognition and tagging by using deep learning techniques. The tagging of the image is used here for easy identification of the objects. The Geon similarity model is used to extract the maximum similarity of the different images by its accurate and rapid computation methods. The modified grey wolf optimization method and the novelty based convolution neural network, ResNet-50, is applied here as a hashing technique and classifier to get high recognition rate and accuracy values when compared to the state of art methods. The performance attributes of the modified convolutional neural network give a high value of precision, accuracy, recall, and mAP.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig.1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig.11

Similar content being viewed by others

Data Availability

https://doi.org/10.1016/j.inffus.2017.01.003

https://doi.org/10.1007/s11042-019-7157-8

https://doi.org/10.1007/s11042-016-3834-z

https://doi.org/10.3390/sym10040099

https://doi.org/10.1016/j.matchemphys.2014.08.036

https://doi.org/10.1007/s10586-018-1731-0

https://doi.org/10.1109/icivc.2017.7984632

https://doi.org/10.1007/s11063-017-9662-y

https://doi.org/10.1016/j.neucom.2017.03.072

https://doi.org/10.1016/j.patcog.2017.03.006

https://doi.org/10.1007/978-3-319-59153-7_25

https://doi.org/10.1007/s11042-018-6038-x

https://doi.org/10.1109/tip.2018.2837219

https://doi.org/10.1109/tmm.2016.2568099

https://doi.org/10.1109/icpr.2016.7900086

https://doi.org/10.1007/978-981-13-9942-8_49

https://doi.org/10.1016/j.jvcir.2019.03.024

https://doi.org/10.1016/j.ipm.2019.102165

https://doi.org/10.1101/661454

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.222.9582&rep=rep1&type=pdf

https://doi.org/10.1016/j.optlastec.2018.06.061

https://arxiv.org/ftp/arxiv/papers/1902/1902.02059.pdf

https://doi.org/10.1002/cpe.4994

https://doi.org/10.1007/s13369-018-3454-1

https://doi.org/10.1007/978-981-32-9990-0_13

https://doi.org/10.33832/ijca.2019.12.4.02

https://doi.org/10.1007/978-3-030-25999-0_6

https://doi.org/10.1109/iccv.2019.00061

https://doi.org/10.1109/tip.2019.2940693

https://doi.org/10.1109/tmm.2019.2947197

References

  1. Piras, L., & Giacinto, G. (2017). Information fusion in content based image retrieval: A comprehensive overview. Information Fusion, 37, 50–60.

    Article  Google Scholar 

  2. He, L., Xie, L., Shu, H., & Hu, S., (2019). "Discrete semi-supervised learning for multi-label image classification and large-scale image retrieval," Multimedia Tools and Applications, pp. 1–19.

  3. Memon, M. H., Li, J.-P., Memon, I., & Arain, Q. A. (2017). GEO matching regions: Multiple regions of interests using content based image retrieval based on relative locations. Multimedia Tools and Applications, 76, 15377–15411.

    Article  Google Scholar 

  4. Corrales, D., Corrales, J., & Ledezma, A. (2018). How to address the data quality issues in regression models: A guided process for data cleaning. Symmetry, 10, 99.

    Article  Google Scholar 

  5. Ramacharyulu, P., Kumar, J. P., Prasad, G., & Sreedhar, B. (2014). Sulphur doped nano TiO2: Synthesis, characterization and photocatalytic degradation of a toxic chemical in presence of sunlight. Materials Chemistry and Physics, 148, 692–698.

    Article  Google Scholar 

  6. Saritha, R. R., Paul, V., & Kumar, P. G. (2019). Content based image retrieval using deep learning process. Cluster Computing, 22, 4187–4200.

    Article  Google Scholar 

  7. Xu, H., Wang, J.-Y., & Mao, L., (2017). "Relevance feedback for Content-based Image Retrieval using deep learning," in 2017 2nd International Conference on Image, Vision and Computing (ICIVC), 2017, pp. 629–633

  8. Zhou, Z., & Zhang, L. (2018). Content-Based Image Retrieval Using Iterative Search. Neural Processing Letters, 47, 907–919.

    Article  Google Scholar 

  9. Alzu’bi, A., Amira, A., & Ramzan, N. (2017). Content-based image retrieval with compact deep convolutional features. Neurocomputing, 249, 95–105.

    Article  Google Scholar 

  10. Celik, C., & Bilge, H. S. (2017). Content based image retrieval with sparse representations and local feature descriptors: A comparative study. Pattern Recognition, 68, 1–13.

    Article  Google Scholar 

  11. Rivas-Sánchez, M., Guerrero-Lebrero, M. D. L. P., Guerrero, E., Bárcena-Gonzalez, G., Martel, J., & Galindo, P. L. (2017). "Using Deep Learning for Image Similarity in Product Matching," in International Work-Conference on Artificial Neural Networks, 2017, pp. 281–290.

  12. Ma, Y., Liu, Y., Xie, Q., & Li, L. (2019). CNN-feature based automatic image annotation method. Multimedia Tools and Applications, 78, 3767–3780.

    Article  Google Scholar 

  13. Wang, Y., Zhu, L., Qian, X., & Han, J. (2018). Joint hypergraph learning for tag-based image retrieval. IEEE Transactions on Image Processing, 27, 4437–4451.

    Article  MathSciNet  Google Scholar 

  14. Lu, D., Liu, X., & Qian, X. (2016). Tag-based image search by social re-ranking. IEEE Transactions on Multimedia, 18, 1628–1639.

    Article  Google Scholar 

  15. Liang, R.-Z., Shi, L., Wang, H., Meng, J., Wang, J. J.-Y., Sun, Q. et al., (2016). "Optimizing top precision performance measure of content-based image retrieval by learning similarity function," in 2016 23rd International conference on pattern recognition (ICPR), pp. 2954–2958.

  16. Shukla, A. K., & Kanungo, S., (2019). "Enhanced Bag-of-Features Method Using Grey Wolf Optimization for Automated Face Retrieval," in International Conference on Advances in Computing and Data Sciences, pp. 519–528.

  17. Wang, X., Lee, F., & Chen, Q. (2019). Similarity-preserving hashing based on deep neural networks for large-scale image retrieval. Journal of Visual Communication and Image Representation, 61, 260–271.

    Article  Google Scholar 

  18. Huang, C., Luo, X., Zhang, J., Liao, Q., Wang, X., Jiang, Z. L., et al. (2020). Explore instance similarity: An instance correlation based hashing method for multi-label cross-model retrieval. Information Processing & Management, 57, 102165.

    Article  Google Scholar 

  19. Peng, T., Boxberg, M., Weichert, W., Navab, N., & Marr, C., (2019). "Multi-task learning of a deep k-nearest neighbour network for histopathological image classification and retrieval," in International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 676–684

  20. n. w. dataset.

  21. Sahu, S., Singh, A. K., Ghrera, S., & Elhoseny, M. (2019). An approach for de-noising and contrast enhancement of retinal fundus image using CLAHE. Optics & Laser Technology, 110, 87–98.

    Article  Google Scholar 

  22. Rashno, A. & Rashno, E. (2019). "Content-based image retrieval system with most relevant features among wavelet and color features," arXiv preprint arXiv:1902.02059.

  23. Sundara Vadivel, P., Yuvaraj, D., Navaneetha Krishnan, S., & Mathusudhanan, S. (2019). An efficient CBIR system based on color histogram, edge, and texture features. Concurrency and Computation: Practice and Experience, 31, e4994.

    Article  Google Scholar 

  24. Özyurt, F., Tuncer, T., Avci, E., Koc, M., & Serhatlioğlu, İ. (2019). A novel liver image classification method using perceptual hash-based convolutional neural network. Arabian Journal for Science and Engineering, 44, 3173–3182.

    Article  Google Scholar 

  25. Al-Tashi, Q., Rais, H. M., Abdulkadir,S. J., Mirjalili, S., & Alhussian, H., (2020). "A Review of Grey Wolf Optimizer-Based Feature Selection Methods for Classification," In Evolutionary Machine Learning Techniques, ed: Springer, pp. 273–286

  26. Ashqar, B. A., & Abu-Naser, S. S. (2019). Identifying images of invasive hydrangea using pre-trained deep convolutional neural networks. International Journal of Academic Engineering Research (IJAER), 3, 28–36.

    Google Scholar 

  27. Hoppenstedt, B., Kammerer, K., Reichert, M., Spiliopoulou M., & Pryss, R., (2019). "Convolutional Neural Networks for Image Recognition in Mixed Reality Using Voice Command Labeling," in International Conference on Augmented Reality, Virtual Reality and Computer Graphics, 2019, pp. 63–70.

  28. Chen, T., Xu, M., Hui, X., Wu, H., & Lin L., (2019). "Learning semantic-specific graph representation for multi-label image recognition," in Proceedings of the IEEE International Conference on Computer Vision, pp. 522–531.

  29. Cui, H., Zhu, L., Li, J., Yang, Y., & Nie, L. (2019). Scalable deep hashing for large-scale social image retrieval. IEEE Transactions on Image Processing, 29, 1271–1284.

    Article  MathSciNet  Google Scholar 

  30. Wang, Y., Zhang, L., Nie, F., Li, X., Chen, Z., & Wang, F., (2019). "WeGAN: Deep Image Hashing with Weighted Generative Adversarial Networks," IEEE Transactions on Multimedia.

Download references

Funding

This research work was not funded by any organization/institute/agency.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Vaigai College of Engineering, Madurai, Tamil Nadu, India

    A. Jeya Christy

  2. Department of Computer Science and Engineering, PSNA College of Engineering and Technology, Dindigul, Tamil Nadu, India

    K. Dhanalakshmi

Authors
  1. A. Jeya Christy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. K. Dhanalakshmi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

I am A. Jeya Christy hereby state that the manuscript title entitled “content-based image recognition and tagging by deep learning methods” submitted to the wireless personal communications, I and my co-author K. Dhanalakshmi confirm that this work is original and has not been published elsewhere, nor is it currently under consideration for publication elsewhere. and I am research scholar in the department of computer science at Vaigai college of Engineering, Madurai, and Tamil nadu, India.

Corresponding author

Correspondence to A. Jeya Christy.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Human and Animal Rights

No animals or human participants are involved in this research work.

Informed Consent

I confirm that any participants (or their guardians if unable to give informed consent, or next of kin, if deceased) who may be identifiable through the manuscript (such as a case report), have been given an opportunity to review the final manuscript and have provided written consent to publish.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jeya Christy, A., Dhanalakshmi, K. Content-Based Image Recognition and Tagging by Deep Learning Methods. Wireless Pers Commun 123, 813–838 (2022). https://doi.org/10.1007/s11277-021-09159-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11277-021-09159-8

Keywords

Search

Navigation