Skip to main content
SpringerLink
Log in

Medical image retrieval using a novel local relative directional edge pattern and Zernike moments

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The traditional annotation-based medical image retrieval faces a problem with competence and precision with the extensive medical image databases. Broad research has been undertaken on Medical image retrieval (MIR) using local, global features of each image, and machine learning algorithms with reliable descriptors have shown the significant improvement of these systems. The proposed method is implemented with a novel approach to address the semantic gap and form efficient texture and shape features clusters. The texture and shape feature vectors are constructed using a novel Relative directional edge binary patterns (RDEBP) and complex Zernike moments. RDEBPs are used to extract the texture features of an image. For every defined square matrix of size 5 × 5, 4 RDEBP patterns are extracted, rich in providing the texture information of an object in the image. The binary patterns are calculated by considering the center pixel’s neighbourhood and relations between neighbour pixels. The complex Zernike moments (ZM) give the shape properties of the object involved in the image. Combining these two features is effectively clustered using the Density-based spatial clustering of applications with noise (DBSCAN) algorithm. Finally, images are retrieved from the closest cluster using the d1-similarity metric concerning the query image. Therefore, the searching time for a query image from the specified cluster is reduced compared to the traditional Content-based image retrieval (CBIR), reflecting excellent response time and retrieval accuracy. Experiments on two databases were performed and confirmed the effectiveness of the proposed work over other state-of-the-art methods. The outcomes of the suggested method are more than 2 to 5% better when compared to the average values produced by other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data Availability

Two publicly medical images databases are analysed during the current study. These databases include Emphysema-CT database [10], and Brain tumor database [8]. The link to these databases are available in the reference section.

References

  1. Afifi AJ, Ashour WM (2012) Content-based image retrieval using invariant color and texture features. In: 2012 International conference on digital image computing techniques and applications (DICTA), IEEE, pp 1–6

  2. Aggarwal AK (2020) Fusion and enhancement techniques for processing of multispectral images. In: Unmanned aerial vehicle: applications in agriculture and environment, Springer, pp 159–175

  3. Ahmad J, Muhammad K, Baik SW (2018) Medical image retrieval with compact binary codes generated in frequency domain using highly reactive convolutional features. J Med Syst 42(2):1–19

    Article  Google Scholar 

  4. Ashok S, Kishore G, Rajesh V, Suchitra S, Sophia SGG, Pavithra B (2020) Tomato leaf disease detection using deep learning techniques. In: 2020 5Th international conference on communication and electronics systems (ICCES), IEEE, pp 979–983

  5. Bedi AK, Sunkaria RK (2020) Local tetra-directional pattern–a new texture descriptor for content-based image retrieval. Pattern Recog Image Anal 30(4):578–592

    Article  Google Scholar 

  6. Bhatt N, Ganatra A (2021) Improvement of deep cross-modal retrieval by generating real-valued representation. PeerJ Comput Sci e491:7

    Google Scholar 

  7. Chen W, Liu Y, Wang W, Bakker E, Georgiou T, Fieguth P, Liu L, Lew MS (2021) Deep learning for instance retrieval: A survey. arXiv:2101.11282

  8. Cheng J Brain tumor, Brain Tumor database. https://figshare.com/articles/dataset/brain_tumor_dataset/1512427/5

  9. Dubey SR, Singh SK, Singh RK (2015) Local bit-plane decoded pattern: a novel feature descriptor for biomedical image retrieval. IEEE J Biomed Health Inf 20(4):1139–1147

    Article  Google Scholar 

  10. ECT Emphysema-CT database. https://lauge-soerensen.github.io/emphysema-database/

  11. Ester M, Kriegel H -P, Sander J, Xu X et al (1996) A density-based algorithm for discovering clusters in large spatial databases with noise. In: Kdd, vol 96. pp 226–231

  12. Garg M, Ubhi JS, Aggarwal AK (2021) Deep learning for obstacle avoidance in autonomous driving. In: Autonomous driving and advanced driver-assistance systems (ADAS), CRC press, pp 233–246

  13. Karanwal S, Diwakar M (2021) Neighborhood and center difference-based-lbp for face recognition. Pattern Anal Appl 24(2):741–761

    Article  Google Scholar 

  14. Karanwal S, Diwakar M (2021) Od-lbp: Orthogonal difference-local binary pattern for face recognition. Digit Signal Process 102948:110

    Google Scholar 

  15. Khalid MJ, Irfan M, Ali T, Gull M, Draz U, Glowacz A, Sulowicz M, Dziechciarz A, AlKahtani FS, Hussain S (2020) Integration of discrete wavelet transform, dbscan, and classifiers for efficient content based image retrieval. Electronics 9(11):1886

    Article  Google Scholar 

  16. Kulshreshtha D, Singh VP, Shrivastava A, Chaudhary A, Srivastava R (2017) Content-based mammogram retrieval using k-means clustering and local binary pattern. In: 2017 2Nd international conference on image, vision and computing (ICIVC), IEEE, pp 634–638

  17. Li Z, Tang J (2015) Unsupervised feature selection via nonnegative spectral analysis and redundancy control. IEEE Trans Image Process 24(12):5343–5355

    Article  MathSciNet  MATH  Google Scholar 

  18. Li Z, Tang J (2015) Weakly supervised deep metric learning for community-contributed image retrieval. IEEE Trans Multimed 17 (11):1989–1999

    Article  Google Scholar 

  19. Li Z, Yang Y, Liu J, Zhou X, Lu H (2012) Unsupervised feature selection using nonnegative spectral analysis. In: Proceedings of the AAAI conference on artificial intelligence, vol 26. pp 1026–1032

  20. Liu H, Xiong J, Zhang N, Liu F, Zou X (2021) Quadruplet-based deep cross-modal hashing. Comput Intell Neurosci 2021

  21. Liu Y, Zhang D, Lu G, Ma W-Y (2007) A survey of content-based image retrieval with high-level semantics. Pattern Recog 40(1):262–282

    Article  MATH  Google Scholar 

  22. Maji S, Bose S (2021) Cbir using features derived by deep learning. ACM/IMS Trans Data Sci (TDS) 2(3):1–24

    Article  Google Scholar 

  23. Martolia M, Dhanore N, Singh A, Shahare V, Arora N (2020) A modified local binary pattern (lbp) for content-based image retrieval. Int J Adv Sci Technol 29(1):1630–1644

    Google Scholar 

  24. Nguyen H -T, Caplier A (2012) Elliptical local binary patterns for face recognition. In: Asian conference on computer vision, Springer, pp 85–96

  25. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recog 29(1):51–59

    Article  Google Scholar 

  26. Ojala T, Pietikäinen M, Mäenpää T (2001) A generalized local binary pattern operator for multiresolution gray scale and rotation invariant texture classification. In: International conference on advances in pattern recognition, Springer, pp 399–408

  27. Pathak D, Raju USN (2022) Content-based image retrieval for super-resolutioned images using feature fusion: Deep learning and hand crafted. Concurr Comput Prac Exp :e6851

  28. Pietikäinen M, Zhao G (2015) Two decades of local binary patterns: a survey. In: Advances in independent component analysis and learning machines, Elsevier, pp 175–210

  29. Pradhan J, Pal AK, Banka H (2019) Principal texture direction based block level image reordering and use of color edge features for application of object based image retrieval. Multimed Tools Appl 78(2):1685–1717

    Article  Google Scholar 

  30. Pradhan J, Pal AK, Banka H (2022) A cbir system based on saliency driven local image features and multi orientation texture features. J Vis Commun Image Represent 103396:83

    Google Scholar 

  31. Pradhan J, Pal AK, Banka H, Dansena P (2021) Fusion of region based extracted features for instance-and class-based cbir applications. Appl Soft Comput 107063:102

    Google Scholar 

  32. Quellec G, Lamard M, Cazuguel G, Cochener B, Roux C (2010) Wavelet optimization for content-based image retrieval in medical databases. Med Image Anal 14(2):227–241

    Article  MATH  Google Scholar 

  33. Sasaki Y et al (2007) The truth of the f-measure. Teach Tutor Mater 1(5):1–5

    Google Scholar 

  34. Seetharaman K, Sathiamoorthy S (2016) A unified learning framework for content based medical image retrieval using a statistical model. J King Saud Univ-Comput Inf Sci 28(1):110–124

    Google Scholar 

  35. Shabat AM, Tapamo J -R (2016) Directional local binary pattern for texture analysis. In: International conference on image analysis and recognition, Springer, pp 226–233

  36. Singh VP, Srivastava R (2017) Content-based mammogram retrieval using wavelet based complete-lbp and k-means clustering for the diagnosis of breast cancer. Int J Hybrid Intell Syst 14(1-2):31–39

    Google Scholar 

  37. Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12):1349–1380

    Article  Google Scholar 

  38. Srinivas M, Naidu RR, Sastry CS, Mohan CK (2015) Content based medical image retrieval using dictionary learning. Neurocomputing 168:880–895

    Article  Google Scholar 

  39. Srivastava A, Singhal V, Aggarawal AK (2017) Comparative analysis of multimodal medical image fusion using pca and wavelet transforms. Int J Latest Technol Eng Manag Appl Sci (IJLTEMAS) VI

  40. Sucharitha G, Senapati RK (2017) Shape based image retrieval using lower order zernike moments. Int J Electr Comput Eng 7(3):1651

    Google Scholar 

  41. Sucharitha G, Senapati RK (2020) Biomedical image retrieval by using local directional edge binary patterns and zernike moments. Multimed Tools Appl 79(3):1847–1864

    Article  Google Scholar 

  42. Tahmasbi A, Saki F, Shokouhi SB (2011) Classification of benign and malignant masses based on zernike moments. Comput Biol Med 41(8):726–735

    Article  Google Scholar 

  43. Thukral R, Arora AS, Kumar A et al (2022) Denoising of thermal images using deep neural network. In: Proceedings of international conference on recent trends in computing, Springer, pp 827–833

  44. Tuyet VTH, Binh NT, Quoc NK, Khare A (2021) Content based medical image retrieval based on salient regions combined with deep learning. Mob Netw Appl 26(3):1300–1310

    Article  Google Scholar 

  45. Verma M, Raman B (2016) Local tri-directional patterns: a new texture feature descriptor for image retrieval. Digit Signal Process 51:62–72

    Article  MathSciNet  Google Scholar 

  46. Verma M, Raman B (2018) Local neighborhood difference pattern: a new feature descriptor for natural and texture image retrieval. Multimed Tools Appl 77(10):11843–11866

    Article  Google Scholar 

  47. Zhang G, Ma Z -M (2007) Texture feature extraction and description using gabor wavelet in content-based medical image retrieval. In: 2007 International conference on wavelet analysis and pattern recognition, vol 1. IEEE, pp 169–173

  48. Zhen L, Hu P, Wang X, Peng D (2019) Deep supervised cross-modal retrieval. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 10394–10403

Download references

Author information

Authors and Affiliations

  1. Electronics and Communication Engineering, Institute of Aeronautical Engineering, Dundigal, India

    G. Sucharitha

  2. Indian Institute of Technology, Roorkee, India

    Nitin Arora & Subhash C. Sharma

Authors
  1. G. Sucharitha
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nitin Arora
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Subhash C. Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to G. Sucharitha.

Ethics declarations

Conflict of Interests

The authors have no conflicts of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sucharitha, G., Arora, N. & Sharma, S.C. Medical image retrieval using a novel local relative directional edge pattern and Zernike moments. Multimed Tools Appl 82, 31737–31757 (2023). https://doi.org/10.1007/s11042-023-14720-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-14720-7

Keywords

Search

Navigation