Skip to main content
SpringerLink
Log in

Zernike moments and LDP-weighted patches for content-based image retrieval

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

This paper proposes a new algorithm using global and local features for content-based image retrieval. Global features are extracted using the magnitude of Zernike moments (ZMs). Local features are obtained through local directional pattern (LDP). Generally, LDP is used to extract texture-based features from an image. In this paper, LDP is used to encode both texture and shape information of an image to represent more meaningful features. To encode texture-based features, original image is used to compute the LDP features. To extract shape information from an image, dual-tree complex wavelet transform (DT-CWT) is applied on image which generates six directional wavelets. These six directional wavelets are superimposed in order to obtain shape-encoded image. LDP is then applied on this wavelet-based shape-encoded image. Further, to enhance retrieval accuracy, LDP features are extracted from patches of both original and shape-encoded images. These patches are assigned with weights based on average discrimination capability of features in a patch. Experiments are performed using three different standard databases with various variations such as pose, distortion, partial occlusion and complex structure. The proposed technique achieves 96.4 and 98.76 % retrieval accuracy at a recall of 50 %, for Kimia-99 and COIL-100 databases, respectively. For MPEG-7 CE-2 shape database, retrieval accuracy of 61.93 % is achieved in terms of average Bull’s eye performance (BEP). The proposed technique is also tested on Springer medical image database to explore its scope in other areas, wherein it attains average BEP of 69.68 % in comparison with 61.52 % with ZMs. It is observed that the proposed technique outperforms other well-known existing methods of image retrieval.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1349–1379 (2000)

    Article  Google Scholar 

  2. Rui, Y., Huang Thomas, S.: Image Retrieval: Current techniques, promising directions and open issues. J. Vis. Commun. Image Represent. 10(1), 39–62 (1999)

    Article  Google Scholar 

  3. Eakins, J.P., Graham, M.E.: Content-based image retrieval: a report to the JISC technology application programme. Institute for Image Data Research, University of Northumbria at Newcastle, UK (1999)

  4. Qiu, G., Morris, J., Fan, X.: Visual guided navigation for image retrieval. Pattern Recognit. 40(6), 1711–1721 (2007)

    Article  MATH  Google Scholar 

  5. Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, influences, and trends of the new age. ACM Comput. Surv. 40(2), 1–60 (2008)

    Article  Google Scholar 

  6. Elalami, M.E.: A novel image retrieval model based on most relevant features. Knowl. Based Syst. 24(1), 23–32 (2011)

    Article  Google Scholar 

  7. Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recognit. 40(1), 262–282 (2007)

    Article  MATH  Google Scholar 

  8. Oussalah, M.: Content based image retrieval: review of state of art and future directions. In: Proceeding of Ist Workshop on Image Processing Theory, Tools and Applications (IPTA) November 2008. Sousse, 1–10 (2008).

  9. Yang, M., Kpalma, K., Ronsin, J.: A survey of shape feature extraction techniques. In: Yin, P.-Y. (ed.) Pattern Recognition Techniques, Technology and Applications, In Tech (2008). ISBN-978-953-7619-24-4

  10. Flickner, M., Sawhney, H., Niblack, W., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafine, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. In: IEEE Computer (1995)

  11. Gevers, T., Smeulders, A.W.M.: Pictoseek: combining color and shape invariant features for image retrieval. IEEE Trans. Image Process. 9(1), 102–119 (2000)

    Article  Google Scholar 

  12. Mehtre, B.M., Kankanhalli, M.S., Lee, W.F.: Shape measures for content based image retrieval: a comparison. Inf. Process. Manag. 33(3), 319–337 (1997)

    Article  Google Scholar 

  13. Zhang, D., Lu, G.: Review of shape representation and description techniques. Pattern Recognit. 37, 1–19 (2004)

    Article  MATH  Google Scholar 

  14. Zhang, D., Lu, G.: A comparative study of curvature scale space and Fourier descriptors for shape-based image retrieval. Visual Commun. Image Represent. 14(1), 41–60 (2003)

    Article  Google Scholar 

  15. Mokhtarian, F., Mackworth, A.K.: A theory of multiscale, curvature based shape representation for planar curves. IEEE Trans. Pattern Anal. Mach. Intell. 14, 789–805 (1992)

    Article  Google Scholar 

  16. Dubois, S.R., Glanz, F.H.: An autoregressive model approach to two dimensional shape classification. IEEE Trans. Pattern Anal. Mach. Intell. 8, 55–65 (1986)

    Article  Google Scholar 

  17. Yadav, R.B., Nishchal, N.K., Gupta, A.K., Rastogi, V.K.: Retrieval and classification of shape-based objects using Fourier, generic Fourier, and wavelet-Fourier descriptors technique: a comparative study. Opt. Laser Eng. 45(6), 695–708 (2007)

    Article  Google Scholar 

  18. Kim, W.Y., Kim, Y.S.: A region based shape descriptor using Zernike moments. Signal Process. Image Commun. 16(1–2), 95–102 (2000)

    Article  Google Scholar 

  19. Hu, M.K.: Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 8(2), 179–187 (1962)

    Article  MATH  Google Scholar 

  20. Teh, C.H., Chin, R.T.: On image analysis by the methods of moments. IEEE Trans. Pattern Anal. Mach. Intell. 10(4), 496–513 (1998)

    Article  Google Scholar 

  21. Teague, M.R.: Image analysis via the general theory of moments. Opt. Soc. Am. 70(8), 920–930 (1980)

    Article  MathSciNet  Google Scholar 

  22. Zhang, D., Lu, G.: Shape-based image retrieval using generic Fourier descriptor. Signal Process. Image Commun. 17(10), 825–848 (2002)

    Article  Google Scholar 

  23. Li, J., Allinson, N.M.: A comprehensive review of current local features for computer vision. Neurocomputing 71(10–12), 1771–1787 (2008)

    Article  Google Scholar 

  24. Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on feature distributions. Pattern Recognit. 29(1), 51–59 (1996)

    Article  Google Scholar 

  25. Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray scale and rotation invariant texture analysis with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–977 (2002)

    Google Scholar 

  26. Gho, Z., Zhang, L., Zhang, G.: A completed modeling of local binary pattern operator for texture classification. IEEE Trans. Image Process. 19(6), 1657–1663 (2010)

    Article  MathSciNet  Google Scholar 

  27. Murala, S., Maheshwari, R.P., Balasubramanian, R.: Directional binary wavelet patterns for biomedical image indexing and retrieval. Med. Syst. 36(5), 2865–2879 (2012)

    Article  MathSciNet  Google Scholar 

  28. Yadav, R.B., Nishchal, N.K., Gupta, A.K., Rastogi, V.K.: Retrieval and classification of objects using generic Fourier, Legendre moment, and wavelet Zernike moment descriptors and recognition using joint transform correlator. Opt. Lasers Technol. 40(3), 517–527 (2008)

    Article  Google Scholar 

  29. Goyal, A., Walia, E., Saini, H.S.: Enhanced retrieval accuracy with ZMs using dual tree complex wavelets and Fourier features. ICGST Int. J. Graph. Vis. Image Process. 10(3), 27–34 (2010)

    Google Scholar 

  30. Goyal, A., Walia, E., Saini, H.S.: Improved accuracy in shape based image retrieval with complex Zernike moments using wavelets. In: Proceeding of IEEE 2nd International Congress on Image and Signal Processing (CISP 2009), vol. 5, pp. 2247–2251, Tianjin, China (2009)

  31. Liu, Y.Y., Chen, M., Ishikawa, H., Wollstein, G., Scuman, J.S., Rehg, J.M.: Automated macular pathology diagnosis in retinal OCT images using multi-scale spatial pyramid and local binary patterns in texture and shape encoding. Med. Image Anal. 15(5), 748–759 (2011)

    Article  Google Scholar 

  32. Kabir, Md.H., Jabid, T., Chae, O.: Local Directional Pattern (LDP): a robust image descriptor for object recognition. In: IEEE International Conference Advanced Video and Signal-Based Surveillance, Boston, Aug. 29–Sept. 1, 2010, 482–487 (2010)

  33. Jabid, T., Kabir, M.H., Chae, O.: Robust facial expression recognition based on local directional pattern. ETRI J. 32(5), 784–794 (2010)

    Article  Google Scholar 

  34. Jabid, T., Kabir, Md.H., Chae, O.: Local directional pattern(LDP) for face recognition. In: Proceeding of IEEE International Conference on Consumer Electronic, pp. 329–330. s, Las Vegas, NV (2010)

  35. Dabbaghchian, S., Ghaemmaghami, M.P., Aghagolzadeh, A.: Feature extraction using discrete cosine transform and discrimination power analysis with a face recognition technology. Pattern Recognit. 43(4), 1431–1440 (2010)

    Article  MATH  Google Scholar 

  36. Singh, C., Walia, E., Mittal, N.: Robust two-stage face recognition approach using global and local features. Vis. Comput. 28(11), 1085–1098 (2011)

    Article  Google Scholar 

  37. Jain, A.K., Vailaya, A.: Shape-based retrieval: a case study with trademark image databases. Pattern Recognit. 31(5), 1369–1390 (1998)

    Article  Google Scholar 

  38. Wei, C.H., Li, Y., Chau, W.Y., Li, C.T.: Trademark image retrieval using synthetic features for describing global shape and interior structure. Pattern Recognit. 42(3), 386–394 (2008)

    Article  Google Scholar 

  39. Qi, H., Li, K., Shen, Y.M.: An effective solution for trademark image retrieval by combining shape description and feature matching. Pattern Recognit. 43(6), 2017–2027 (2010)

    Article  MATH  Google Scholar 

  40. Shu, X., Wu, X.J.: A novel contour descriptor for 2D shape matching and its application to image retrieval. Image Vis. Comput. 29(4), 286–294 (2011)

    Article  Google Scholar 

  41. Singh, C., Pooja.: Local and global features based image retrieval system using orthogonal radial moments. Opt. Lasers Eng. 50(5), 655–667 (2012)

  42. Goyal, A., Walia, E.: Variants of dense descriptors and Zernike moments as features for accurate shape-based image retrieval. Signal Image Video Process. (2012). doi:10.1007/s11760-012-0353-x

  43. Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. Appl. Comput. Harm. Anal. 10(3), 234–253 (2001)

    Article  MATH  MathSciNet  Google Scholar 

  44. Goyal, A., Walia, E.: An analysis of shape based image retrieval using variants of Zernike moments as features. Int. J. Imaging Robotics 7(S12), 44–69 (2012)

    Google Scholar 

  45. Bober, M.: MPEG-7 visual shape descriptors. IEEE Trans. Circ. Syst. Video Technol. 11(6), 716–719 (2001)

    Article  Google Scholar 

  46. Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 509–522 (2002)

    Article  Google Scholar 

  47. Li, S., Lee, M.C., Pun, C.M.: Complex Zernike moments features for shape based image retrieval. IEEE Trans. Syst. Man Cybern. 39(1), 227–237 (2009)

    Article  Google Scholar 

  48. Murala, S., Maheshwari, R.P., Balasubramanian, R.: Local maximum edge binary patterns: a new descriptor for image retrieval and object tracking. Signal Process. 92(6), 1467–1479 (2012)

    Article  Google Scholar 

  49. Murala, S., Maheshwari, R.P., Balasubramanian, R.: Local tetra patterns: a new feature descriptor for content based image retrieval. IEEE Trans. Image Process. 21(5), 2874–2886 (2012)

    Article  MathSciNet  Google Scholar 

  50. Brar, Y.S., Walia, E., Goyal, A.: Gabor wavelet enabled Zernike moments for effective content based image retrieval. In: Proceedings of International Conference on Image Analysis and Recognition. LNCS-7950, pp. 703–710 (2013)

  51. Singh, C.: Improved quality of reconstructed images using floating point arithmetic for moment calculation. Pattern Recognit. 39(11), 2047–2064 (2006)

    Article  MATH  Google Scholar 

  52. Revaud, J., Lavoue, G., Baskurt, A.: Improving Zernike moments comparison for optimal similarity and rotation angle retrieval. IEEE Trans. Pattern Anal. Mach. Intell. 31(4), 627–636 (2009)

    Article  Google Scholar 

  53. Haddadnia, J., Ahmadi, M., Raahemifar, K.: An effective feature extraction method for face recognition. In: Proceeding of International Conference on Image Processing, vol. 3, pp. 917–920, Barcelona (2003)

  54. Ghosal, S., Mehrotra, R.: Edge detection using orthogonal moment based operators. In: Proceeding of 11th International Conference on pattern recognition image, speech and signal analysis (IAPR), vol. 3, pp. 413–416, The Hague (1992)

  55. Chen, Z., Sun, S.K.: A Zernike moment phase-based descriptor for local image representation and matching. IEEE Trans. on Image Process. 19(1), 205–219 (2010)

    Article  Google Scholar 

  56. Wee, C.Y., Raveendran, P.: On the computational aspects of Zernike moments. Image Vis Comput. 25(6), 967–980 (2007)

    Article  Google Scholar 

  57. Pratt, W.K.: Digital Image Processing. Wiley, New York (1978)

    Google Scholar 

  58. Lee, S.W.: Offline recognition of totally unconstrained handwritten numerals using multilayer cluster neural networks. IEEE Trans. Pattern Anal. Mach. Intell. 18(6), 648–652 (1996)

    Article  Google Scholar 

  59. Mallat, S.: A wavelet tour of signal processing, 2nd edn. Academic Press, San Diego, NY (1999)

    MATH  Google Scholar 

  60. Liu, C.C., Dai, D.Q.: Face recognition using dual-tree complex wavelet features. IEEE Trans. Image Process. 18(11), 2593–2599 (2009)

    Article  MathSciNet  Google Scholar 

  61. Chen, G. Y., Kegl, B.: Invariant pattern recognition using dual-tree complex wavelets and Fourier features. In: Proceeding of Conference on Image and Vision Computing (IVCNZ 05), Newzealand (2005)

  62. Springer Online Medical Image Library. http://www.springerimages.com/ImagesMD/

  63. Chong, C.W., Raveendran, P., Mukundan, R.: A comparative analysis of algorithms for fast computation of Zernike moments. Pattern Recognit. 36, 731–742 (2003)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, South Asian University, New Delhi, India

    Ekta Walia

  2. Department of Computer Applications, Guru Nanak Institute of Management and Technology, Ludhiana, India

    Anjali Goyal

  3. Department of Electrical Engineering, Guru Nanak Dev Engineering College, Ludhiana, India

    Y. S. Brar

Authors
  1. Ekta Walia
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anjali Goyal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Y. S. Brar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anjali Goyal.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Walia, E., Goyal, A. & Brar, Y.S. Zernike moments and LDP-weighted patches for content-based image retrieval. SIViP 8, 577–594 (2014). https://doi.org/10.1007/s11760-013-0561-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-013-0561-z

Keywords

Search

Navigation