Skip to main content
SpringerLink
Log in

A novel multimodal framework for automatic recognition of individual cattle based on hybrid features using sparse stacked denoising autoencoder and group sparse representation techniques

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Recently, visual animal bio-metrics have attracted much attention for identifying endangered species and animals based on their prominent bio-metric features. This study explores a new possibility of using facial recognition for an inexpensive and user-friendly bio-metric modality to identify cattle. This paper proposes an automatic recognition system to identify cattle based on face and muzzle image features using sparse Stacked Denoising Autoencoder (SDAE) and group sparse representation techniques. The discriminatory features are extracted from cattle’s facial image and muzzle images using sparse SDAE and Deep Belief Networks (DBN) methods to represent extracted features. It mitigates the need for individual bio-metric feature representation from the single face and muzzle bio-metric modality features at various score levels. The single modality features and multi-features are fused at score level to represent better and classify individual cattle using group sparse representation technique. The proposed system’s performance is compared with holistic and handcrafted texture feature extraction and representation technique and current state of the art methods. Author shows that the proposed recognition system yield 96.85% accuracy for identifying individual cattle based on the multi-feature-based representation of cattle’s face and muzzle features.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Acharya UR, Sree SV, Krishnan MMR, Molinari F, Saba L, Ho SYS, Suri JS (2012) Atherosclerotic risk stratification strategy for carotid arteries using texture-based features. Ultrasound Med Biol 38(6):899–915

    Article  Google Scholar 

  2. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: Application to face recognition. IEEE Transactions on pattern analysis & machine intelligence 12:2037–2041

    Article  MATH  Google Scholar 

  3. Andrew W, Greatwood C, Burghardt T (2019) Aerial animal bio-metrics: Individual friesian cattle recovery and visual identification via an autonomous uav with onboard deep inference. IEEE international workshop on intelligent robots and systems (IROS), pp 237–243

  4. Awad AI (2016) From classical methods to animal bio-metrics: a review on cattle identification and tracking. Comput Electron Agric 123:423–435

    Article  Google Scholar 

  5. Awad AI, Zawbaa HM, Mahmoud HA, Nabi EHHA, Fayed RH, Hassanien AE (2013) A robust cattle identification scheme using muzzle print images. In: proceedings of IEEE federated conference on computer science and information systems (FedCSIS), pp 529–534

  6. Barry B, Gonzales-Barron UA, McDonnell K, Butler F, Ward S (2007) Using muzzle pattern recognition as a bio-metric approach for cattle identification. Trans ASABE 50(3):1073–1080

    Article  Google Scholar 

  7. Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (SURF). Comp Vision Image Underst 110(3):346–359

    Article  Google Scholar 

  8. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE transactions on pattern analysis & machine intelligence 7:711–720

    Article  Google Scholar 

  9. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE transactions on pattern analysis & machine intelligence 7:711–720

    Article  Google Scholar 

  10. Bello RW, Abubakar S (2019) Development of a software package for cattle identification in nigeria. J Appl Sci Environ Manag 23(10):1825–1828

    Google Scholar 

  11. Bennamoun M, Guo Y, Sohel F (1999) Feature selection for 2 d and 3 d face recognition. In: Wiley encyclopedia of electrical and electronics engineering, pp 1–28

  12. Brust CA, Burghardt T, Groenenberg M, Kading C, Kuhl HS, Manguette ML, Denzler J (2017) Towards automated visual monitoring of individual gorillas in the wild. In: Proceedings of the IEEE international conference on computer vision, pp 2820–2830

  13. Chen H, Qian C, Zheng H, Wang H (2018) A multilinear unsupervised discriminant projections method for feature extraction. Multimed Tools Appl 77(3):3857–3870

    Article  Google Scholar 

  14. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection

  15. Fabian HS, Kang DK (2019) Learning deep representation by increasing ConvNets Depth for few shot learning. International Journal of Advanced Smart Convergence 8(4):75–81

    Google Scholar 

  16. Feichtenhofer C, Pinz A, Zisserman A (2016) Convolutional two-stream network fusion for video action recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1933–1941

  17. Givens GH, Beveridge JR, Lui YM, Bolme DS, Draper BA, Phillips PJ (2013) Bio-metric face recognition: from classical statistics to future challenges. Wiley Interdisciplinary Reviews: Comput Stat 5(4):288–308

    Article  MATH  Google Scholar 

  18. Haralick RM, Shanmugam K (1973) Textural features for image classification. IEEE Transactions on systems, man, and cybernetics 6:610–621

    Article  Google Scholar 

  19. Iakovidis DK, Keramidas EG, Maroulis D (2008) Fuzzy local binary patterns for ultrasound texture characterization. In: International conference image analysis and recognition. Springer, Berlin, pp 750–759

  20. Kühl HS, Burghardt T (2013) Animal bio-metrics: quantifying and detecting phenotypic appearance. Trends in Ecology & Evolution 28,7:432–441

    Article  Google Scholar 

  21. Kumar D, Rai CS, Kumar S (2010) Analysis of unsupervised learning techniques for face recognition. Int J Imaging Syst Technol 20(3):261–267

    Article  Google Scholar 

  22. Kumar S, Singh SK (2014) Bio-metric recognition for pet animal. J Softw Eng Appl 7(05):470–482

    Article  Google Scholar 

  23. Kumar S, Singh SK (2016) Visual animal bio-metrics: survey. IET Bio-metrics 6(3):139–156

    Article  Google Scholar 

  24. Kumar S, Singh SK (2019) Cattle recognition: A new frontier in visual animal bio-metrics research. Proceedings of the National Academy of Sciences. India Section A: Physical Sciences, 1–20

  25. Kusakunniran W, Wiratsudakul A, Chuachan U, Kanchanapreechakorn S, Imaromkul T (2018) Automatic cattle identification based on fusion of texture features extracted from muzzle images. In: 2018 IEEE international conference on industrial technology (ICIT), pp 1484–1489

  26. Lahiri M, Tantipathananandh C, Warungu R, Rubenstein DI, Berger-Wolf TY (2011) Bio-metric animal databases from field photographs: identification of individual zebra in the wild. In: Proceedings of the 1st ACM international conference on multimedia retrieval, p 6

  27. Lin S, Crotty KM, Vazquez N (2010) U.S. Patent no. 7,668,376 washington. DC, U.S. Patent and Trademark Office

  28. Liu C, Yuen J, Torralba A (2010) Sift flow: Dense correspondence across scenes and its applications. IEEE transactions on pattern analysis and machine intelligence 33(5):978–994

    Article  Google Scholar 

  29. Low CY, Teoh ABJ, Ng CJ (2017) Multi-fold Gabor, PCA, and ICA filter convolution descriptor for face recognition. IEEE Trans Circuits Syst Video Technol 29(1):115–129

    Article  Google Scholar 

  30. Lu C, Yang Y (2019) On assessing binary regression models based on ungrouped data. Bio-metrics 75(1):5–12

    MathSciNet  MATH  Google Scholar 

  31. Méndez-Vázquez H, Martínez-Díaz Y, Chai Z (2013, June) Volume structured ordinal features with background similarity measure for video face recognition. In: Proceedings of international conference on bio-metrics (ICB), pp 1–6

  32. Minagawa H, Fujimura T, Ichiyanagi M, Tanaka K, Fangquan M (2002) Identification of beef cattle by analyzing images of their muzzle patterns lifted on paper. publications of the Japanese society of agricultural informatics 8:596–600

    Google Scholar 

  33. Noviyanto A, Arymurthy AM (2012) Automatic cattle identification based on muzzle photo using speed-up robust features approach. Inproceedings of the 3rd European conference of computer science. ECCS 110:114

    Google Scholar 

  34. Noviyanto A, Arymurthy AM (2013) Beef cattle identification based on muzzle pattern using a matching refinement technique in the SIFT method. Comput Electron Agric 99:77–84

    Article  Google Scholar 

  35. Nurtanio I, Areni IS, Bugiwati SR, Bustamin A, Rahmatullah M (2020) A portable cattle tagging based on muzzle pattern. international journal of interactive mobile technologies, 14(13)

  36. Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE transactions on pattern analysis & machine intelligence 7:971–987

    Article  MATH  Google Scholar 

  37. Qiao Y, Su D, Kong H, Sukkarieh S, Lomax S, Clark C (2019) Individual cattle identification using a deep learning based framework. IFAC-PapersOnLine 52(30):318–323

    Article  Google Scholar 

  38. Shao W, Kawakami R, Yoshihashi R, You S, Kawase H, Naemura T (2020) Cattle detection and counting in UAV images based on convolutional neural networks. Int J Remote Sens 41(1):31–52

    Article  Google Scholar 

  39. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: simple way to prevent neural networks from overfitting. the journal of machine learning research 15(1):1929– 1958

    MathSciNet  MATH  Google Scholar 

  40. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. the journal of machine learning research 15(1):1929– 1958

    MathSciNet  MATH  Google Scholar 

  41. Stevenson BC, Borchers DL, Fewster RM (2019) Cluster capture-recapture to account for identification uncertainty on aerial surveys of animal populations. Bio-metrics 75(1):326–336

    MathSciNet  MATH  Google Scholar 

  42. Sun J, Herazo-Maya JD, Molyneaux PL, Maher TM, Kaminski N, Zhao H (2019) Regularized Latent Class Model for Joint Analysis of High-Dimensional Longitudinal Biomarkers and a Time-to-Event Outcome. Bio-metrics 75(1):69–77

    MathSciNet  MATH  Google Scholar 

  43. Tang X, Feng G, Cai J (2014) Weighted group sparse representation for undersampled face recognition. Neurocomputing 145:402–415

    Article  Google Scholar 

  44. Tharwat A, Gaber T, Hassanien AE, Hasssan AH, Mohamed FT (2014) Cattle identification using muzzle print images based on texture features approach. In: proceedings of the fifth international conference on innovations in bio-inspired computing and applications IBICA 2014, vol 217–227. Springer, Cham

  45. Vincent P, Larochelle H, Lajoie I, Bengio Y, Manzagol PA (2010) Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. J Mach Learn Res 11(Dec):3371–3408

    MathSciNet  MATH  Google Scholar 

  46. Wolf L, Hassner T, Taigman Y (2009, September) The one-shot similarity kernel. In: Proceedings of 12th IEEE international conference on computer vision, pp 897–902

  47. Xiong C, Liu L, Zhao X, Yan S, Kim TK (2015) Convolutional fusion network for face verification in the wild. IEEE Trans Circuits Syst Video Technol 26(3):517–528

    Article  Google Scholar 

  48. Yao L, Hu Z, Liu C, Liu H, Kuang Y, Gao Y (2019, May) Cow face detection and recognition based on automatic feature extraction algorithm. In: Proceedings of the ACM turing celebration conference-china, pp 1–5

  49. Yin J, Liu Z, Jin Z, Yang W (2012) Kernel sparse representation based classification. Neurocomputing 77(1):120–128

    Article  Google Scholar 

  50. Zhang Q, Benveniste A (1992) Wavelet networks. IEEE transactions on Neural Networks 3(6):889–898

    Article  Google Scholar 

  51. Zhu Q, Yeh MC, Cheng KT, Avidan S (2006, June) Fast human detection using a cascade of histograms of oriented gradients. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition (CVPR’06), vol 2, pp 1491–1498

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, IIIT-Naya Raipur, Chhattisgarh, 493661, India

    Santosh Kumar

  2. Marine Engineering and Research Institute Kolkatta, Kolkatta, India

    Sunil Kumar

  3. Department of Electronics and Communication Engineering, Shri Mata Vaishno Devi University, Katra, India

    Mehak Shafi

  4. Department of Mathematical Science, IIIT-Naya Raipur, Chhattisgarh, 493661, India

    Mithilesh Kumar Chaube

Authors
  1. Santosh Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sunil Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mehak Shafi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mithilesh Kumar Chaube
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Santosh Kumar.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kumar, S., Kumar, S., Shafi, M. et al. A novel multimodal framework for automatic recognition of individual cattle based on hybrid features using sparse stacked denoising autoencoder and group sparse representation techniques. Multimed Tools Appl 81, 31075–31106 (2022). https://doi.org/10.1007/s11042-022-12701-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12701-w

Keywords

Search

Navigation