Skip to main content
Log in

An auto tuned noise resistant descriptor for dynamic texture recognition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper presents a scheme for the representation and recognition of the dynamic texture in the noisy environment. Dynamic texture is the sequence of images of a moving scene that shows some form of temporal regularity. Though, the dynamic texture is the spatiotemporal extension of the conventional texture, its analysis requires additional attention, since the motion causes continuous changes in the geometry of these textures. Hence, to recognize the noisy dynamic texture, the noise should be estimated not only at the spatial level; it must also be estimated at the temporal level. To this end, an auto tuned noise resistance descriptor, based on the Local Binary Pattern approach, is proposed for the modeling and classification of the dynamic texture. Our approach based on the fact that, uniform local binary patterns are the fundamental units of image texture and occur more frequently in an image in comparison to non-uniform patterns. Noise affects these uniform local binary patterns and more likely fall into non-uniform codes. To counter this, we have extended conventional local binary pattern descriptor from a 2-value code to a 3-value code to include an additional state (called indecisive state) to represent the noise affected pixels. However, the estimation of the indecisive state is of the primary concern of this letter due to the inherently varying nature of the dynamic texture. The proposed technique devised a new scheme to estimate the noisy pixels in a dynamic texture. Eventually, the indecisive state is corrected back to non-noisy natural states using a mapping function so as to form a uniform LBP code. Experimental results on the UCLA and Dyntex++ databases demonstrate high classification efficiency of the proposed approach in the noisy environment.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Ahonen T, Pietikäinen M (2007) Soft histograms for local binary patterns. In: Proc. Finnish Signal Process. Symposium

  2. Chan AB, Vasconcelos N (2005) Probabilistic kernels for the classification of auto-regressive visual processes. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 846–851

  3. Chen J, Kellokumpu V, Zhao G, Pietikäinen M (2013) RLBP: Robust local binary pattern. In: Proc. of British Machine Vision Conference (BMVC 2013)

  4. Chetverikov D, Péteri R (2005) A brief survey of dynamic texture description and recognition. 4th Int. Conf. on Computer Recognition Systems, pp. 17–26

  5. Dorado G, Chiuso A, Soatto S, Wu YN (2003) Dynamic textures. Int J Comput Vis 51(2):91–109

    Article  MATH  Google Scholar 

  6. Fathi A, Nilchi A (2012) Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recogn Lett 3(9):1093–1100

    Article  Google Scholar 

  7. Ghanem B, Ahuja N (2010) Maximum margin distance learning for dynamic texture recognition. European Conference on Computer Vision, pp. 223–236

  8. Hossain S, Serikawa S (2013) Texture databases – a comprehensive survey. Pattern Recogn Lett 34:2007–2022

    Article  Google Scholar 

  9. Liu L, Zhao L, Long Y, Kuang G, Fieguth PW (2012) Extended local binary patterns for texture classification. Image Vis Comput 30(2):86–99

    Article  Google Scholar 

  10. Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59

    Article  Google Scholar 

  11. Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  MATH  Google Scholar 

  12. Péteri R, Fazekas S, Huiskes MJ (2010) DynTex: a comprehensive database of dynamic textures. Pattern Recogn Lett 31(12):1627–1632

    Article  Google Scholar 

  13. Ravichandran A, Chaudhry R, Vidal R (2009) View-invariant dynamic texture recognition using a bag of dynamical systems. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1651–1657

  14. Ren J, Jiang X, Yuan J (2013) Noise-resistant local binary pattern with an embedded error-correction mechanism. IEEE Trans Image Process 22(10):4049–4060

    Article  MathSciNet  Google Scholar 

  15. Ren J, Jiang XD, Yuan J (2013) Dynamic texture recognition using enhanced LBP features. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), pp. 2400–2404

  16. Ren J, Jiang XD, Yuan J (2015) Learning LBP structure by maximizing the conditional mutual information. Pattern Recogn 48(10):3180–3190

    Article  Google Scholar 

  17. Saisan P, Doretto G, Wu Y, Soatto S (2001) Dynamic texture recognition. IEEE Conf CVPR 2:58–63

    Google Scholar 

  18. Tiwari D, Tyagi V (2016) Improved Weber’s law based local binary pattern for dynamic texture recognition. Multimed Tools Appl. doi:10.1007/s11042-016-3362-x

    Google Scholar 

  19. Tiwari D, Tyagi V (2016) Dynamic texture recognition based on completed volume local binary pattern. Multidim Syst Sign Process 27(2):563–575

    Article  Google Scholar 

  20. Tiwari D, Tyagi V (2016) Dynamic texture recognition: a review. Adv Intell Syst Comput 434:365–373

    Google Scholar 

  21. Zhao G, Ahonen T, Matas J, Pietikäinen M (2012) Rotation-invariant image and video description with local binary pattern features. IEEE Trans Image Process 21(4):1465–1467

    Article  MathSciNet  Google Scholar 

  22. Zhao G, Pietikäinen M (2007) Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans Pattern Anal Mach Intell 29(6):915–928

    Article  Google Scholar 

  23. Zhao G, Pietikäinen M (2007) Dynamic texture recognition using volume local binary patterns. In: Proc. of Workshop on Dynamical Vision, WDV 2005/2006, LNCS 4358, pp. 165–177

  24. Zhao G, Pietikäinen M (2009) Improving rotation invariance of the volume local binary pattern operator. In: Proceeding of IAPR Conference on Machine Vision Applications, pp. 327–330

  25. Zhu S, Wu Y, Mumford D (1997) Minimax entropy principle and its application to texture modeling. Neural Comput 9(8):1627–1660

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vipin Tyagi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tiwari, D., Tyagi, V. An auto tuned noise resistant descriptor for dynamic texture recognition. Multimed Tools Appl 76, 21225–21246 (2017). https://doi.org/10.1007/s11042-016-4066-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-4066-y

Keywords

Navigation