Abstract
This paper presents a scheme for the representation and recognition of the dynamic texture in the noisy environment. Dynamic texture is the sequence of images of a moving scene that shows some form of temporal regularity. Though, the dynamic texture is the spatiotemporal extension of the conventional texture, its analysis requires additional attention, since the motion causes continuous changes in the geometry of these textures. Hence, to recognize the noisy dynamic texture, the noise should be estimated not only at the spatial level; it must also be estimated at the temporal level. To this end, an auto tuned noise resistance descriptor, based on the Local Binary Pattern approach, is proposed for the modeling and classification of the dynamic texture. Our approach based on the fact that, uniform local binary patterns are the fundamental units of image texture and occur more frequently in an image in comparison to non-uniform patterns. Noise affects these uniform local binary patterns and more likely fall into non-uniform codes. To counter this, we have extended conventional local binary pattern descriptor from a 2-value code to a 3-value code to include an additional state (called indecisive state) to represent the noise affected pixels. However, the estimation of the indecisive state is of the primary concern of this letter due to the inherently varying nature of the dynamic texture. The proposed technique devised a new scheme to estimate the noisy pixels in a dynamic texture. Eventually, the indecisive state is corrected back to non-noisy natural states using a mapping function so as to form a uniform LBP code. Experimental results on the UCLA and Dyntex++ databases demonstrate high classification efficiency of the proposed approach in the noisy environment.
Similar content being viewed by others
References
Ahonen T, Pietikäinen M (2007) Soft histograms for local binary patterns. In: Proc. Finnish Signal Process. Symposium
Chan AB, Vasconcelos N (2005) Probabilistic kernels for the classification of auto-regressive visual processes. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 846–851
Chen J, Kellokumpu V, Zhao G, Pietikäinen M (2013) RLBP: Robust local binary pattern. In: Proc. of British Machine Vision Conference (BMVC 2013)
Chetverikov D, Péteri R (2005) A brief survey of dynamic texture description and recognition. 4th Int. Conf. on Computer Recognition Systems, pp. 17–26
Dorado G, Chiuso A, Soatto S, Wu YN (2003) Dynamic textures. Int J Comput Vis 51(2):91–109
Fathi A, Nilchi A (2012) Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recogn Lett 3(9):1093–1100
Ghanem B, Ahuja N (2010) Maximum margin distance learning for dynamic texture recognition. European Conference on Computer Vision, pp. 223–236
Hossain S, Serikawa S (2013) Texture databases – a comprehensive survey. Pattern Recogn Lett 34:2007–2022
Liu L, Zhao L, Long Y, Kuang G, Fieguth PW (2012) Extended local binary patterns for texture classification. Image Vis Comput 30(2):86–99
Ojala T, Pietikäinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Pattern Recogn 29(1):51–59
Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987
Péteri R, Fazekas S, Huiskes MJ (2010) DynTex: a comprehensive database of dynamic textures. Pattern Recogn Lett 31(12):1627–1632
Ravichandran A, Chaudhry R, Vidal R (2009) View-invariant dynamic texture recognition using a bag of dynamical systems. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1651–1657
Ren J, Jiang X, Yuan J (2013) Noise-resistant local binary pattern with an embedded error-correction mechanism. IEEE Trans Image Process 22(10):4049–4060
Ren J, Jiang XD, Yuan J (2013) Dynamic texture recognition using enhanced LBP features. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), pp. 2400–2404
Ren J, Jiang XD, Yuan J (2015) Learning LBP structure by maximizing the conditional mutual information. Pattern Recogn 48(10):3180–3190
Saisan P, Doretto G, Wu Y, Soatto S (2001) Dynamic texture recognition. IEEE Conf CVPR 2:58–63
Tiwari D, Tyagi V (2016) Improved Weber’s law based local binary pattern for dynamic texture recognition. Multimed Tools Appl. doi:10.1007/s11042-016-3362-x
Tiwari D, Tyagi V (2016) Dynamic texture recognition based on completed volume local binary pattern. Multidim Syst Sign Process 27(2):563–575
Tiwari D, Tyagi V (2016) Dynamic texture recognition: a review. Adv Intell Syst Comput 434:365–373
Zhao G, Ahonen T, Matas J, Pietikäinen M (2012) Rotation-invariant image and video description with local binary pattern features. IEEE Trans Image Process 21(4):1465–1467
Zhao G, Pietikäinen M (2007) Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans Pattern Anal Mach Intell 29(6):915–928
Zhao G, Pietikäinen M (2007) Dynamic texture recognition using volume local binary patterns. In: Proc. of Workshop on Dynamical Vision, WDV 2005/2006, LNCS 4358, pp. 165–177
Zhao G, Pietikäinen M (2009) Improving rotation invariance of the volume local binary pattern operator. In: Proceeding of IAPR Conference on Machine Vision Applications, pp. 327–330
Zhu S, Wu Y, Mumford D (1997) Minimax entropy principle and its application to texture modeling. Neural Comput 9(8):1627–1660
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Tiwari, D., Tyagi, V. An auto tuned noise resistant descriptor for dynamic texture recognition. Multimed Tools Appl 76, 21225–21246 (2017). https://doi.org/10.1007/s11042-016-4066-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-4066-y