Abstract
Dimensionality reduction techniques based on manifold learning are becoming very popular for computer vision tasks like image recognition and image classification. Generally, most of these techniques involve optimizing a cost function in L2-norm and thus they are susceptible to outliers. However, recently, due to capability of handling outliers, L1-norm optimization is drawing the attention of researchers. The work documented here is the first attempt towards the same goal where orthogonal neighbourhood preserving projection (ONPP) technique is performed using optimization in terms of L1-norm to handle data having outliers. In particular, the relationship between ONPP and PCA is established theoretically in the light of L2-norm and then ONPP is optimized using an already proposed mechanism of PCA-L1. Extensive experiments are performed on synthetic as well as real data for applications like classification and recognition. It has been observed that when larger number of training data is available L1-ONPP outperforms its counterpart L2-ONPP.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Baccini A, Besse P, De Falguerolles A (1996) A L1-norm PCA and a heuristic approach. Ordinal Symb Data Anal 1:359–368
Bhattacharya U, Chaudhuri B (2005) Databases for research on recognition of handwritten characters of indian scripts. In: Proceedings eighth international conference on document analysis and recognition, 2005. IEEE, pp 789–793
Ding C, Zhou D, He X, Zha H (2006) R1-PCA: rotational invariant l 1-norm principal component analysis for robust subspace factorization. In: Proceedings of the 23rd international conference on machine learning, pp 281–288
Dua D, Karra Taniskidou E (2017) UCI machine learning repository. University of California, School of Information and Computer Science, Irvine, CA. http://archive.ics.uci.edu/ml. Accessed 03 Aug 2018
Goswami MM, Mitra SK (2015) Offline handwritten gujarati numeral recognition using low-level strokes. Int J Appl Pattern Recognit 2(4):353–379
He X, Niyogi P (2004) Locality preserving projections. Adv Neural Inf Process Syst 16:153–160
He X, Cai D, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Tenth IEEE international conference on computer vision, ICCV 2005, vol 2. IEEE, pp 1208–1213
Ke Q, Kanade T (2005a) Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 739–746
Ke Q, Kanade T (2005b) Robust L1 norm factorization in the presence of outliers and missing data by alternative convex programming. In: IEEE computer society conference on computer vision and pattern recognition, 2005. CVPR 2005, vol 1. IEEE, pp 739–746
Kokiopoulou E, Saad Y (2007) Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans Pattern Anal Mach Intell 29(12):2143–2156
Koringa P, Shikkenawis G, Mitra SK, Parulkar S (2015) Modified orthogonal neighborhood preserving projection for face recognition. In: Kryszkiewicz M, Bandyopadhyay S, Rybinski H, Pal SK (eds) Pattern recognition and machine intelligence. Springer, Berlin, pp 225–235
Kwak N (2008) Principal component analysis based on L1-norm maximization. IEEE Trans Pattern Anal Mach Intell 30(9):1672–1680
Lecun Y, Cortes C (2009) The MNIST database of handwritten digits. http://yann.lecun.com/exdb/mnist/. Accessed 03 Aug 2018
Li M, Yuan B (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recognit Lett 26(5):527–532
Li X, Pang Y, Yuan Y (2010a) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern Part B (Cybern) 40(4):1170–1175
Li X, Pang Y, Yuan Y (2010b) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern Part B (Cybern) 40(4):1170–1175
Lu J, Plataniotis KN, Venetsanopoulos AN (2003) Face recognition using LDA-based algorithms. IEEE Trans Neural Netw 14(1):195–200
Nagar R, Mitra SK (2015) Feature extraction based on stroke orientation estimation technique for handwritten numeral. In: 2015 eighth international conference on advances in pattern recognition (ICAPR), pp 1–6
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326
Shikkenawis G, Mitra SK (2012) Improving the locality preserving projection for dimensionality reduction. In: Third international conference on emerging applications of information technology (EAIT), 2012. IEEE, pp 161–164
Turk M, Pentland A (1991) Eigenfaces for recognition. J Cognit Neurosci 3(1):71–86
Wang H, Lu X, Hu Z, Zheng W (2014) Fisher discriminant analysis with L1-norm. IEEE Trans Cybern 44(6):828–842. https://doi.org/10.1109/TCYB.2013.2273355
Zhang D, Zhou ZH (2005) (2D) 2PCA: two-directional two-dimensional pca for efficient face representation and recognition. Neurocomputing 69(1):224–231
Zhang H, Wu QJ, Chow TW, Zhao M (2012) A two-dimensional neighborhood preserving projection for appearance-based face recognition. Pattern Recognit 45(5):1866–1876
Zhong F, Zhang J (2013) Linear discriminant analysis based on L1-norm maximization. IEEE Trans Image Process 22(8):3018–3027
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Koringa, P.A., Mitra, S.K. L1-norm orthogonal neighbourhood preserving projection and its applications. Pattern Anal Applic 22, 1481–1492 (2019). https://doi.org/10.1007/s10044-018-0745-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-018-0745-9