Abstract
The locally linear embedding (LLE) algorithm is an unsupervised technique for nonlinear dimensionality reduction which can represent the underlying manifold as well as possible. While in classification, data label information is available and our main purpose changes to represent class separability as well as possible. To the end of classification, we propose a new supervised variant of LLE, called orthogonal centroid locally linear embedding (OCLLE) algorithm in this paper. It uses class membership information to map overlapping high-dimensional data into disjoint clusters in the embedded space. Experiments show that very promising results are yielded by this variant.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs.Fisherfaces: Recognition using Class Specific Linear Projection. IEEE Trans. Pattern Anal. Mach. Intell. 19, 711–720 (1997)
Park, H., Jeon, M., Rosen, J.B.: Lower Dimensional Representation of Text Data Based on Centroids and Least Squares. BIT Numerical Math. 43, 427–448 (2003)
Okun, O., Kouropteva, O., Pietikainen, M.: Supervised Locally Linear Embedding Algorithm. In: Tenth Finnish Artificial Intelligence Conference, pp. 50–61 (2002)
de Ridder, D., Duin, R.P.W.: Locally Linear Embedding for Classification. Technical Report PH-2002-01, Pattern Recognition Group, Department of Imaging Science and Technology, Delft University of Technology, Delft, The Netherlands (2002)
Liang, D., Yang, J., Zheng, Z.L., Chang, Y.C.: A Facial Expression Recognition System based on Supervised Locally Linear Embedding. Pattern Recogn. Lett. 26, 2374–2389 (2005)
Wang, M., Yang, J., Xu, Z.J., Chou, K.C.: SLLE for Predicting Membrane Protein Types. J. Theor. Biol. 232, 7–15 (2005)
Roweis, S.T., Saul, L.K.: Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science 290(5500), 2323–2326 (2000)
Saul, L.K., Roweis, S.T.: Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifolds. J. Mach. Learning Res. 4, 119–155 (2003)
de Ridder, D., Kouropteva, O., Okun, O., Pietikainen, M., Duin, R.: Supervised Locally Linear Embedding. In: Thirteenth International Conference on Artificial Neural Networks, pp. 333–341 (2003)
Hettich, S., Blake, C., Merz, C.: UCI repository of machine learning databases. University of California, Irvine, Dept. of Information and Computer Sciences (1998), http://www.ics.uci.edu/_mlearn/MLRepository.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, Y., Hu, Y., Wu, Y. (2009). Orthogonal Centroid Locally Linear Embedding for Classification. In: Huang, R., Yang, Q., Pei, J., Gama, J., Meng, X., Li, X. (eds) Advanced Data Mining and Applications. ADMA 2009. Lecture Notes in Computer Science(), vol 5678. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03348-3_76
Download citation
DOI: https://doi.org/10.1007/978-3-642-03348-3_76
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-03347-6
Online ISBN: 978-3-642-03348-3
eBook Packages: Computer ScienceComputer Science (R0)