Abstract
Classical multidimensional scaling (CMDS) is a widely used method for dimensionality reduction and data visualization, but it’s very slow. Landmark MDS (LMDS) is a fast algorithm of CMDS. In LMDS, some data points are designated as landmark points. When the intrinsic dimension of the landmark points is less than the intrinsic dimension of the data set, the embedding recovered by LMDS is not consistent with that of classical multidimensional scaling. A selection algorithm of landmark points is put forward in this paper to ensure the intrinsic dimension of the landmarks to be equal to that of the data set, so as to ensure that the embedding recovered by LMDS is the same as that of CMDS. By introducing the selection algorithm into the original LMDS, an improved LMDS algorithm called iLMDS is presented in this paper. The experimental results verify the consistency of iLMDS and CMDS.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Trevor, F.C., Michael, A.A.C.: Multidimensional Scaling. Chapman & Hall/CRC, London (2001)
Ingram, S., Munzner, T.: Dimensionality reduction for documents with nearest neighbor queries. Neurocomputing 150, 557–569 (2015)
Mjolsness, E., DeCoste, D.: Machine learning for science: state of the art and future prospects. Science 293(5537), 2051–2055 (2001)
Patel, A.P., Tirosh, I., Trombetta, J.J., et al.: Single-cell RNA-seq highlights intratumoral heterogeneity in primary glioblastoma. Science 344(6190), 1396–1401 (2014)
Wang, S., Zhuo, Z., Yang, H., et al.: An approach to facial expression recognition integrating radial basis function kernel and multidimensional scaling analysis. Soft. Comput. 18(7), 1363–1371 (2014)
Vogelstein, J.T., Park, Y., Ohyama, T., et al.: Discovery of brainwide neural-behavioral maps via multiscale unsupervised structure learning. Science 344(6182), 386–392 (2014)
Arkin, A., Shen, P., Ross, J.: A test case of correlation metric construction of a reaction pathway from measurements. Science 277(5330), 1275–1279 (1997)
Li, S.S.-M., Wang, C.C.L., Kin, C.H.: Bending-Invariant correspondence matching on 3-D human bodies for feature point extraction. IEEE Trans. Autom. Sci. Eng. 8(4), 805–814 (2011)
Chalmers, M.: A linear iteration time layout algorithm for visualizing high dimensional data. In: Proceedings of IEEE Visualization 1996, pp. 127–132. IEEE Press, New York (1996)
Morrison, A., Ross, G., Chalmers, M.: Fast multidimensional scaling through sampling, springs and interpolation. Inf. Visual. 2(1), 68–77 (2003)
Williams, M., Munzner, T.: Steerable, progressive multidimensional scaling. In: IEEE Symposium on Information Visualization 2004, pp. 57–64. IEEE Press, Austin (2004)
Faloutsos, C., Lin, K.: FastMap: a fast algorithm for indexing, data-mining, and visualization. In: Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data, pp. 163—174. ACM Press, Washington (1995)
Silva, V.D., Tenenbaum, J.B.: Sparse multidimensional scaling using landmark points. Technical report, Stanford University, Palo Alto (2004)
Silva, V.D., Tenenbaum, J.B.: Global versus local methods in nonlinear dimensionality reduction. In: NIPS 2002, pp. 705–712. MIT Press, Cambridge, Massachusettes (2003)
Platt, J.C.: Fast embedding of sparse music similarity graphs. In: NIPS 2003, pp. 571–578. MIT Press, Cambridge, Massachusettes (2004)
Brandes, U., Pich, C.: An experimental study on distance-based graph drawing. In: Tollis, I.G., Patrignani, M. (eds.) GD 2008. LNCS, vol. 5417, pp. 218–229. Springer, Heidelberg (2009)
Silva, J., Marques, J., Lemos, J.: Selecting landmark points for sparse manifold learning. In: NIPS 2005, pp. 1241–1248. MIT Press, Cambridge, Massachusettes (2006)
Gu, R.J., Xu, W.B.: An improved manifold learning algorithm for data visualization. In: IEEE International Conference on Machine Learning and Cybernetics 2006, pp. 1170–1173. IEEE Press, Piscataway, N.J. (2006)
Li, J., Hao, P.: Finding representative landmarks of data on manifolds. Pattern Recogn. 42(11), 2335–2352 (2009)
Young, G., Householder, A.S.: Discussion of a set of points in terms of their mutual distances. Psychometrika 3(1), 19–22 (1938)
Data for MATLAB hackers. http://www.cs.toronto.edu/~roweis/data.html
UCI Machine Learning Repository. http://archive.ics.uci.edu/ml/datasets.html
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Qu, T., Cai, Z. (2016). An Improved LMDS Algorithm. In: Tan, Y., Shi, Y., Li, L. (eds) Advances in Swarm Intelligence. ICSI 2016. Lecture Notes in Computer Science(), vol 9713. Springer, Cham. https://doi.org/10.1007/978-3-319-41009-8_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-41009-8_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41008-1
Online ISBN: 978-3-319-41009-8
eBook Packages: Computer ScienceComputer Science (R0)