Abstract
Usual visualization techniques for multidimensional data sets, such as parallel coordinates and scatter-plot matrices, do not scale well to high numbers of dimensions. A common approach to solve this problem is dimensionality selection. Existing dimensionality selection techniques usually select pertinent dimension subsets that are significant to the user without loose of information. We present concrete cooperation between automatic algorithms, interactive algorithms and visualization tools: the evolutionary algorithm is used to obtain optimal dimension subsets which represent the original data set without loosing information for unsupervised mode (clustering or outlier detection). The last effective cooperation is a visualization tool used to present the user interactive evolutionary algorithm results and let him actively participate in evolutionary algorithm searching with more efficiency resulting in a faster evolutionary algorithm convergence. We have implemented our approach and applied it to real data set to confirm this approach is effective for supporting the user in the exploration of high dimensional data sets.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Aggarwal, C.: Towards effective and interpretable data mining by visual interaction. SIGKDD Eplorations 3(2), 11–22, Accessed from www.acm.org/sigkdd/explorations/
Boudjeloud, L., Poulet, F.: A Genetic Approach for Outlier Detection in High-Dimensional Data-Sets. In: Le Thi, H., Pham, D.T. (eds.) Modeling, Computation and Optimization in Information Systems and Management Sciences, pp. 543–550. Hermes Sciences Publishing (2004)
Boudjeloud, L., Poulet, F.: Attributes selection for high dimensional data clustering. To appear in Proc. of International Symposium on Applied Stochastic Models and Data Analysis, ASMDA 2005, Brest, France (May 2005)
Carr, D.B., Littlefield, R.J., Nicholson, W.L.: Scatter-plot matrix techniques for large N. Journal of the American Statistical Association 82(398), 424–436 (Littlefield)
Hartigan, J.A., Wong, M.A.: A K-means clustering algorithm: Algorithm AS 136. Applied Statistics 28, 126–130 (1979)
Holland, J.: Adaptation in Natural and Artificial Systems. University of Michigan Press, Ann Arbor (1975)
Inselberg, A.: The Plane with Parallel Coordinates. Special Issue on computational Geometry 1, 69–97 (1985)
Jinyan, L., Huiqing, L.: Kent ridge bio-medical data set repository (2002) (accessed December 2004), http://sdmc.-lit.org.sg/GEDatasets
Kim, Y., Nick Street, W., Menczer, F.: Evolutionary Model Selection in Unsupervised Learning. Intelligent data analysis 6, 531–556 (2002)
Liu, H., Motoda, H.: Feature detection for knowledge discovery and data mining. Kluwer Academic Publishers, Dordrecht (1998)
Michalewicz, Z.: Genetic Algorithms + Data Structures = Evolution Programs, 3rd edn. Springer, New York (1996)
Milligan, G., Cooper, M.: An examination of procedures for determining the number of classes in a data set. Psychometrika 52(2), 159–179 (1985)
Poulet, F.: Visualisation in data mining and knowledge discovery. In: Lenca, P. (ed.) Proc. HCP 1999, 10th Mini Euro Conference “Human Centred Processes”, pp. 183–192 (1999)
Takagi, H.: Interactive Evolutionary Computation: Fusion of the Capacities of EC Optimization and Human Evaluation. Proceedings of the IEEE 89(9), 1275–1296 (2001)
Wong, P.: Visual data mining. IEEE Computer Graphics and Application 19(5), 20–21 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Boudjeloud, L., Poulet, F. (2005). Visual Interactive Evolutionary Algorithm for High Dimensional Data Clustering and Outlier Detection. In: Ho, T.B., Cheung, D., Liu, H. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2005. Lecture Notes in Computer Science(), vol 3518. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11430919_50
Download citation
DOI: https://doi.org/10.1007/11430919_50
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26076-9
Online ISBN: 978-3-540-31935-1
eBook Packages: Computer ScienceComputer Science (R0)