Abstract
This paper presents a hybrid classification method that utilizes genetic algorithms (GAs) and adaptive operations of ellipsoidal regions for multidimensional pattern classification problems with continuous features. The classification method fits a finite number of the ellipsoidal regions to data pattern by using hybrid GAs, the combination of local improvement procedures and GAs. The local improvement method adaptively expands, rotates, shrinks, and/or moves the ellipsoids while each ellipsoid is separately handled with a fitness value assigned during the GA operations. A set of significant features for the ellipsoids are automatically determined in the hybrid GA procedure by introducing “don’t care” bits to encode the chromosomes. The performance of the method is evaluated on well-known data sets and a real field classification problem originated from a deflection yoke production line. The evaluation results show that the proposed method can exert superior performance to other classification methods such as k nearest neighbor, decision trees, or neural networks.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Weiss SM, Kulikowski CA (1991) Computer systems that learn. Morgan Kaufmann, San Francisco, CA
Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Patt Anal Mach Intell 22(1):4–37
Simpson PK (1992) Fuzzy min-max neural networks-part1: classification. IEEE Trans Neur Netw 3(5):776–786
Pal SK, Bandyopadhyay S, Murthy CA (1998) Genetic algorithms for generation of class boundaries. IEEE Trans Syst, Man, Cybern-Part B: Cybernetics 28(6):816–828
Nolan JR (2002) Computer systems that learn: an empirical study of the effect of noise on the performance of three classification methods. Expert Syst with Appl 23:39–47
Abe S, Thawonmas R, Kayama M (1999) A fuzzy classifier with ellipsoidal regions for diagnosis problems. IEEE Trans Syst, Man, Cybern-Part C 29(1):140–149
Abe S, Thawonmas R (1997) A fuzzy classifier with ellipsoidal regions. IEEE Trans Fuzzy Syst 5(3):358–368
Srikanth R, George R, Warsi N, Prabhu D, Petry FE, Buckles BP (1995) A variable-length genetic algorithm for clustering and classification. Patt Recognit Lett 16:789–800
Zhu Q, Cai Y, Liu L (2001) A multiple hyper-ellipsoidal subclass model for an evolutionary classifier. Patt Recognit 34:547–560
Abe S, Lan M (1995) A method for fuzzy rules extraction directly from numerical data and its application to pattern classification. IEEE Trans Fuzzy Syst 3(1):18–28
Bandyopadhyay S, Murthy CA, Pal SK (1998) Pattern classification using genetic algorithms: determination of H. Pattern Recognit Lett 19:1171–1181
Baram Y (2000) A geometric approach to consistent classification. Pattern Recognit 33:177–184
Uebele V, Abe S, Lan M (1995) A neural-network-based fuzzy classifier. IEEE Trans Syst, Man, Cybern 25(2):353–361
Goldberg DE (1989) Genetic algorithm in search, optimization and machine learning. Addison-Wesley, New York
Kudo M, Sklansky J (2000) Comparison of algorithms that select features for pattern classifiers. Patt Recog 33:25–41
Davis L (1991) Handbook of genetic algorithms. Van Nostrand Reinhold, New York
Gen M, Cheng R (1997) Genetic algorithms and engineering design. John Wiley & Sons, New York
Houck CR, Joines JA, Kay MG, Wilson JR (1997) Empirical investigation of the benefits of partial Lamarckianism. Evol Comp 5(1):31–60
Renders J-M, Flasse S (1996) Hybrid methods using genetic algorithm. IEEE Trans Syst, Man, Cybern 26(2): 243–258
Lee KK, Yoon WC (2005) Adaptive classification with ellipsoidal regions for multidimensional pattern classification problems. Patt Recognit Lett 26:1232–1243
Eshelman LJ (1991) The CHC adaptive search algorithm: How to have safe search when engaging in nontraditional genetic recombination. In: Rawlins GJE (ed) Foundations of genetic algorithms Morgan Kaufman, San Mateo, CA, pp 265–283
Blake CL, Merz CJ (1998) UCI Repository of machine learning databases [http://www.ics.uci.edu/~mlearn/MLRepository.html]. Irvine, CA: University of California, Department of Information and Computer Science
Park M-K, Lee I, Shon K-M (1998) Using case-based reasoning for problem solving in a complex production process. Expert Syst Appl 15:69–75
Park M-K, Lee KK, Shon K-M, Yoon WC (2001) Automating the diagnosis and rectification of deflection yoke production using hybrid knowledge acquisition and case-based reasoning. Appl Intell 15:25–40
Lee KK, Yoon WC (1999) Acquisition of diagnostic strategy in a complex production process using hybrid method. In: Proceedings of 3rd International Conference on Engineering Design and Automation
Quinlan JR (1993) C4.5: Programs for machine learning. Morgan Kaufmann, San Mateo, CA
Haykin S (1994) Neural networks: a comprehensive foundation. Prentice-Hall, New Jersey
Author information
Authors and Affiliations
Corresponding author
Additional information
Ki K. Lee received the B.S. degree from Han Yang University, Seoul, Korea in 1994, and the M.S. and Ph.D. degrees in industrial engineering from Korea Advanced Institute Science and Technology (KAIST), Daejeon, Korea in 1996 and 2005, respectively. From 2001 to 2004, he was a senior research engineer in telecommunication systems laboratory of LG Electronics Inc. Since 2005, he has been an assistant professor in the School of Management at Inje University, Kimhae, Korea. His research interests include intelligent decision support systems, soft computing, and pattern recognition.
Wan C. Yoon received the B.S. degree from Seoul National University, Korea in 1977, the M.S. degree from KAIST, Korea in 1979, and the Ph.D. degree in industrial and systems engineering from Georgia Institute of Technology in 1987. He is professor of the Department of Industrial Engineering at KAIST, Korea. His research interests include application of artificial intelligence, human decision-making and aiding, information systems, and joint intelligent systems.
Dong H. Baek received the B.S. degree from Han Yang University, Seoul, Korea in 1992, and the M.S. and Ph.D. degrees in industrial engineering from Korea Advanced Institute Science and Technology (KAIST), Daejeon, Korea in 1994 and 1999, respectively. He is an assistant professor in management information systems at department of business administration, Hanyang University, Korea. His research interests include management information systems, system engineering, and machine learning.
Rights and permissions
About this article
Cite this article
Lee, K.K., Yoon, W.C. & Baek, D.H. A classification method using a hybrid genetic algorithm combined with an adaptive procedure for the pool of ellipsoids. Appl Intell 25, 293–304 (2006). https://doi.org/10.1007/s10489-006-0108-x
Issue Date:
DOI: https://doi.org/10.1007/s10489-006-0108-x