Abstract
In this paper, a novel classification rule extraction algorithm which has been recently proposed by authors is employed to determine the causes of quality defects in a fabric production facility in terms of predetermined parameters like machine type, warp type etc. The proposed rule extraction algorithm works on the trained artificial neural networks in order to discover the hidden information which is available in the form of connection weights in them. The proposed algorithm is mainly based on a swarm intelligence metaheuristic which is known as Touring Ant Colony Optimization (TACO). The algorithm has a hierarchical structure with two levels. In the first level, a multilayer perceptron type neural network is trained and its weights are extracted. After obtaining the weights, in the second level, the TACO-based algorithm is applied to extract classification rules. The main purpose of the present work is to determine and analyze the most effective parameters on the quality defects in fabric production. The parameters and their levels which give the best quality results are tried to be discovered and evaluated by making use of the proposed algorithm. It is also aimed to compare the accuracy of proposed algorithm with several other rule-based algorithms in order to present its competitiveness.
Similar content being viewed by others
References
Jothishankar MC, Wu T, Roberts J, Shiau J-Y (2004) Case study: applying data mining to defect diagnosis. J Adv Manuf Syst 3(1):69–83
Baykasoğlu A, Özbakır L (2007) MEPAR-miner: multi-expression programming for classification rule mining. Eur J Oper Res 183(2):767–784
Özbakır L, Baykasoğlu A, Kulluk S (2010) A soft computing-based approach for integrated training and rule extraction from artificial neural networks: DIFACONN-miner. Appl Soft Comput 10(1):304–317
Frawley W, Piatetsky-Shapiro G, Maktheus CW (1992) Knowledge discovery in databases: an overview. AI Magazine 213–238
Han J, Kamber M (2001) Data mining: concepts and techniques. Academic Press, New York
Wang C (2009) Separation of composite defect patterns on wafer bin map using support vector clustering. Expert Syst Appl 36(2):2554–2561
Hu X, Zhao Z, Wang S, Wang F, He D, Wu S (2008) Multi-stage extreme learning machine for fault diagnosis on hydraulic tube tester. Neural Comput Appl 17:399–403
Chien C, Wang W, Cheng J (2007) Data mining for yield enhancement in semiconductor manufacturing and an empirical study. Expert Syst Appl 33:192–198
Sun W, Chen J, Li J (2007) Decision tree and PCA-based fault diagnosis of rotating machinery. Mech Syst Signal Process 21:1300–1317
Hsu S, Chien C (2007) Hybrid data mining approach for pattern extraction from wafer bin map to improve yield in semiconductor manufacturing. Int J Prod Econ 107:88–103
Tseng B, Kwon Y, Yalcin E (2005) Feature-based rule induction in machining operation using rough set theory for quality assurance. Robot Comput Integr Manuf 21:559–567
Baykasoğlu A, Dereli T, Tanış S (2004) Prediction of cement strength using soft computing techniques. Cement Concrete Res 34:2083–2090
Baykasoğlu A, Çevik A, Özbakır L, Kulluk S (2009) Generating prediction rules for liquefaction through data mining. Expert Syst Appl 36(10):12491–12499
Harding JA, Shahbaz M, Srinivas Kusiak A (2006) Data mining in manufacturing: a review. J Manuf Sci Eng 128:969–976
Özbakır L, Baykasoğlu A, Kulluk S (2008) Rule extraction from neural networks via ant colony algorithm for data mining applications. Lect Notes Comput Sci 5313:177–191
Özbakır L, Baykasoğlu A, Kulluk S, Yapıcı H (2009) TACO-miner: an ant colony based algorithm for rule extraction from trained neural networks. Expert Syst Appl 36(10):12295–12305
Andrews R, Diederich J, Tickle AB (1995) A survey, critique of techniques for extracting rules from trained artificial neural networks. Knowl Based Syst 8(6):373–389
Hruschka ER, Ebecken NFF (2006) Extracting rules from multilayer perceptrons in classification problems: a clustering-based approach. Neurocomputing 70:384–397
Santos RT, Nievola JC, Freitas AA (2000) Extracting comprehensible rules from neural network via genetic algorithms. In: Proceedings of 2000 IEEE Symposium on Combinations of Evolutionary Computation and Neural Networks (ECNN-2000), San Antonio, TX: USA, pp 130–139
Setiono R, Thong JYL (2004) An approach to generate rules from neural networks for regression problems. Eur J Oper Res 155:239–250
Elalfi E, Haque R, Elalami ME (2004) Extracting rules from trained neural network using GA for managing E-business. Appl Soft Comput 4:65–77
Markowska-Kaczmar U, Wnuk-Lipinski P (2004) Rule extraction from neural network by genetic algorithm with pareto optimization. In: Artificial Intelligence and Soft Computing- ICAISC 2004, 7th International Conference, Proceedings, Springer, Lecture Notes in Computer Science, vol 3070, pp 450–455
Tokinaga S, Lu J, Ikeda Y (2005) Neural network rule extraction by using the genetic programming and its applications to explanatory classifications. IECE Trans Fundamentals E88-A(10):2627–2635
Malone J, McGarry K, Wermter S, Bowerman C (2005) Data mining using rule extraction from Kohonen self-organising maps. Neural Comput Appl 15:9–17
Heh JS, Chen JC, Chang M (2008) Designing a decompositional rule extraction algorithm for neural networks with bound decomposition tree. Neural Comput Appl 17:297–309
Kahramanlı H, Allahverdi N (2009) Rule extraction from trained adaptive neural networks using artificial immune systems. Expert Syst Appl 36:1513–1522
Setiono R, Baesens B, Mues C (2009) A note on knowledge discovery using neural networks and its application to credit card screening. Eur J Oper Res 192:326–332
Dorigo M, Maniezzo V, Colorni A (1991) Positive feedback as a search strategy. Technical Report N. 91-016, Politecnico di Milano
Hiroyasu T, Miki M, Ono Y, Minami Y (2000) Ant colony for continuous functions. The Science and Engineering, Doshisha University XX (Y)
Karaboğa N, Kalinli A, Karaboğa D (2004) Designing digital IIR filters using ant colony optimisation algorithm. Eng Appl Artif Intell 17:301–309
Tan C, Yu Q, Ang JH (2006) A dual-objective evolutionary algorithm for rules extraction in data mining. Comput Optim Appl 34:273–294
Parpinelli RS, Lopes HS, Freitas AA (2002) Data mining with an ant colony optimization algorithm. IEEE Trans Evol Comput 6(4):321–332
Johansson U, Löfström T, König R (2006) Why not use an oracle when you got one? Neural Information Processing—Letters and Reviews 10(8–9)
Antony J, Perry D, Wang C, Kumar M (2006) An application of Taguchi method of experimental design for new product design and development process. Assembly Automat 26(1):18–24
Quinlan R (1993) C4.5: programs for machine learning. Morgan Kaufmann Publishers, San Mateo
Frank E, Witten IH (1998) Generating accurate rule sets without global optimization. In: Shavlik J (ed) Machine learning: Proceedings of the 15th International Conference, Morgan Kaufmann Publishers, pp 144–151
Kohavi R (1995) The power of decision tables. In: Lavrac N, Wrobel S (eds) Machine learning: Proceedings of the 8th European Conference on Machine Learning (ECML 95), Lecture Notes in Artificial Intelligence, vol 914. Springer, pp 174–189
John GH, Langley (1995) Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence, Morgan Kaufmann, San Mateo, pp 338–345
Acknowledgments
Prof. Dr. Adil Baykasoğlu is grateful to Turkish Academy of Sciences (TÜBA) for supporting his scientific studies.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Özbakır, L., Baykasoğlu, A. & Kulluk, S. Rule extraction from artificial neural networks to discover causes of quality defects in fabric production. Neural Comput & Applic 20, 1117–1128 (2011). https://doi.org/10.1007/s00521-010-0434-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-010-0434-0