Abstract
Much of the research on extracting rules from a large amount of data has focused on the extraction of a general rule that covers as many data as possible. In the field of health care, where people’s lives are at stake, it is necessary to diagnose appropriately without overlooking the small number of patients who show different symptoms. Thus, the exceptional rules for rare cases are also important. From such a viewpoint, multiple rules, each of which covers a part of the data, are needed for covering all data. In this paper, we describe the extraction of such multiple rules, each of which is expressed by a tree structural program. We consider a multi-agent approach to be effective for this purpose. Each agent has a rule that covers a part of the data set, and multiple rules which cover all data are extracted by multi-agent cooperation. In order to realize this approach, we propose a new method for rule extraction using Automatically Defined Groups (ADG). The ADG, which is based on Genetic Programming, is an evolutionary optimization method of multi-agent systems. By using this method, we can acquire both the number of necessary rules and the tree structural programs which represent these respective rules. We applied this method to a database used in the machine learning field and showed its effectiveness. Moreover, we applied this method to medical data and developed a diagnostic system for coronary heart diseases
Similar content being viewed by others
References
D.E. Goldberg (1989) Genetic Algorithms in search, optimization, and machine learning Addison Wesley Reading, MA
Hara, A. and Nagao, T. (1999) Emergence of cooperative behavior using ADG; Automatically Defined Groups. Proceedings of the Genetic and Evolutionary Computation Conference 1999, pp. 1039-1046.
A. Hara T. Nagao (2002) ArticleTitleConstruction and analysis of stock market model using ADG; automatically defined groups International Journal of Computational Intelligence and Applications (IJCIA) 2 IssueID4 433–446 Occurrence Handle10.1142/S1469026802000749
A. Hara T. Ichimura T. Takahama Y. Isomichi (2003) ArticleTitleExtraction of rules by heterogeneous agents using automatically defined groups Proceedings of the Seventh conference on Knowledge-Based Intelligent Information and Engineering Systems (KES’2003) 2 1405–1411
Hara A., Ichimura T., Takahama T., Isomichi Y. (2004). Discovery of cluster structure and the clustering rules from medical database using ADG; automatically defined groups. In: Ichimura T., Yoshida K. (eds). Knowledge-Based Intelligent Systems for Healthcare. pp. 51-86
Haynes, T., Wainwright, R., Sen, S. and Schoenefeld, D. (1995) Strongly typed genetic programming in evolving cooperation strategies. Genetic Algorithms: Proceedings of the Sixth International Conference (ICGA95), pp. 271–278.
Holland, J. H. (1995). Adaptation in Natural and Artificial Systems, The Univ. Michigan Press.
Iba, H. (1996) Emergent cooperation for multiple agents using genetic programming. Parallel Problem Solving from Nature IV, Proceedings of the International Conference on Evolutionary Computation, pp. 32–41.
Iba, H. (1997) Multiple-agent learning for a robot navigation task by genetic programming. Genetic Programming 1997: Proceedings oe Second Annual Conference, pp. 195–200.
T. Ichimura E. Tazaki K. Yoshida (1995) ArticleTitleExtraction of fuzzy rules using neural networks with structure level adaptation – verification to the diagnosis of hepatobiliary disorders International Journal of Bio-Medical Computing 40 IssueID(2 139–146 Occurrence Handle10.1016/0020-7101(95)01138-5 Occurrence Handle8847122
T. Ichimura S. Oeda J. Mackin K. T. Yamashita K. Yoshida (2001) ArticleTitleDarwinian inheritance genetic learning method of neural networks under dynamic environment and its application to diagnostic system for hepatobiliary disorders Journal of the Biomedical Fuzzy Systems and Human Sciences 7 19–26
T. Ichimura S. Oeda M. Suka K. Yoshida (2003a) ArticleTitleA classification capability of reflective neural networks in medical databases Proceedings of the Seventh Conference on Knowledge-Based Intelligent Information and Engineering Systems (KES’2003) 2 373–379
T. Ichimura S. Oeda T. Yamashita K. Yoshida (2003b) ArticleTitleA classification method of medical database by immune multi-agent neural networks with planar lattice architecture Proceeding of the Seventh conference on Knowledge-Based Intelligent Information and Engineering Systems (KES’2003) 2 380–387
JR. Koza (1992) Genetic Programming – On the Programming of Computers by Means of Natural Selection The MIT Press Cambridge
Luke, S. and Spector, L. (1996) Evolving teamwork and coordination with genetic programming. Genetic Programming 1996: Proceedings of the First Annual Conference, pp. 150–156.
Soule, T. (1999) Voting Teams: A cooperative approach to non-typical problems using genetic programming. Proceedings of the Genetic and Evolutionary Computation Conference 1999, pp. 916–922
Soule, T. (2000) Heterogeneity and specialization in evolving teams. Proceedings of the Genetic and Evolutionary Computation Conference 2000, pp. 778–785.
Suka, M., Ichimura, T. and Yoshida, K. (2004) Development of Coronary Heart Disease Database. Proceedings of the Eighth Conference of Knowledge-Based Intelligent Information and Engineering Systems (KES’ 2004), 2004.
Thrun, S. B. et al. (1991) The MONK’s problems: a performance comparison of different learning algorithms. Technical Report CMU-CS-91-197, Carnegie Mellon University.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hara, A., Ichimura, T. & Yoshida, K. Discovering Multiple Diagnostic Rules from Coronary Heart Disease Database using Automatically Defined Groups. J Intell Manuf 16, 645–661 (2005). https://doi.org/10.1007/s10845-005-4368-9
Issue Date:
DOI: https://doi.org/10.1007/s10845-005-4368-9