Abstract
In real applications, data provided to a learning system usually contain linguistic information which greatly influences concept descriptions derived by conventional inductive learning methods. Design of learning methods for working with vague data is thus very important. In this paper, we apply fuzzy set concepts to machine learning to solve this problem. A fuzzy learning algorithm based on the AQR learning strategy is proposed to manage linguistic information. The proposed learning algorithm generates fuzzy linguistic rules from “soft” instances. Experiments on the Sports and the Iris Flower classification problems are presented to compare the accuracy of the proposed algorithm with those of some other learning algorithms. Experimental results show that the rules derived from our approach are simpler and yield higher accuracy than those from some other learning algorithms.
Similar content being viewed by others
References
Y. Kodratoff and R.S. Michalski, Machine Learning: An Artificial Intelligence Approach, vol. 3, Toiga: Palo Alto, CA, 1990.
R.S. Michalski, J.G. Carbonell, and T.M. Mitchell, Machine Learning: An Artificial Intelligence Approach, vol. 1, Toiga: Palo Alto, CA, 1983.
R.S. Michalski, J.G. Carbonell, and T.M. Mitchell, Machine Learning: An Artificial Intelligence Approach, vol. 2, Toiga: Palo Alto, CA, 1984.
R.S. Michalski and G. Tecuci, Machine Learning: A Multistrategy Approach, vol. 4, Morgan Kaufmann Publishers: San Francisco, CA, 1994.
R.S. Michalski, I. Bratka, and M. Kubat, Machine Learning and Data Mining: Methods and Applications, Wiley: Chichester, England, 1998.
J. Cendrowska, “PRISM: An algorithm for inducing modular rules,” Int. J. of Man-Machine Studies, vol. 27, pp. 349–370, 1987.
J.R. Quinlan, “Induction of decision trees,” Machine Learning, vol. 1, pp. 81–106, 1986.
J.R. Quinlan, “C4.5: Programs for machine learning,” 1993.
P. Clark and T. Niblett, “The CN2 induction algorithm,” Machine Learning, vol. 3, pp. 261–283, 1989.
R.S. Michalski, “On the quasi-minimal solution of the general covering problem,” in Proceedings of the Fifth International Symposium on Information Processing, 1969, pp. 25–128.
A. Giordana and L. Saitta, “Machine learning,” in Handbook of Fuzzy Computation, edited by E. Ruspini, P. Bonissone, and W. Pedrycz, IOP Publishing Ltd., 1998.
T. Sudkamp and R.J. Hammell, “Interpolation, completion, and learning fuzzy rules,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 24, no.2, pp. 332–342, 1994.
Y. Kodratoff and M. Manago, “Generalization and noise,” Int. J. of Man-Machine Studies, vol. 27, pp. 181–204, 1987.
A.F. Blishun, “Fuzzy Learning models in expert systems,” Fuzzy Sets and Systems, vol. 22, pp. 57–70, 1987.
M. Botta, A. Giordana and L. Saitta, “Learning in uncertain environments,” An Introduction to Fuzzy Logic Applications in Intelligent Systems, pp. 281–296, 1992.
L.M. de Campos and S. Moral, “Learning rules for a fuzzy inference model,” Fuzzy Sets and Systems, vol. 59, pp. 247–257, 1993.
M. Delgado and A. Gonzalez, “An inductive learning procedure to identify fuzzy systems,” Fuzzy Sets and Systems, vol. 55, pp. 121–132, 1993.
A. Gonzalez, “A learning methodology in uncertain and imprecise environments,” Int. J. of Intelligent Systems, vol. 10, pp. 357–371, 1995.
R.L.P. Chang and T. Pavliddis, “Fuzzy decision tree algorithms,” IEEE Transactions on Systems, Man, and Cybernetics, vol. 7, pp. 28–35, 1977.
J. Rives, “FID3: Fuzzy induction decision tree,” The First International Symposium on Uncertainty Modeling and Analysis, 1990, pp. 457–462.
Y. Yuan and M.J. Shaw, “Induction of fuzzy decision trees,” Fuzzy Sets and Systems, vol. 69, pp. 125–139, 1995.
T.M. Mitchell, “Generalization as search,” Artificial Intelligence, vol. 18, pp. 203–226, 1982.
C.H. Wang, T.P. Hong, and S.S. Tseng, “Inductive learning from fuzzy examples,” The Fifteenth IEEE International Conference on Fuzzy Systems, pp. 13–18, 1996.
J. Kacprzyk and C. Iwanski, “Fuzzy logic with linguistic quantifiers in inductive learning,” Fuzzy Logic for the Management of Uncertainty, pp. 465–478, 1992.
D. Haussler, “Quantifying inductive bias: A.I. learning algorithms andValiant's learning framework,” Artificial Intelligence, vol. 36, pp. 177–221, 1998.
P.H. Winston, Artificial Intelligence, Third Edition, Addison-Wesley Publishing, 1992.
C. Feng, “Fuzzy multicriteria decision-making in distribution of factories: An application of approximate reasoning,” Fuzzy Sets and Systems, vol. 71, pp. 197–205, 1995.
T.P. Hong and J.B. Chen, “Finding relevant attributes and membership functions,” Fuzzy Sets and Systems, vol. 103, no.3, pp. 389–404, 1999.
T.P. Hong and J.B. Chen, “Processing individual fuzzy attributes for fuzzy rule induction,” Fuzzy Sets and Systems, vol. 112, no.1, pp. 127–140, 2000.
T.P. Hong and C.Y. Lee, “Induction of fuzzy rules and membership functions from training examples,” Fuzzy Sets and Systems, vol. 84, pp. 33–47, 1996.
F. Hoppner, F. Klawonn, R. Kruse, and T. Runkler, Fuzzy Cluster Analysis, John Wiley, 1999.
L. Breiman, J.H. Friedman, R.A. Olshen, and C.J. stone, Classification and Regression Tree, 1984.
H. Hirsh, “Generalizing version spaces,” Machine Learning, vol. 17, pp. 5–46, 1994.
D.W. Aha and D. Kibler, “Detecting and removing noisy instances from concept descriptions,” Technical Report University of California, 1989, pp. 12–88.
B.V. Dasarathy, “Noising around the neighborhood: A new system structure and classification rule for recognition in partially exposed environments,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 2, pp. 67–71, 1980.
T.P. Hong and S.S. Tseng, “A generalized version space learning algorithm for noisy and uncertain data,” IEEE Trans. on Knowledge and Data Engineering, vol. 9, no.2, pp. 336–340, 1997.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Wang, CH., Tsai, CJ., Hong, TP. et al. Fuzzy Inductive Learning Strategies. Applied Intelligence 18, 179–193 (2003). https://doi.org/10.1023/A:1021938425987
Issue Date:
DOI: https://doi.org/10.1023/A:1021938425987