Skip to main content
Springer Nature Link
Log in

Linguistic Fuzzy Rules in Data Mining: Follow-Up Mamdani Fuzzy Modeling Principle

  • Chapter
  • First Online:
Combining Experimentation and Theory

Part of the book series: Studies in Fuzziness and Soft Computing ((STUDFUZZ,volume 271))

Abstract

From the definition of fuzzy sets by Zadeh in 1965, fuzzy logic has become a significant area of interest for researchers on artificial intelligence. In particular, Professor Mamdani was the pioneer who investigated the use of fuzzy logic for interpreting the human derived control rules, and therefore his work was considered a milestone application of this theory.

In this work, we aim to carry out an overview of the principles of fuzzy modeling given by Mamdani and its application to different areas of data mining that can be exploited such as classification, association rule mining or subgroup discovery, among others. Specifically, we present a case of study on classification with highly imbalanced data-sets in which linguistic fuzzy rule based systems have shown to achieve a good behaviour among other techniques such as decision trees.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Agrawal, R., Srikant, R.: Fast algorithms for mining association rules. In: Bocca, J.B., Jarke, M., Zaniolo, C. (eds.) Proceedings of 20th International Conference on Very Large Data Bases, VLDB, pp. 487–499. Morgan Kaufmann (1994)

    Google Scholar 

  2. Alcalá-Fdez, J., Alcalá, R., Gacto, M.J., Herrera, F.: Learning the membership function contexts for mining fuzzy association rules by using genetic algorithms. Fuzzy Sets and Systems 160(7), 905–921 (2009)

    Article  MATH  MathSciNet  Google Scholar 

  3. Alcalá-Fdez, J., Fernández, A., Luengo, J., Derrac, J., García, S., Sánchez, L., Herrera, F.: KEEL data-mining software tool: Data set repository, integration of algorithms and experimental analysis framework. Journal of Multi-Valued Logic and Soft Computing (2010) (in press)

    Google Scholar 

  4. Au, W.H., Chan, K.C.C., Wong, A.K.C.: A fuzzy approach to partitioning continuous attributes for classification. IEEE Transactions on Knowledge Data Engeneering 18(5), 715–719 (2006)

    Article  Google Scholar 

  5. Batista, G., Prati, R.C., Monard, M.C.: A study of the behaviour of several methods for balancing machine learning training data. SIGKDD Explorations 6(1), 20–29 (2004)

    Article  Google Scholar 

  6. Berlanga, F.J., del Jesus, M.J., González, P., Herrera, F., Mesonero, M.: Multiobjective Evolutionary Induction of Subgroup Discovery Fuzzy Rules: A Case Study in Marketing. In: Perner, P. (ed.) ICDM 2006. LNCS (LNAI), vol. 4065, pp. 337–349. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Carmona, C.J., González, P., del Jesus, M.J., Herrera, F.: NMEEF-SD: Non-dominated multi-objective evolutionary algorithm for extracting fuzzy rules in subgroup discovery. IEEE Transactions on Fuzzy Systems (2010) (in press); doi:10.1109/TFUZZ.2010.2060200

    Google Scholar 

  8. Casillas, J., Cordón, O., Herrera, F., Magdalena, L. (eds.): Accuracy improvements in linguistic fuzzy modeling. Springer, Berlin (2003a)

    MATH  Google Scholar 

  9. Casillas, J., Cordón, O., Herrera, F., Magdalena, L. (eds.): Interpretability issues in fuzzy modeling. Springer, Berlin (2003b)

    MATH  Google Scholar 

  10. Chan, C.C., Au, W.H.: Mining fuzzy association rules. In: Conference on Information and Knowledge Management, vol. 215, pp. 209–215 (1997)

    Google Scholar 

  11. Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: Synthetic minority over–sampling technique. Journal of Artificial Intelligent Research 16, 321–357 (2002)

    MATH  Google Scholar 

  12. Chawla, N.V., Japkowicz, N., Kolcz, A.: Editorial: special issue on learning from imbalanced data sets. SIGKDD Explorations 6(1), 1–6 (2004)

    Article  Google Scholar 

  13. Chi, Z., Yan, H., Pham, T.: Fuzzy algorithms with applications to image processing and pattern recognition. World Scientific (1996)

    Google Scholar 

  14. Cordón, O., del Jesus, M.J., Herrera, F.: A proposal on reasoning methods in fuzzy rule-based classification systems. International Journal of Approximate Reasoning 20(1), 21–45 (1999)

    Google Scholar 

  15. Cordón, O., Herrera, F., Villar, P.: Analysis and guidelines to obtain a good fuzzy partition granularity for fuzzy rule-based systems using simulated annealing. International Journal of Approximate Reasoning 25(3), 187–215 (2000)

    Article  MATH  Google Scholar 

  16. Cordón, O., Herrera, F., Hoffmann, F., Magdalena, L.: Genetic fuzzy systems. In: Evolutionary tuning and learning of fuzzy knowledge bases. World Scientific, Singapore (2001)

    Google Scholar 

  17. Cordón, O., Herrera, F., Zwir, I.: Linguistic modeling by hierarchical systems of linguistic rules. IEEE Transactions on Fuzzy Systems 10(1), 2–20 (2002)

    Article  Google Scholar 

  18. Driankow, D., Hellendoorn, H., Reinfrank, M.: An introduction to fuzzy control. Springer, Berlin (1993)

    Google Scholar 

  19. Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2001)

    MATH  Google Scholar 

  20. Eshelman, L.J.: The CHC adaptive search algorithm: How to have safe search when engaging in nontraditional genetic recombination. In: Foundations of Genetic Algorithms, pp. 265–283. Morgan Kaufman (1991)

    Google Scholar 

  21. Fernández, A., García, S., del Jesus, M.J., Herrera, F.: A study of the behaviour of linguistic fuzzy rule based classification systems in the framework of imbalanced data–sets. Fuzzy Sets and Systems 159(18), 2378–2398 (2008)

    Article  MathSciNet  Google Scholar 

  22. Fernández, A., del Jesus, M.J., Herrera, F.: Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data–sets. International Journal of Approximate Reasoning 50, 561–577 (2009)

    Article  MATH  Google Scholar 

  23. García, V., Mollineda, R., Sánchez, J.S.: On the k-NN performance in a challenging scenario of imbalance and overlapping. Pattern Analysis Applications 11(3-4), 269–280 (2008)

    Article  Google Scholar 

  24. Han, J., Kamber, M.: Data Mining - Concepts and Techniques, 2nd edn. Morgan Kaufmann, San Francisco (2006)

    MATH  Google Scholar 

  25. He, H., Garcia, E.A.: Learning from imbalanced data. IEEE Transactions on Knowledge And Data Engineering 21(9), 1263–1284 (2009)

    Article  Google Scholar 

  26. Hong, T.P., Kuo, C.S., Chi, S.C.: Mining association rules from quantitative data. Intelligent Data Analysis 3(5), 363–376 (1999)

    Article  MATH  Google Scholar 

  27. Hong, T.P., Chen, C.H., Lee, Y.C., Wu, Y.L.: Genetic-fuzzy data mining with divide-and-conquer strategy. IEEE Transactions on Evolutionary Computation 12(2), 252–265 (2008)

    Article  Google Scholar 

  28. Huang, J., Ling, C.X.: Using AUC and accuracy in evaluating learning algorithms. IEEE Transactions on Knowledge and Data Engineering 17(3), 299–310 (2005)

    Article  Google Scholar 

  29. Ishibuchi, H., Nakashima, T.: Effect of rule weights in fuzzy rule-based classification systems. IEEE Transactions on Fuzzy Systems 9(4), 506–515 (2001)

    Article  Google Scholar 

  30. Ishibuchi, H., Yamamoto, T.: Rule weight specification in fuzzy rule–based classification systems. IEEE Transactions on Fuzzy Systems 13, 428–435 (2005)

    Article  Google Scholar 

  31. Ishibuchi, H., Nozaki, K., Tanaka, H.: Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets and Systems 52(1), 21–32 (1992)

    Article  Google Scholar 

  32. Ishibuchi, H., Nakashima, T., Nii, M.: Classification and modeling with linguistic information granules: Advanced approaches to linguistic data mining. Springer, Berlin (2004)

    Google Scholar 

  33. del Jesus, M.J., González, P., Herrera, F., Mesonero, M.: Evolutionary Fuzzy Rule Induction Process for Subgroup Discovery: A case study in marketing. IEEE Transactions on Fuzzy Systems 15(4), 578–592 (2007)

    Article  Google Scholar 

  34. Kralj-Novak, P., Lavrac, N., Webb, G.I.: Supervised descriptive rule discovery: A unifying survey of constrast set, emerging pattern and subgroup mining. Journal of Machine Learning Research 10, 377–403 (2009)

    Google Scholar 

  35. Kuncheva, L.I.: On the equivalence between fuzzy and statistical classifiers. International Journal of Uncertainty, Fuzzyness and Knowledge Based Systems 4(3), 245–253 (1996)

    Article  MathSciNet  Google Scholar 

  36. Kuncheva, L.I.: Fuzzy classifier design. Springer, Berlin (2000)

    MATH  Google Scholar 

  37. Kuok, C.M., Fu, A.W.C., Wong, M.H.: Mining fuzzy association rules in databases. SIGMOD Record 27(1), 41–46 (1998)

    Article  Google Scholar 

  38. Lavrač, N., Flach, P.A., Zupan, B.: Rule Evaluation Measures: A Unifying View. In: Džeroski, S., Flach, P.A. (eds.) ILP 1999. LNCS (LNAI), vol. 1634, p. 174. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  39. Lavrac, N., Cestnik, B., Gamberger, D., Flach, P.A.: Decision Support Through Subgroup Discovery: Three Case Studies and the Lessons Learned. Machine Learning 57(1-2), 115–143 (2004)

    Article  MATH  Google Scholar 

  40. Mamdani, E.H.: Applications of fuzzy algorithm for control a simple dynamic plant. Proceedings of the IEEE 121(12), 1585–1588 (1974)

    Google Scholar 

  41. Mamdani, E.H.: Application of fuzzy logic to approximate reasoning using linguistic synthesis. IEEE Transactions on Computers 26(12), 1182–1191 (1977)

    Article  MATH  Google Scholar 

  42. Mamdani, E.H., Assilian, S.: An experiment in linguistic synthesis with a fuzzy logic controller. International Journal of Man-Machine Studies 7(1), 1–13 (1975)

    Article  MATH  Google Scholar 

  43. Mandal, D.P., Murphy, C.A., Pal, S.K.: Formulation a multivalued recognition system. IEEE Transations on System man and cibernetics 22(4), 607–620 (1992)

    Article  MATH  Google Scholar 

  44. Nauck, D., Kruse, R.: A neuro-fuzzy method to learn fuzzy classification rules from data. Fuzzy Sets and Systems 89(3), 277–288 (1997)

    Article  MathSciNet  Google Scholar 

  45. Noda, E., Freitas, A.A., Lopes, H.S.: Discovering interesting prediction rules with a genetic algorithm. In: Proceedings of the Congress on Evolutionary Computation, pp. 1322–1329 (1999)

    Google Scholar 

  46. Nozaki, K., Ishibuchi, H., Tanaka, H.: Adaptive fuzzy rule-based classification systems. IEEE Transactions on Fuzzy Systems 4(3), 238–250 (1996)

    Article  Google Scholar 

  47. Orriols-Puig, A., Bernadó-Mansilla, E.: Evolutionary rule–based systems for imbalanced datasets. Soft Computing 13(3), 213–225 (2009)

    Article  Google Scholar 

  48. Pal, S.K., Mandal, D.P.: Linguistic recognition system based on approximate reasoning. Information Sciences 61(1-2), 135–161 (1992)

    Article  Google Scholar 

  49. Pedrycz, W.: Fuzzy sets in pattern recognition: Methodology and methods. Pattern Recognition 23(1-2), 121–146 (1990)

    Article  Google Scholar 

  50. Pedrycz, W.: Fuzzy sets in pattern recognition: Accomplishments and challenges. Fuzzy sets and systems 90, 171–176 (1997)

    Article  MathSciNet  Google Scholar 

  51. Quinlan, J.R.: C4. Machine Learning. Morgan Kaufmann Publishers, San Mateo–California (1993)

    Google Scholar 

  52. Sheskin, D.: Handbook of parametric and nonparametric statistical procedures, 2nd edn. Chapman and Hall, CRC (2006)

    Google Scholar 

  53. Su, C.T., Hsiao, Y.H.: An evaluation of the robustness of MTS for imbalanced data. IEEE Transactions on Knowledge Data Engineering 19(10), 1321–1332 (2007)

    Article  Google Scholar 

  54. Sun, Y., Wong, A.K.C., Kamel, M.S.: Classification of imbalanced data: A review. International Journal of Pattern Recognition and Artificial Intelligence 23(4), 687–719 (2009)

    Article  Google Scholar 

  55. Weiss, G.M.: Mining with rarity: a unifying framework. SIGKDD Explorations 6(1), 7–19 (2004)

    Article  Google Scholar 

  56. Yager, R.R., Filev, D.P.: Essentials of fuzzy modeling and control. John Wiley & Sons (1994)

    Google Scholar 

  57. Yang, Q., Wu, X.: 10 challenging problems in data mining research. International Journal of Information Technology and Decision Making 5(4), 597–604 (2006)

    Article  Google Scholar 

  58. Zadeh, L.A.: Fuzzy sets. Information and Control 8, 338–353 (1965)

    Article  MATH  MathSciNet  Google Scholar 

  59. Zadeh, L.A.: The concept of a linguistic variable and its applications to approximate reasoning. part I. Information Sciences 8, 199–249 (1975a)

    Article  MathSciNet  Google Scholar 

  60. Zadeh, L.A.: The concept of a linguistic variable and its applications to approximate reasoning. part II. Information Sciences 8, 301–357 (1975b)

    MathSciNet  Google Scholar 

  61. Zadeh, L.A.: The concept of a linguistic variable and its applications to approximate reasoning. part III. Information Sciences 9, 43–80 (1975c)

    Article  MathSciNet  Google Scholar 

  62. Zhang, C., Zhang, S.: Association Rule Mining. LNCS (LNAI), vol. 2307. Springer, Heidelberg (2002)

    Book  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Jaén, 23071, Jaén, Spain

    A. Fernández

  2. Department of Computer Science and Artificial Intelligence, CITIC-UGR (Research Center on Information and Communications Technology), University of Granada, 18071, Granada, Spain

    F. Herrera

Authors
  1. A. Fernández
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. F. Herrera
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. Fernández .

Editor information

Editors and Affiliations

  1. European Center for Soft Computing, Mieres, Asturias, 33600, Spain

    Enric Trillas

  2. , Computing and Decision Sciences, Coolidge Fellow GE Global Research, NY, 12309, USA

    Piero P. Bonissone

  3. , Edificio Científico-Tecnológico, European Centre of Soft Computing, Calle Gonzalo Gutiérrez Quirós S/N Mieres, Asturias, 33600, Spain

    Luis Magdalena

  4. Systems Research Institute, Polish Academy of Sciences, ul. Newelska 6, Warsaw, 01--447, Poland

    Janusz Kacprzyk

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Fernández, A., Herrera, F. (2012). Linguistic Fuzzy Rules in Data Mining: Follow-Up Mamdani Fuzzy Modeling Principle. In: Trillas, E., Bonissone, P., Magdalena, L., Kacprzyk, J. (eds) Combining Experimentation and Theory. Studies in Fuzziness and Soft Computing, vol 271. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24666-1_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24666-1_8

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24665-4

  • Online ISBN: 978-3-642-24666-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics