Skip to main content

Ryszard S. Michalski: The Vision and Evolution of Machine Learning

  • Chapter
Advances in Machine Learning I

Part of the book series: Studies in Computational Intelligence ((SCI,volume 262))

Abstract

Ryszard S. Michalski was an outstanding scientist who dedicated his life to research and discovery. He pioneered so many areas and methods of machine learning that it is not possible to describe them properly in one chapter. Thus, we present a brief summary of what we believe are the most important aspects of his research, and present the vision of machine learning that he communicated to us on multiple occasions. The most important topics mentioned in this chapter are: natural induction, knowledge mining, AQ learning, conceptual clustering, VL1 and attributional calculus, constructive induction, the learnable evolution model, inductive databases, methods of plausible reasoning, and the inferential theory of learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bloedorn, E., Wnek, J., Michalski, R.S., Kaufman, K.: AQ17 A Multistrategy Learning System The Method and Users Guide. Reports of the Machine Learning and Inference Laboratory, MLI 93-12, School of Information Technology and Engineering, George Mason University, Fairfax, VA (November 1993)

    Google Scholar 

  2. Collins, A., Michalski, R.S.: The Logic of Plausible Reasoning: A Core Theory. Cognitive Science 13, 1–49 (1989)

    Article  Google Scholar 

  3. Dietterich, T.G., Michalski, R.S.: Discovering Patterns in Sequence of Events. Artificial Intelligence Journal 25(2), 187–232 (1985)

    Article  Google Scholar 

  4. Domanski, P.A., Yashar, D., Kaufman, K., Michalski, R.S.: An Optimized Design of Finned-Tube Evaporators Using the Learnable Evolution Model. International Journal of Heating, Ventilating, Air-Conditioning and Refrigerating Research 10, 201–211 (2004)

    Google Scholar 

  5. Falkenhainer, B., Michalski, R.S.: Integrating Quantitative and Qualitative Discovery in the ABACUS System. In: Kodratoff, Y., Michalski, R.S. (eds.) Machine Learning: An Artificial Intelligence Approach, San Mateo, CA, vol. III, pp. 153–190. Morgan Kaufmann Publishers, San Francisco (1990)

    Google Scholar 

  6. Fürnkranz, J.: Separate-and-Conquer Rule Learning. Artificial Intelligence Review 13(1), 3–54 (1999)

    Article  MATH  Google Scholar 

  7. International Intelligent Systems, Inc.: User’s Guide to AURORA 2.0: A Discovery System. International Intelligent Systems, Inc. (1988)

    Google Scholar 

  8. Kaufman, K.: INLEN: A Methodology and Integrated System for Knowledge Discovery in Databases. Ph.D. Dissertation, School of Information Technology and Engineering, Reports of the Machine Learning and Inference Laboratory, MLI 97-15, George Mason University, Fairfax, VA (November 1997)

    Google Scholar 

  9. Kaufman, K., Michalski, R.S.: EMERALD 2: An Integrated System of Machine Learning and Discovery Programs to Support Education and Experimental Research. Reports of the Machine Learning and Inference Laboratory, MLI 93-10, School of Information Technology and Engineering, George Mason University, Fairfax, VA (September 1993)

    Google Scholar 

  10. Kaufman, K., Michalski, R.S.: ISHED1: Applying the LEM Methodology to Heat Exchanger Design. Reports of the Machine Learning and Inference Laboratory, MLI 00-2, George Mason University, Fairfax, VA (2000)

    Google Scholar 

  11. Kaufman, K., Michalski, R.S.: A Knowledge Scout for Discovering Medical Patterns: Methodology and System SCAMP. In: Proceedings of the Fourth International Conference on Flexible Query Answering Systems, FQAS 2000, Poland, October 25-28, pp. 485–496 (2000)

    Google Scholar 

  12. Kaufman, K., Michalski, R.S.: The Development of the Inductive Database System VINLEN: A Review of Current Research. In: International Intelligent Information Processing and Web Mining Conference, Zakopane, Poland (2003)

    Google Scholar 

  13. Kaufman, K., Michalski, R.S.: From Data Mining to Knowledge Mining. In: Rao, C.R., Solka, J.L., Wegman, E.J. (eds.) Handbook in Statistics. Data Mining and Data Visualization, vol. 24, pp. 47–75. Elsevier/North Holland (2005)

    Google Scholar 

  14. Kaufman, K., Michalski, R.S., Kerschberg, L.: Mining for Knowledge in Databases: Goals and General Description of the INLEN System. In: Piatetski-Shapiro, G., Frawley, W.J. (eds.) Knowledge Discovery in Databases. AAAI Press/The MIT Press, Menlo Park (1991)

    Google Scholar 

  15. Kaufman, K., Michalski, R.S., Pietrzykowski, J., Wojtusiak, J.: An Integrated Multi-task Inductive Database VINLEN: Initial Implementation and Early Results. In: Džeroski, S., Struyf, J. (eds.) KDID 2006. LNCS, vol. 4747, pp. 116–133. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  16. Larson, J., Michalski, R.S.: Inductive Inference of VL Decision Rules. In: Invited paper for the Workshop in Pattern-Directed Inference Systems, Hawaii, and published in SIGART Newsletter, May 23-27, vol. 63, pp. 38–44. ACM, New York (1977)

    Google Scholar 

  17. Michalski, R.S.: On the Quasi-Minimal Solution of the General Covering Problem. In: Proceedings of the V International Symposium on Information Processing (FCIP 1969), Yugoslavia, Bled, October 8-11. Switching Circuits, vol. A3, pp. 125–128 (1969)

    Google Scholar 

  18. Michalski, R.S.: Synteza wyrazen minimalnych i rozpoznawanie symetrii funkcji logicznych. Prace Instytutu Automatyki PAN, Zeszyt 1992, Warszawa, Instytut Automatyki Polskiej Akademii Nauk (1971)

    Google Scholar 

  19. Michalski, R.S.: A Geometrical Model for the Synthesis of Interval Covers. Report No. 461, Department of Computer Science, University of Illinois, Urbana, June 24 (1971)

    Google Scholar 

  20. Michalski, R.S.: A Variable-Valued Logic System as Applied to Picture Description and Recognition. In: Nake, F., Rosenfeld, A. (eds.) Graphic Languages. North-Holland Publishing Co., Amsterdam (1972)

    Google Scholar 

  21. Michalski, R.S.: Knowledge Acquisition Through Conceptual Clustering: A Theoretical Framework and an Algorithm for Partitioning Data into Conjunctive Concepts. Journal of Policy Analysis and Information Systems 4(3), 219–244 (1980)

    MathSciNet  Google Scholar 

  22. Michalski, R.S.: A Theory and Methodology of Inductive Learning. In: Michalski, R.S., Carbonell, T.J., Mitchell, T.M. (eds.) Machine Learning: An Artificial Intelligence Approach, pp. 83–134. TIOGA Publishing Co., Palo Alto (1983)

    Google Scholar 

  23. Michalski, R.S.: Learning = Inferencing + Memorizing: Basic Concepts of Inferential Theory of Learning and Their Use for Classifying Learning Processes. In: Foundations of Knowledge Acquisition. Machine Learning, vol. 2, pp. 1–41 (1993)

    Google Scholar 

  24. Michalski, R.S.: Learnable Evolution: Combining Symbolic and Evolutionary Learning. In: Proceedings of the Fourth International Workshop on Multistrategy Learning (MSL 1998), Desenzano del Garda, Italy, June 11-13, pp. 14–20 (1998)

    Google Scholar 

  25. Michalski, R.S.: Learnable Evolution Model Evolutionary Processes Guided by Machine Learning. Machine Learning 38, 9–40 (2000)

    Article  MATH  Google Scholar 

  26. Michalski, R.S.: Attributional Calculus: A Logic and Representation Language for Natural Induction. Reports of the Machine Learning and Inference Laboratory, MLI 04-2, George Mason University, Fairfax, VA (April 2004)

    Google Scholar 

  27. Michalski, R.S., Baskin, A.B.: Integrating Multiple Knowledge Representations and Learning Capabilities in an Expert System: The ADVISE System. In: Proceedings of the 8th International Joint Conference on Artificial Intelligence, Karlsruhe, West Germany, pp. 256–258 (1983)

    Google Scholar 

  28. Michalski, R.S., Baskin, A.B., Spackman, K.A.: A Logic-based Approach to Conceptual Database Analysis. In: Sixth Annual Symposium on Computer Applications in Medical Care (SCAMC-6), George Washington University Medical Center, Washington, DC, pp. 792–796 (1982)

    Google Scholar 

  29. Michalski, R.S., Carbonell, T.J., Mitchell, T.M. (eds.): Machine Learning: An Artificial Intelligence Approach. TIOGA Publishing Co., Palo Alto (1983)

    Google Scholar 

  30. Michalski, R.S., Carbonell, T.J., Mitchell, T.M. (eds.): Machine Learning: An Artificial Intelligence Approach, vol. II. Morgan Kaufmann Publishers, Inc., Los Altos (1986)

    MATH  Google Scholar 

  31. Michalski, R.S., Kaufman, K.: Intelligent Evolutionary Design: A New Approach to Optimizing Complex Engineering Systems and its Application to Designing Heat Exchangers. International Journal of Intelligent Systems 21, 12 (2006)

    Article  Google Scholar 

  32. Michalski, R.S., Kaufman, K.: The AQ19 System for Machine Learning and Pattern Discovery: A General Description and User’s Guide. Reports of the Machine Learning and Inference Laboratory, MLI 01-2, George Mason University, Fairfax, VA (2001)

    Google Scholar 

  33. Michalski, R.S., Kaufman, K.: Learning Patterns in Noisy Data: The AQ Approach. In: Paliouras, G., Karkaletsis, V., Spyropoulos, C.D. (eds.) ACAI 1999. LNCS (LNAI), vol. 2049, pp. 22–38. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  34. Michalski, R.S., Kaufman, K., Pietrzykowski, J., Wojtusiak, J., Mitchell, S., Seeman, W.D.: Natural Induction and Conceptual Clustering: A Review of Applications. Reports of the Machine Learning and Inference Laboratory, MLI 06-3, George Mason University, Fairfax, VA (June 2006)

    Google Scholar 

  35. Michalski, R.S., Ko, H., Chen, K.: SPARC/E(V.2), An Eleusis Rule Generator and Game Player. Reports of the Intelligent Systems Group, ISG 85-11, UIUCDCS-F-85-941, Department of Computer Science, University of Illinois (February 1985)

    Google Scholar 

  36. Michalski, R.S., Ko, H., Chen, K.: Qualitative Prediction: The SPARC/G Methodology for Inductively Describing and Predicting Discrete Processes. In: Expert Systems. Academic Press Inc., London (1986)

    Google Scholar 

  37. Michalski, R.S., Larson, J.: AQVAL/1 (AQ7) User’s Guide and Program Description. Report No. 731, Department of Computer Science, University of Illinois, Urbana (June 1975)

    Google Scholar 

  38. Michalski, R.S., Larson, J.: Incremental Generation of VL1 Hypotheses: The Underlying Methodology and the Description of Program AQ11. Reports of the Intelligent Systems Group, ISG 83-5, UIUCDCS-F-83-905, Department of Computer Science, University of Illinois, Urbana (January 1983)

    Google Scholar 

  39. Michalski, R.S., Pietrzykowski, J.: iAQ: A program that discovers rules. AAAI-07 AI Video Competition. In: Twenty-Second Conference on Artificial Intelligence (AAAI 2007), Vancouver, British Columbia, July 22-26 (2007)

    Google Scholar 

  40. Michalski, R.S., Stepp, R.: Learning from Observation: Conceptual Clustering. In: Michalski, R.S., Carbonell, T.J., Mitchell, T.M. (eds.) Machine Learning: An Artificial Intelligence Approach, pp. 331–363. TIOGA Publishing Co., Palo Alto (1983)

    Google Scholar 

  41. Michalski, R.S., Stepp, R., Diday, E.: A Recent Advance in Data Analysis: Clustering Objects into Classes Characterized by Conjunctive Concepts. In: Kanal, L., Rosenfeld, A. (eds.) Progress in Pattern Recognition, vol. 1, pp. 33–55. North-Holland, Amsterdam (1981)

    Google Scholar 

  42. Michalski, R.S., Wojtusiak, J.: Reasoning with Meta-values in AQ Learning. Reports of the Machine Learning and Inference Laboratory, MLI 05-1, George Mason University, Fairfax, VA (June 2005)

    Google Scholar 

  43. Michalski, R.S., Wojtusiak, J.: Generalizing Data in Natural Language. In: Kryszkiewicz, M., Peters, J.F., Rybiński, H., Skowron, A. (eds.) RSEISP 2007. LNCS (LNAI), vol. 4585, pp. 29–39. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  44. Pietrzykowski, J.: Demonstration and Application of Rule Discovery Methods Using iAQ. In: Workshop on Building Computational Intelligence and Machine Learning Virtual Organizations, George Mason University, Fairfax, VA, October 24, pp. 39–44 (2008)

    Google Scholar 

  45. Seeman, W.D., Michalski, R.S.: The CLUSTER3 System for Goal-oriented Conceptual Clustering: Method and Preliminary Results. In: Proceedings of The Data Mining and Information Engineering 2006 Conference, Prague, Czech Republic, July 11-13 (2006)

    Google Scholar 

  46. Spackman, K.A.: QUIN: Integration of Inferential Operators within a Relational Database. Reports of the Intelligent Systems Group, ISG 83-13, UIUCDCS-F-83-917, M.S. Thesis, Department of Computer Science, University of Illinois, Urbana (1983)

    Google Scholar 

  47. Wnek, J., Kaufman, K., Bloedorn, E., Michalski, R.S.: Inductive Learning System AQ15c: The Method and User’s Guide. Reports of the Machine Learning and Inference Laboratory, MLI 95-4, George Mason University, Fairfax, VA (March 1995)

    Google Scholar 

  48. Wojtusiak, J.: AQ21 User’s Guide. Reports of the Machine Learning and Inference Laboratory, MLI 04-3, George Mason University, Fairfax, VA (September 2004)

    Google Scholar 

  49. Wojtusiak, J.: Handling Constrained Optimization Problems and Using Constructive Induction to Improve Representation Spaces in Learnable Evolution Model. Ph.D. Dissertation, College of Science, Reports of the Machine Learning and Inference Laboratory, MLI 07-3, George Mason University, Fairfax, VA (November 2007)

    Google Scholar 

  50. Wojtusiak, J.: Data-driven Constructive Induction in the Learnable Evolution Model. In: Proceedings of the 16th International Conference Intelligent Information Systems, Zakopane, Poland, June 16-18 (2008)

    Google Scholar 

  51. Wojtusiak, J.: The LEM3 System for Multitype Evolutionary Optimization. Computing and Informatics (accepted for publication, 2009)

    Google Scholar 

  52. Wojtusiak, J., Michalski, R.S.: The LEM3 Implementation of Learnable Evolution Model and Its Testing on Complex Function Optimization Problems. In: Proceedings of Genetic and Evolutionary Computation Conference, GECCO 2006, Seattle, WA, July 8-12 (2006)

    Google Scholar 

  53. Wojtusiak, J., Michalski, R.S., Kaufman, K., Pietrzykowski, J.: The AQ21 Natural Induction Program for Pattern Discovery: Initial Version and its Novel Features. In: Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence, Washington, D.C, November 13-15 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Wojtusiak, J., Kaufman, K.A. (2010). Ryszard S. Michalski: The Vision and Evolution of Machine Learning. In: Koronacki, J., Raś, Z.W., Wierzchoń, S.T., Kacprzyk, J. (eds) Advances in Machine Learning I. Studies in Computational Intelligence, vol 262. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-05177-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-05177-7_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-05176-0

  • Online ISBN: 978-3-642-05177-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics