Abstract
The concept of confirmation rule sets represents a framework for reliable decision making that combines two principles that are effective for increasing the predictive accuracy: consensus in an ensemble of classifiers and indecisive or probabilistic predictions in cases when reliable decisions are not possible. The confirmation rules concept uses a separate classifier set for every class of the domain. In this decision model different rules can be incorporated: either those obtained by applying one or more inductive learning algorithms or even rules representing human encoded expert domain knowledge. The only conditions for the inclusion of a rule into the confirmation rule set are its high predictive value and relative independence of other rules in the confirmation rule set. This paper introduces the concept of confirmation rule sets, together with an algorithm for selecting relatively independent rules from a set of all acceptable confirmation rules and an algorithm for the systematic construction of a set of confirmation rules.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
R. Agrawal, H. Mannila, R. Srikant, H. Toivonen and A.I. Verkamo (1996) Fast discovery of association rules. In U.M. Fayyad, G. Piatetski-Shapiro, P. Smyth and R. Uthurusamy (Eds.) Advances in Knowledge Discovery and Data Mining, pp. 307–328. AAAI Press.
K.M. Ali and M.J. Pazzani (1996) Error reduction through learning multiple descriptions. Machine Learning, 24:173–206.
P.J. Boland (1989) Majority systems and the Concorcet jury theorem. Statistician, 38:181–189.
L. Breiman (1996) Bagging predictors. Machine Learning 24(2): 123–140.
Y. Freund and R.E. Shapire (1996) Experiments with a new boosting algorithm. In Proc. Thirteenth International Machine Learning Conference ICML’96, 148–156, Morgan Kaufmann.
D. Gamberger, N. Lavrač, C. Grošelj (1999) Diagnostic rules of increased reliability for critical medical applications. In Proc. Joint European Conference on Artificial Intelligence in Medicine and Medical Decision Making AIMDM-99, 361–365, Springer Lecture Notes in AI 1620.
D. Gamberger, N. Lavrač, C. Grošelj (1999) Experiments with noise filtering ina medical domain. In Proc. of International Conference on Machine Learning ICML-99, 143–151. Morgan Kaufmann.
C. Grošelj, M. Kukar, J.J. Fetich and I. Kononenko (1997) Machine learning improves the accuracy of coronary artery disease diagnostic methods. Computers in Cardiology, 24:57–60.
T. Kagan and J. Ghosh (1996) Error correlation and error reduction in ensemble classifiers. Connection Science, 8:385–404.
J. Kittler, M. Hatef, R.P.W. Duin, and J. Matas (1998) On combining classifiers. IEEE Trans. on Pattern Analysis and Machine Intelligence 20:226–239.
M. Kukar, I. Kononenko, C. Grošelj, K. Kralj, J.J. Fettich (1998) Analysing and improving the diagnosis of ischaemic heart disease with machine learning. Artificial Intelligence in Medicine, special issue on Data Mining Techniques and Applications in Medicine, Elsevier.
N. Lavrač, D. Gamberger, and P. Turney (1997) A relevancy filter for constructive induction. IEEE Intelligent Systems & Their Applications, 13:50–56.
B. Liu, W. Hsu and Y. Ma (1998) Integrating classification and association rule mining. In Proc. Fourth International Conference on knowledge Discovery and Data Mining,KDD-98, New York, USA, 1998.
R.S. Michalski, I. Mozetič, J. Hong, and N. Lavrač (1986) The multi-purpose incremental learning system AQ15 and its testing application on three medical domains. In Proc. Fifth National Conference on Artificial Intelligence, pp. 1041–1045, Morgan Kaufmann.
M. Pazzani, P. Murphy, K. Ali, and D. Schulenburg (1994) Trading off coverage for accuracy in forecasts: Applications to clinical data analysis. In Proceedings of the AAAI Symposium on AI in Medicine, pp. 106–110.
J.R. Quinlan (1996) Boosting, bagging, and C4.5. In Proc. Thirteenth National Conference on Artificial Intelligence, 725–730, AAAI Press.
R.L. Rivest and R. Sloan (1988) Learning complicated concepts reliably and usefully. In Proc. Workshop on Computational Learning Theory, 69–79, Morgan Kaufman.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gamberger, D., Lavrač, N. (2000). Confirmation Rule Sets. In: Zighed, D.A., Komorowski, J., Żytkow, J. (eds) Principles of Data Mining and Knowledge Discovery. PKDD 2000. Lecture Notes in Computer Science(), vol 1910. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45372-5_4
Download citation
DOI: https://doi.org/10.1007/3-540-45372-5_4
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41066-9
Online ISBN: 978-3-540-45372-7
eBook Packages: Springer Book Archive