Abstract
Bayesian learning provides a simple but efficient method for classification by combining the sample information with the prior knowledge and the dependencies with probability estimates. However, Bayesian network classifiers that minimize the number of misclassification errors ignore different misclassification costs. For example, in rock burst prediction, the cost of misclassifying a rock which happens to burst as a rock which doesn’t burst is much higher than the opposite type of error. This paper studies the cost-sensitive learning and then applies it to different Bayesian Network classifiers, and the resulted algorithms are called cost-sensitive Bayesian Network classifiers. The experimental results on 36 UCI datasets validate their effectiveness in terms of the total misclassification costs. Finally, we apply the cost-sensitive Bayesian Network classifiers to some real-world rock burst prediction examples and achieve good results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chickering, D.M.: Learning Bayesian Networks Is NP-Complete. In: Learning from Data: Artificial Intelligence and Statistics, pp. 121–130 (1996)
Jiang, L., Cai, Z., Zhang, H., Wang, D.: Not So Greedy: Randomly Selected Naive Bayes. Expert Systems With Applications 39(12), 11022–11028 (2012)
Chai, X., Deng, L., Yang, Q., et al.: Test-Cost Sensitive Naive Bayes Classification. In: Proceedings of the 4th IEEE International Conference on Data Mining, pp. 51–58 (2004)
Elkan, C.: The Foundations of Cost-Sensitive Learning. In: Proceedings of 17th International Joint Conference on Artificial Intelligence, vol. 17(1), pp. 973–978. Morgan Kaufmann (2001)
Ling, C.X., Sheng, V.S.: Cost-Sensitive Learning and the Class Imbalance Problem. In: Encyclopedia of Machine Learning, pp. 231–235 (2008)
Feng, X.T., et al.: A New Direction-Intelligent Rock Mechanics and Rock Engineering. International Journal of Rock Mechanics and Mining Sciences 34(1), 135–141 (1997)
Friedman, N., Geiger, D., Goldszmid, T.M.: Bayesian Network Classifiers. Machine Learning 29(2-3), 131–163 (1997)
Keogh, E., Pazzani, M.: Learning Augmented Bayesian Classifiers: A Comparison of Distribution-Based and Classification-Based Approaches. In: Proceedings of the Seventh International Workshop on Artificial Intelligence and Statistics, pp. 225–230 (1999)
Webb, G.I., Boughton, J.R., Wang, Z.: Not So Naive Bayes: Aggregating One-Dependence Estimators. Machine Learning 58(1), 5–24 (2005)
Jiang, L., Zhang, H., Cai, Z., Wang, D.: Weighted Average of One-Dependence Estimators. Journal of Experimental & Theoretical Artificial Intelligence 24(2), 219–230 (2012)
Jiang, L., Zhang, H., Cai, Z.: A Novel Bayes Model: Hidden Naive Bayes. IEEE Transactions on Knowledge and Data Engineering 21(10), 1361–1371 (2012)
Nigam, K., Mccallum, A.K., Thrun, S., et al.: Text Classification from Labeled and Unlabeled Documents Using EM. Machine Learning 39(2-3), 103–134 (2000)
Margineantu, D.D.: Active Cost-Sensitive Learning. In: Proceedings of the 19th International Joint Conference on Artificial Intelligence, vol. 5, pp. 1622–1623 (2005)
Liu, A., Jun, G., Ghosh, J.: Spatially Cost-Sensitive Active Learning. In: Proceedings of the 9th SIAM International Conference on Data Mining, pp. 814–825 (2009)
Wang, T., Qin, Z., Zhang, S., et al.: Cost-Sensitive Classification With Inadequate Labeled Data. Information Systems 37(5), 508–516 (2012)
Jiang, L., Li, C., Cai, Z., Zhang, H.: Sampled Bayesian Network Classifiers for Class-Imbalance and Cost-Sensitive Learning. In: Proceedings of the 25th IEEE International Conference on Tools With Artificial Intelligence (ICTAI 2013), Herndon, Virginia, USA, pp. 512–517 (2013)
Frank, A., Asuncion, A.: UCI Machine Learning Repository. University of California. School of Information and Computer Science, Irvine, CA, 213 (2010), http://Archive.Ics.Uci.Edu/Ml
Witten, I.H., Frank, E., Hall, M.A.: Data Mining: Practical Machine Learning Tools and Techniques, 3rd edn. Morgan Kaufmann (January 2011) ISBN 978-0-12-374856-0
Feng, X.T., Wang, L.N.: Rock-Burst Prediction Based on Neural Networks. Transactions of Nonferrous Metals Society of China 4(1), 7–14 (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Kong, G., Xia, Y., Qiu, C. (2014). Cost-Sensitive Bayesian Network Classifiers and Their Applications in Rock Burst Prediction. In: Huang, DS., Bevilacqua, V., Premaratne, P. (eds) Intelligent Computing Theory. ICIC 2014. Lecture Notes in Computer Science, vol 8588. Springer, Cham. https://doi.org/10.1007/978-3-319-09333-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-09333-8_12
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09332-1
Online ISBN: 978-3-319-09333-8
eBook Packages: Computer ScienceComputer Science (R0)