Welcome to the InfoSci Platform
Influence of Domain and Model Properties on the Reliability Estimates' Performance

Influence of Domain and Model Properties on the Reliability Estimates' Performance

Zoran Bosnic, Igor Kononenko
Copyright: © 2009 |Volume: 5 |Issue: 4 |Pages: 19
ISSN: 1548-3924|EISSN: 1548-3932|ISSN: 1548-3924|EISBN13: 9781616920425|EISSN: 1548-3924|DOI: 10.4018/jdwm.2009080704
Cite Article Cite Article

MLA

Bosnic, Zoran, and Igor Kononenko. "Influence of Domain and Model Properties on the Reliability Estimates' Performance." IJDWM vol.5, no.4 2009: pp.58-76. http://doi.org/10.4018/jdwm.2009080704

APA

Bosnic, Z. & Kononenko, I. (2009). Influence of Domain and Model Properties on the Reliability Estimates' Performance. International Journal of Data Warehousing and Mining (IJDWM), 5(4), 58-76. http://doi.org/10.4018/jdwm.2009080704

Chicago

Bosnic, Zoran, and Igor Kononenko. "Influence of Domain and Model Properties on the Reliability Estimates' Performance," International Journal of Data Warehousing and Mining (IJDWM) 5, no.4: 58-76. http://doi.org/10.4018/jdwm.2009080704

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

In machine learning, the reliability estimates for individual predictions provide more information about individual prediction error than the average accuracy of predictive model (e.g. relative mean squared error). Such reliability estimates may represent decisive information in the risk-sensitive applications of machine learning (e.g. medicine, engineering, and business), where they enable the users to distinguish between more and less reliable predictions. In the authors’ previous work they proposed eight reliability estimates for individual examples in regression and evaluated their performance. The results showed that the performance of each estimate strongly varies depending on the domain and regression model properties. In this paper they empirically analyze the dependence of reliability estimates’ performance on the data set and model properties. They present the results which show that the reliability estimates perform better when used with more accurate regression models, in domains with greater number of examples and in domains with less noisy data.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.