Skip to main content

Cost-sensitive specialization

  • Machine Learning I
  • Conference paper
  • First Online:
PRICAI'96: Topics in Artificial Intelligence (PRICAI 1996)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1114))

Included in the following conference series:

Abstract

Cost-sensitive specialization is a generic technique for mis-classification cost sensitive induction. This technique involves specializing aspects of a classifier associated with high misclassification costs and generalizing those associated with low misclassification costs. It is widely applicable and simple to implement. It could be used to augment the effect of standard cost-sensitive induction techniques. It should directly extend to test application cost sensitive induction tasks. Experimental evaluation demonstrates consistent positive effects over a range of misclassification cost sensitive learning tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. L. Breiman, J. H. Friedman, R. A. Olshen, and C. J. Stone. Classification and Regression Trees. Wadsworth, Belmont, Ca, 1984.

    Google Scholar 

  2. B. A. Draper, C. E. Brodley, and P. E. Utgoff. Goal-directed classification using linear machine decision trees. IEEE Transactions on Pattern Recognition and Artificial Intelligence, 16:888–893, 1994.

    Google Scholar 

  3. D. Gordon and D. Perlis. Explicitly biased generalization. Computational Intelligence, 5(2):67–81, May 1989.

    Google Scholar 

  4. R. C. Holte, L. E. Acker, and B. W. Porter. Concept learning and the problem of small disjuncts. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, pp. 813–818, Detroit, 1989. Morgan Kaufmann.

    Google Scholar 

  5. U. Knoll, G. Nakhaeizadeh, and B. Tausend. Cost-sensitive pruning of decision trees. In F. Bergadano and L. De Raedt, editors, Proceedings of the Eighth Eutropean Conference on Machine Learning, ECML-94, pp. 383–386, Catania, Italy, 1994. Springer-Verlag.

    Google Scholar 

  6. S. W. Norton. Generating better decision trees. In Proceedings of the Eleventh International Joint Conference on Artificial Intelligence, IJCAI-89, pp. 800–805, Detroit, MI, 1989. Morgan Kaufmann.

    Google Scholar 

  7. M. Nùñez. The use of background knowledge in decision tree induction. Machine Learning, 6:231–250, 1991.

    Google Scholar 

  8. M. J. Pazzani, C. Merz, P. Murphy, K. Ali, T. Hume, and C. Brunk. Reducing misclassification costs. In Proceedings of the Eleventh International Conference on Macine Learning, pp. 217–225, New Jersey, 1994. Morgan Kaufmann.

    Google Scholar 

  9. F. J. Provost. Goal-directed inductive learning: Trading off accuracy for reduced error cost. In Proceedings of the AAAI Spring Symposium on Goal Directed Learning, pp. 94–101, 1994.

    Google Scholar 

  10. F. J. Provost and B. G. Buchanan. Inductive policy. In Proceedings of the Tenth National Conference on Artificial Intelligence (AAAI-92), pp. 255–261. AAAI Press, 1992.

    Google Scholar 

  11. F. J. Provost and B. G. Buchanan. Inductive policy: The pragmatics of bias selection. Machine Learning, 20(1/2):35–61, 1995.

    Google Scholar 

  12. J. R. Quinlan. C4.5: Programs For Machine Learning. Morgan Kaufmann, San Mateo, 1993.

    Google Scholar 

  13. M. Tan. Cost-sensitive learning of classification knowledge and its applications in robotics. Machine Learning, 13:7–33, 1993.

    Google Scholar 

  14. P. D. Turney. Cost-sensitive classification: Empirical evaluation of a hybrid genetic decision tree induction algorithm. Journal of Artificial Intelligence Research, 2:369–409, 1995.

    Google Scholar 

  15. G. I. Webb. Generality is more significant than complexity: Toward alternatives to Occam's razor. In C. Zhang, J. Debenham, and D. Lukose, editors, AI'94 — Proceedings of the Seventh Australian Joint Conference on Artificial Intelligence, pp. 60–67, Armidale, 1994. World Scientific.

    Google Scholar 

  16. G. I. Webb. Syntactic complexity is not predictive of predictive accuracy: Experimental evidence against Occam's razor. To be published in Journal of Artificial Intelligence Research, 1996.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Norman Foo Randy Goebel

Rights and permissions

Reprints and permissions

Copyright information

© 1996 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Webb, G.I. (1996). Cost-sensitive specialization. In: Foo, N., Goebel, R. (eds) PRICAI'96: Topics in Artificial Intelligence. PRICAI 1996. Lecture Notes in Computer Science, vol 1114. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61532-6_3

Download citation

  • DOI: https://doi.org/10.1007/3-540-61532-6_3

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-61532-3

  • Online ISBN: 978-3-540-68729-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics