Abstract
In the paper we discuss the issue of contaminated data sets that contain improper patterns apart from proper ones. To distinguish between those two kinds of patterns we use terms: native (proper) patterns and foreign (garbage) patterns. To deal with contaminated datasets we propose to build decision mechanism based on a collection of classification and regression models that together classify native patterns and reject foreign. The developed approach is empirically evaluated based on a set of handwritten digits as native patterns and handwritten letters playing role of foreign patterns.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Breunig, M.M., Kriegel, H.P., Ng, R.T., Sander, J.: OPTICS-OF: identifying local outliers. In: European Conference on Principles of Data Mining and Knowledge Discovery (1999)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Ghoting, A., Parthasarathy, S., Otey, M.: Fast mining of distance-based outliers in high-dimensional datasets. Data Min. Knowl. Discov. 16(3), 349–364 (2008)
Grubbs, F.E.: Sample criteria for testing outlying observations. Ann. Math. Stat. 21(1), 27–58 (1950)
Kapoor, A., Grauman, K., Urtasun, R., Darrell, T.: Gaussian processes for object categorization. Int. J. Comput. Vis. 88(2), 169–188 (2010)
LeCun, Y., Cortes, C., Burges, C.: The MNIST database of handwritten digits. http://yann.lecun.com/exdb/mnist
Pimentel, M.A.F., Clifton, D.A., Clifton, L., Tarassenko, L.: A review of novelty detection. Sig. Process. 99, 215–249 (2014)
Romanski, P., Kotthoff, L.: Package FSelector. http://cran.r-project.org/web/packages/FSelector/FSelector.pdf
Song, X., Wu, M., Jermaine, C., Ranka, S.: Conditional anomaly detection. IEEE Trans. Knowl. Data Eng. 19(5), 631–645 (2007)
Sun, H., Bao, Y., Zhao, F., Yu, G., Wang, D.: CD-trees: an efficient index structure for outlier detection. In: Advances in Web-Age Information Management, vol. 3129, pp. 600–609 (2004)
Acknowledgments
The research is partially supported by the National Science Center, grant No 2012/07/B/ST6/01501, decision no DEC-2012/07/B/ST6/01501.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Homenda, W., Jastrzebska, A., Waszkiewicz, P. (2018). Decision Making Beyond Pattern Recognition: Classification or Rejection. In: Czarnowski, I., Howlett, R., Jain, L. (eds) Intelligent Decision Technologies 2017. IDT 2017. Smart Innovation, Systems and Technologies, vol 72. Springer, Cham. https://doi.org/10.1007/978-3-319-59421-7_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-59421-7_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-59420-0
Online ISBN: 978-3-319-59421-7
eBook Packages: EngineeringEngineering (R0)