Abstract
Recent practical studies have shown that a selective desensitization neural network (SDNN) is a high-performance function approximator that is robust against redundant input dimensions. This paper examined the classification performance of a single-output-SDNN, which we refer to as a selective desensitization perceptron (SDP), through a numerical experiment on binary classification problems that include some irrelevant features and partially relevant features and compared these results with multilayer perceptron (MLP) and support vector machine (SVM) classification methods. The results show that SDP was highly effective not only in dealing with irrelevant features but also in a dataset including a partially relevant feature, which is irrelevant in most of the domain but affects the output in a specific domain. These results indicate that the previously observed SDNN’s high-performance in the practical problems might be originated from the fact that SDP does not require a precise feature selection with taking account of the various degrees of feature relevance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27:1–27:27 (2011)
Weston, J., Mukherjee, S., Chapelle, O., Pontil, M., Poggio, T., Vapnik, V.: Feature selection for SVMs. In: Leen, T.K., Dietterich, T.G., Tresp, V. (eds.) NIPS 2000. Advances in Neural Information Processing Systems, vol. 13, pp. 647–653. MIT Press, Cambridge (2001)
Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3(May), 1157–1182 (2003)
Gasca, E., Sanchez, J.S., Alonso, R.: Eliminating redundancy and irrelevance using a new MLP-based feature selection method. Pattern Recogn. 39(2), 313–315 (2006)
Kobayashi, T., Shibuya, T., Morita, M.: Q-learning in continuous state-action space with noisy and redundant inputs by using a selective desensitization neural network. J. Adv. Comput. Intell. Intell. Inform. 19(6), 825–832 (2015)
Nonaka, K., Tanaka, F., Morita, M.: Empirical comparison of feedforward neural network on two-variable function approximation. IEICE Trans. Inf. Syst. J. 94(12), 2114–2125 (2011). (in Japanese)
Kawata, H., Tanaka, F., Suemitsu, A., Morita, M.: Practical surface EMG pattern classification by using a selective desensitization neural network. In: Wong, K.W., Mendis, B.S.U., Bouzerdoum, A. (eds.) ICONIP 2010. LNCS, vol. 6444, pp. 42–49. Springer, Heidelberg (2010). doi:10.1007/978-3-642-17534-3_6
Horie, K., Suemitsu, A., Morita, M.: Direct estimation of hand motion speed from surface electromyograms using a selective desensitization neural network. J. Sig. Process. 18(4), 225–228 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Tanno, T., Horie, K., Izawa, J., Morita, M. (2017). Robustness of Selective Desensitization Perceptron Against Irrelevant and Partially Relevant Features in Pattern Classification. In: Liu, D., Xie, S., Li, Y., Zhao, D., El-Alfy, ES. (eds) Neural Information Processing. ICONIP 2017. Lecture Notes in Computer Science(), vol 10639. Springer, Cham. https://doi.org/10.1007/978-3-319-70136-3_55
Download citation
DOI: https://doi.org/10.1007/978-3-319-70136-3_55
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70135-6
Online ISBN: 978-3-319-70136-3
eBook Packages: Computer ScienceComputer Science (R0)