Abstract
Novelty detection involves identifying novel patterns. They are not usually available during training. Even if they are, the data quantity imbalance leads to a low classification accuracy when a supervised learning scheme is employed. Thus, an unsupervised learning scheme is often employed ignoring those few novel patterns. In this paper, we propose two ways to make use of the few available novel patterns. First, a scheme to determine local thresholds for the Self Organizing Map boundary is proposed. Second, a modification of the Learning Vector Quantization learning rule is proposed so that allows one to keep codebook vectors as far from novel patterns as possible. Experimental results are quite promising.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bishop, C.: Novelty Detection and Neural Network Validation. In: Proceedings of IEE Conference on Vision and Image Signal Processing, pp. 217–222 (1994)
Schölkopf, B., Platt, J.C., Shawe-Taylor, J., Smola, A.J., Williamson, R.C.: Estimating the Support of a High-dimensional Distribution. Neural Computation 13, 1443–1471 (2001)
Markou, M., Singh, S.: Novelty Detection: A Review - Part 1: Statistical Approaches. Signal Processing 83, 2481–2497 (2003)
Markou, M., Singh, S.: Novelty Detection: A Review - Part 2: Neural Network Based Approaches. Signal Processing 83, 2499–2521 (2003)
Marsland, S.: Novelty Detection in Learning Systems. Neural Computing Surveys 3, 157–195 (2003)
Gori, M., Lastrucci, L., Soda, G.: Autoassociator-based Models for Speaker Verification. Pattern Recognition Letters 17, 241–250 (1995)
Frosini, A., Gori, M., Priami, P.: A neural Network-based Model for Paper Currency Recognition and Verification. IEEE Transactions on Neural Networks 7(6), 1482–1490 (1996)
Lauer, M.: A Mixture Approach to Novelty Detection Using Training Data with Outliers. In: De Raedt, L., Flach, P. (eds.) Proceedings of the 12th European Conference on Machine Learning, pp. 300–311. Springer, Heidelberg (2001)
Tax, D.M.J., Duin, R.P.W.: Support Vector Data Description. Machine Learning 54, 45–66 (2004)
Japkowicz, N.: Supervised versus Unsupervised Binary-learning by Feed-forward Neural Networks. Machine Learning 42(1-2), 97–122 (2001)
Kohonen, T.: Self Organizing Maps. Springer, Berlin (2001)
Rätsch, G., Onoda, T., Müller, K.R.: Soft Margins for AdaBoost. Machine Learning 42(3), 287–320 (2001)
Yu, E., Cho, S.: Keystroke Dynamics Identity Verification - Its Problems and Practical Solutions. Computer and Security 23(5), 428–440 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, Hj., Cho, S. (2005). SOM-Based Novelty Detection Using Novel Data. In: Gallagher, M., Hogan, J.P., Maire, F. (eds) Intelligent Data Engineering and Automated Learning - IDEAL 2005. IDEAL 2005. Lecture Notes in Computer Science, vol 3578. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11508069_47
Download citation
DOI: https://doi.org/10.1007/11508069_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-26972-4
Online ISBN: 978-3-540-31693-0
eBook Packages: Computer ScienceComputer Science (R0)