Abstract
Novelty detection in time series is an important problem with application in different domains such as machine failure detection, fraud detection and auditing. In many problems, the occurrence of short length time series is a frequent characteristic. In previous works we have proposed a novelty detection approach for short time series that uses RBF neural networks to classify time series windows as normal or novelty. Additionally, both normal and novelty random patterns are added to training sets to improve classification performance. In this work we consider the use of MLP networks as classifiers. Next, we analyze (a) the impact of validation and training sets generation, and (b) of the training method. We have carried out a number of experiments using four real-world time series, whose results have shown that under a good selection of these alternatives, MLPs perform better than RBFs. Finally, we discuss the use of MLP and MLP/RBF committee machines in conjunction with our previous method. Experimental results shows that these committee classifiers outperform single MLP and RBF classifiers.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Berthold, M.R.: A time delay radial basis function network for phoneme recognition. In: Proc. of the IEEE International Conference on Neural Networks, vol. 7, pp. 4470–4473 (1994)
Berthold, M.R., Diamond, J.: Boosting the performance of RBF networks with dynamic decay adjustment. In: Tesauro, G., Touretzky, D., Alspector, J. (eds.) Advances in Neural Information Processing, vol. 7 (1995)
Chatfield, C.: The Analysis of Time Series – An Introduction, 4th edn. Chapman & Hall, Boca Raton (1989)
Zell, A., et al.: SNNS - Stuttgart Neural Network Simulator, User Manual, Version 4.2. University of Stuttgart and University of Tubingen
Gonzalez, F., Dasgupta, D., Kozma, R.: Combining negative selection and classification techniques for anomaly detection. In: Proc. of the Congress on Evolutionary Computing (2002)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall, Englewood Cliffs (1998)
Keogh, E., Lonardi, S., Chiu, W.: Finding surprising patterns in a time series database in linear time and space. In: Proc. ACM Knowledge Discovery and Data Mining - SIGKDD 2002, pp. 550–556 (2002)
Koskivaara, E.: Artificial neural network models for predicting patterns in auditing monthly balances. Journal of Operational Research Society 51(9), 1060–1069 (2000)
Oliveira, L.I., Azevedo, G., Barros, A., Santos, A.L.M.: A neural network based system for payroll audit support. In: Proceeding of the IV Brazilian National Artificial Intelligence Meeting (2003) (in portuguese)
Oliveira, L.I., Neto, F.B.L., Meira, S.R.L.: Novelty detection for short time series with neural networks. In: Abraham, A., Köppen, M., Franke, K. (eds.) Design and Application of Hybrid Intelligent Systems. Frontiers in Artificial Intelligence and Applications, vol. 104, IOS Press, Amsterdam (2003)
Prechelt, L.: Proben1 – a set of neural networks benchmark problems and benchmarking rules. Technical Report 21/94, Universität Karlsruhe, Germany (1994)
Riedmiller, M., Braun, H.: A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In: Proceedings of the IEEE International Conference on Neural Networks, ICNN 1993 (1993)
Shahabi, C., Tian, X., Zhao, W.: TSA-tree: A wavelet-based approach to improve the efficiency of multi-level surprise and trend queries on time-series data. In: Proc. of 12th International Conference on Scientific and Statistical Database Management (2000)
Singh, S., Markou, M.: An approach to novelty detection applied to the classification of image regions. IEEE Transactions on Knowledge and Data Engineering 15 (2003)
Yao, J., Tan, C.L.: A case study on using neural networks to perform technical forecasting of forex. Neurocomputing (34), 79–98 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Oliveira, A.L.I., Neto, F.B.L., Meira, S.R.L. (2004). Combining MLP and RBF Neural Networks for Novelty Detection in Short Time Series. In: Monroy, R., Arroyo-Figueroa, G., Sucar, L.E., Sossa, H. (eds) MICAI 2004: Advances in Artificial Intelligence. MICAI 2004. Lecture Notes in Computer Science(), vol 2972. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24694-7_87
Download citation
DOI: https://doi.org/10.1007/978-3-540-24694-7_87
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21459-5
Online ISBN: 978-3-540-24694-7
eBook Packages: Springer Book Archive