Abstract
A novel evolving fuzzy rule-based classifier, namely parsimonious classifier (pClass), is proposed in this paper. pClass can set off its learning process either from scratch with an empty rule base or from an initially trained fuzzy model. Importantly, pClass not only adopts the open structure concept, where an automatic knowledge building process can be cultivated during the training process, which is well-known as a main pillar to learn from streaming examples, but also incorporates the so-called plug-and-play principle, where all learning modules are coupled in the training process, in order to diminish the requirement of pre- or post-processing steps, undermining the firm logic of the online classifier. In what follows, pClass is equipped with the rule growing, pruning, recall and input weighting techniques, which are fully performed on the fly in the training process. The viability of pClass has been tested exploiting real-world and synthetic data streams containing some sorts of concept drifts, and compared with state-of-the-art classifiers, where pClass can deliver the most encouraging numerical results in terms of the classification rate, number of fuzzy rule, number of rule base parameters and the runtime.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vapnik, V.N.: The Statistical Learning Theory. Springer, New York (1998)
Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall Inc., Upper Saddle River (1999)
Wu, X., Kumar, V., Quinlan, J.R., Gosh, J., Yang, Q., Motoda, H., MacLachlan, G.J., Ng, A., Liu, B., Yu, P.S., Zhou, Z.-H., Steinbach, M., Hand, D.J., Steinberg, D.: Top 10 algorithms in data mining. Knowledge and Information Systems 14(1), 1–37 (2006)
Angelov, P., Filev, D.: An approach to online identification of Takagi-Sugeno fuzzy models. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics 34, 484–498 (2004)
Lemos, A., Caminhas, W., Gomide, F.: Multivariable Gaussian Evolving Fuzzy Modeling System. IEEE Transactions on Fuzzy Systems 19(1), 91–104 (2011)
Pratama, M., Anavatti, S., Angelov, P., Lughofer, E.: PANFIS: A Novel Incremental Learning. IEEE Transactions on Neural Networks and Learning Systems (2013) (online and in press)
Angelov, P., Filev, D.: Simpl_eTS: A simplified method for learning evolving Takagi-Sugeno fuzzy models. In: IEEE International Conference on Fuzzy Systems (FUZZ), pp. 1068–1073 (2005)
Angelov, P.: Evolving Takagi-Sugeno Fuzzy Systems from Data Streams (eTS+). In: Angelov, P., Filev, D., Kasabov, N. (eds.) Evolving Intelligent Systems: Methodology and Applications. IEEE Press Series on Computational Intelligence, pp. 21–50. John Willey and Sons (April 2010) ISBN: 978-0-470-28719-4
Lughofer, E.: FLEXFIS: A Robust Incremental Learning Approach for Evolving TS Fuzzy Models. IEEE Transactions on Fuzzy Systems 16(6), 1393–1410 (2008)
Lughofer, E.: On-line incremental feature weighting in evolving fuzzy classifiers. Fuzzy Sets and Systems 163(1), 1–23 (2011)
Pratama, M., Anavatti, S., Lughofer, E.: pClass: An Effective Classifier to Streaming Examples. Submitted to IEEE Transactions on Fuzzy Systems, Under Review (June 7, 2013)
Pratama, M., Anavatti, S., Lughofer, E.: Evolving Fuzzy Rule-Based Classifier Based on GENEFIS. In: Proceedings of the IEEE Conference on Fuzzy Systems, Hyderabad, India (2013)
Lughofer, E., Buchtala, O.: Reliable All-Pairs Evolving Fuzzy Classifiers. IEEE Transactions on Fuzzy Systems 21(4), 625–641 (2013)
Angelov, P., Lughofer, E., Zhou, X.: Evolving fuzzy classifiers using different model architectures. Fuzzy Sets and Systems 159(23), 3160–3182 (2008)
Rong, H.-J., Sundarajan, N., Huang, G.-B.: Extended Sequential Adaptive Fuzzy Inference System for Classification Problems. Evolving System 2(2), 71–82 (2011)
Pang, S., Ozawa, S., Kasabov, N.: Incremental Linear Discriminant Analysis for Classification of Data Streams. IEEE Transactions on System, Man and Cybernetics-Part: Cybernetics 35(5), 905–914 (2005)
Sateesh Babu, G., Suresh, S.: Meta-cognitive neural network for classification problems in a sequential learning framework. Neurocomputing 81(1), 86–96 (2012)
Suresh, S., Dong, K., Kim, H.: A sequential learning algorithm for self-adaptive resource allocation network classifier. Neurocomputing 73(16-18), 3012–3019 (2010)
Huang, G.-B., Saratchandran, P., Sundararajan, N.: An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. IEEE Transaction on Systems., Man, Cybernetics., Part-B: Cybernetics 34, 2284–2292 (2004)
Huang, G.-B., Saratchandran, P., Sundararajan, N.: A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation. IEEE Transaction on. Neural Networks 16, 57–67 (2005)
Lemos, A., Caminhas, W., Gomide, F.: Adaptive fault detection and diagnosis using an evolving fuzzy classifier. Information Sciences 220, 64–85 (2013)
Pratama, M., Anavatti, S., Lughofer, E.: GENEFIS: Towards An Effective Localist Network. IEEE Transactions on Fuzzy Systems, http://dx.doi.org/10.1109/TFUZZ.2013.2264938 (online and in press)
Pratama, M., Er, M.-J., Li, X., Oentaryo, R.J., Lughofer, E., Arifin, I.: Data Driven Modelling Based on Dynamic Parsimonious Fuzzy Neural Network. Neurocomputing 110, 18–28 (2013)
Lughofer, E.: A Dynamic Split-and-Merge Approach for Evolving Cluster Models. Evolving Systems 3(3), 135–151 (2012)
Vigdor, B., Lerner, B.: The Bayesian ARTMAP. IEEE Transactions on Neural Networks 18(6), 1628–1644 (2007)
Yap, K.S., Lim, C.P., Au, M.T.: Improved GART Neural Network Model for Pattern Classification and Rule Extraction with Application to Power System. IEEE Transaction on Neural Network 22(12) (2011)
Pratama, M., Anavatti, S., Garratt, M., Lughofer, E.: Online Identification of Complex Multi-Input-Multi-Output System Based on GENERIC Evolving Neuro-Fuzzy Inference System. In: Proceedings of the Symposium Series on Computational Intelligence, Singapore (2013)
Lee, C.C.: Fuzzy logic in control systems: Fuzzy logic controller. IEEE Transaction. Systems., Man, Cybernetics, pt. I, II 20, 404–436 (1990)
de Barros, J.-C., Dexter, A.L.: On-line Identification of Computationally Undemanding Evolving Fuzzy Models. Fuzzy Sets and Systems 158, 1997–2012 (2007)
Bartett, F.C.: Remembering: A study in Experimental and Social Psychology. Cambridge Press University Press, Cambridge (1932)
Xu, Y., Wong, K.W., Leung, C.S.: Generalized Recursive Least Square to The Training of Neural Network. IEEE Transaction on Neural Network 17(1) (2006)
Minku, L.L., Yao, X.: DDD: A New Ensemble Approach for Dealing with Drifts. IEEE Transactions on Knowledge and Data Engineering 24(4) (2012)
Liang, N.-Y., Huang, G.-B., Saratchandran, P., Sundararajan, N.: A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Transactions on Neural Networks and Learning Systems 17(6), 1411–1423 (2006)
Wang, L., Ji, H.-B., Jin, Y.: Fuzzy Passive-Aggressive Classification: A Robust and Efficient Algorithm for Online Classification Problems. Information Sciences 220, 46–63 (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Pratama, M., Anavatti, S.G., Lughofer, E. (2014). An Incremental Classifier from Data Streams . In: Likas, A., Blekas, K., Kalles, D. (eds) Artificial Intelligence: Methods and Applications. SETN 2014. Lecture Notes in Computer Science(), vol 8445. Springer, Cham. https://doi.org/10.1007/978-3-319-07064-3_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-07064-3_2
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07063-6
Online ISBN: 978-3-319-07064-3
eBook Packages: Computer ScienceComputer Science (R0)