Abstract
This paper proposes an innovative combinational algorithm to improve the performance of multiclass problems. Because the more accurate classifier the better performance of classification, so researchers have been tended to improve the accuracies of classifiers. Although obtaining the more accurate classifier is often targeted, there is an alternative way to reach for it. Indeed one can use many inaccurate classifiers each of which is specialized for a few dataitems in the problem space and then s/he can consider their consensus vote as the classification. This paper proposes a new ensembles methodology that uses ensemble of classifiers as elements of ensemble. These ensembles of classifiers jointly work using majority weighted voting. The results of these ensembles are in weighted manner combined to decide the final vote of the classification. In empirical result, these weights in final classifier are determined with using a series of genetic algorithms. We evaluate the proposed framework on a very large scale Persian digit handwritten dataset and the results show effectiveness of the algorithm.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Bala, J., De Jong, K., Huang, J., Vafaie, H., Wechsler, H.: Using learning to facilitate the evolution of features for recognizing visual concepts. Evolutionary Computation, Special Issue on Evolution, Learning, and Instinct: 100 years of the Baldwin Effect 4(3) (1997)
Bandyopadhyay, S., Muthy, C.A.: Pattern Classification Using Genetic Algorithms. Pattern Recognition Letters 16, 801–808 (1995)
Breiman, L.: Bagging Predictors. Journal of Machine Learning 24(2), 123–140 (1996)
Guerra-Salcedo, C., Whitley, D.: Feature Selection mechanisms for ensemble creation: a genetic search perspective. In: Freitas, A.A. (ed.) Data Mining with Evolutionary Algorithms: Research Directions – Papers from the AAAI Workshop, Technical Report WS-99-06, pp. 13–17. AAAI Press, Menlo Park (1999)
Gunter, S., Bunke, H.: Creation of classifier ensembles for handwritten word recognition using feature selection algorithms. In: IWFHR 2002, January 15 (2002)
Holland, J.: Adaptive in Natural and Artificial Systems. MIT Press, Cambridge (1992) (1st edn. The University of Michigan Press, Ann Arbor (1975))
Khosravi, H., Kabir, E.: Introducing a very large dataset of handwritten Farsi digits and a study on the variety of handwriting styles. Pattern Recognition Letters 28(10), 1133–1141 (2007)
Kuncheva, L.I., Jain, L.C.: Designing Classifier Fusion Systems by Genetic Algorithms. IEEE Transaction on Evolutionary Computation 33, 351–373 (2000)
Kuncheva, L.I.: Combining Pattern Classifiers, Methods and Algorithms. Wiley, New York (2005)
Martin-Bautista, M.J., Vila, M.A.: A survey of genetic feature selection in mining issues. In: Proceeding Congress on Evolutionary Computation (CEC 1999), Washington DC, pp. 1314–1321 (1999)
Minaei-Bidgoli, B., Punch, W.F.: Using Genetic Algorithms for Data Mining Optimization in an Educational Web-based System. In: Cantú-Paz, E., Foster, J.A., Deb, K., Davis, L., Roy, R., O’Reilly, U.-M., Beyer, H.-G., Kendall, G., Wilson, S.W., Harman, M., Wegener, J., Dasgupta, D., Potter, M.A., Schultz, A., Dowsland, K.A., Jonoska, N., Miller, J., Standish, R.K. (eds.) GECCO 2003. LNCS, vol. 2723, Springer, Heidelberg (2003)
Minaei-Bidgoli, B., Kortemeyer, G., Punch, W.F.: Mining Feature Importance: Applying Evolutionary Algorithms within a Web-Based Educational System. In: Proc. of the Int. Conf. on Cybernetics and Information Technologies, Systems and Applications (2004)
Parvin, H., Alizadeh, H., Fathi, M., Minaei-Bidgoli, B.: Improved Face Detection Using Spatial Histogram Features. In: Improved Face Detection Using Spatial Histogram Features. The 2008 Int. Conf. on Image Processing, Computer Vision, and Pattern Recognition (IPCV 2008), Las Vegas, Nevada, USA, July 14-17 (2008)
Punch, W.F., Pei, M., Chia-Shun, L., Goodman, E.D., Hovland, P., Enbody, R.: Further research on Feature Selection and Classification Using Genetic Algorithms. In: 5th International Conference on Genetic Algorithm, Champaign IL, pp. 557–564 (1993)
Saberi, A., Vahidi, M., Minaei-Bidgoli, B.: Learn to Detect Phishing Scams Using Learning and Ensemble Methods. In: IEEE/WIC/ACM International Conference on Intelligent Agent Technology, Workshops (IAT 2007), Silicon Valley, USA, November 2-5, vol. 5, pp. 311–314 (2007)
Vafaie, H., De Jong, K.: Robust feature Selection algorithms. In: Proceeding 1993 IEEE Int. Conf on Tools with AI, Boston, Mass., USA, pp. 356–363 (1993)
Yang, T.: Computational Verb Decision Trees. International Journal of Computational Cognition, 34–46 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Parvin, H., Minaei, B., Alizadeh, H. (2011). A New Adaptive Framework for Classifier Ensemble in Multiclass Large Data. In: Murgante, B., Gervasi, O., Iglesias, A., Taniar, D., Apduhan, B.O. (eds) Computational Science and Its Applications - ICCSA 2011. ICCSA 2011. Lecture Notes in Computer Science, vol 6782. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21928-3_38
Download citation
DOI: https://doi.org/10.1007/978-3-642-21928-3_38
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21927-6
Online ISBN: 978-3-642-21928-3
eBook Packages: Computer ScienceComputer Science (R0)