Abstract
Active learning has been a hot topic because labeled data are useful, however expensive. Many existing approaches are based on decision trees, Naïve Bayes algorithms, etc. In this paper, we propose a representative-based active learning algorithm with max-min distance. Our algorithm has two techniques interacting with each other. One is the representative-based classification inspired by covering-based neighborhood rough sets. The other is critical instance selection with max-min distance. Experimental results on six UCI datasets indicate that, with the same number of labeled instances, our algorithm is comparable with or better than the ID3, C4.5 and Naïve Bayes algorithms.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Settles, B.: Active learning. Synth. Lect. Artif. Intell. Mach. Learn. 6(1), 1–114 (2012)
Basu, S.: Semi-supervised learning. J. Roy. Stat. Soc. 6493(10), 2465–2472 (2010)
Jin, R., Si, L.: A Bayesian approach toward active learning for collaborative filtering, pp. 278–285 (2004)
Saartsechansky, M., Provost, F.: Active sampling for class probability estimation and ranking. Mach. Learn. 54(2), 153–178 (2004)
Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1(1), 81–106 (1986)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Elsevier, San Francisco (2014)
McCallum, A., Nigam, K.: A comparison of event models for Naive Bayes text classification. In: AAAI 1998 Workshop on Learning for Text Categorization, vol. 752, pp. 41–48 (1998)
Utgoff, P.E.: An incremental Id3. In: Machine Learning Proceedings, pp. 107–120 (1988)
Dwyer, K., Holte, R.: Decision tree instability and active learning. In: Kok, J.N., Koronacki, J., Mantaras, R.L., Matwin, S., Mladenič, D., Skowron, A. (eds.) ECML 2007. LNCS (LNAI), vol. 4701, pp. 128–139. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74958-5_15
Wang, L.M., Yuan, S.M., Li, L., Li, H.J.: Boosting Naïve Bayes by active learning. In: Proceedings of 2004 International Conference on Machine Learning and Cybernetics, vol. 3, pp. 1383–1386 (2004)
Hu, Q.H., Yu, D.R., Xie, Z.X.: Neighborhood classifiers. Expert Syst. Appl. 34(2), 866–876 (2008)
Zakowski, W.: Approximations in the space (u, \(\pi \)). Demonstratio Math. 16(3), 761–769 (1983)
Zhu, W.: Topological approaches to covering rough sets. Inf. Sci. 177(6), 1499–1508 (2007)
Hu, Q.H., Yu, D.R., Liu, J.F., Wu, C.X.: Neighborhood rough set based heterogeneous feature subset selection. Inf. Sci. 178(18), 3577–3594 (2008)
Xu, Z., Yu, K., Tresp, V., Xu, X., Wang, J.: Representative sampling for text classification using support vector machines. ECIR 2633, 393–407 (2013)
Huang, S.J., Jin, R., Zhou, Z.H.: Active learning by querying informative and representative examples. IEEE Trans. Pattern Anal. Mach. Intell. 36(10), 1936–1949 (2014)
Zhang, B.W., Min, F., Ciucci, D.: Representative-based classification through covering-based neighborhood rough sets. Appl. Intell. 43(4), 840–854 (2015)
Blake, C., Merz, C.J.: UCI repository of machine learning databases (1998)
Ea, S., Peterson, R.: Decision Systems for Inventory Management and Production Planning. Wiely, New York (1985)
Zhao, H., Zhu, W.: Optimal cost-sensitive granularization based on rough sets for variable costs. Knowl.-Based Syst. 65, 72–82 (2014)
Min, F., Zhu, W.: Attribute reduction of data with error ranges and test costs. Inf. Sci. 211, 48–67 (2012)
Yao, Y.Y., Zhao, Y.: Conflict analysis based on discernibility and indiscernibility. In: IEEE Symposium on Foundations of Computational Intelligence, pp. 302–307 (2007)
Acknowledgements
This work is supported in part by National Natural Science Foundation of China (Grant No. 61379089), and the Natural Science Foundation of Department of Education of Sichuan Province (Grant No. 16ZA0060).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Liu, FL., Min, F., Wen, LY., Wang, HJ. (2016). Representative-Based Active Learning with Max-Min Distance. In: Flores, V., et al. Rough Sets. IJCRS 2016. Lecture Notes in Computer Science(), vol 9920. Springer, Cham. https://doi.org/10.1007/978-3-319-47160-0_33
Download citation
DOI: https://doi.org/10.1007/978-3-319-47160-0_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47159-4
Online ISBN: 978-3-319-47160-0
eBook Packages: Computer ScienceComputer Science (R0)