Abstract
In this paper, we propose a new instance-aware concept drift detection and learning algorithm, called CPP, by dynamically capturing the evolving concepts via online Class Posterior Probability. Instead of comparing distributions of two adaptive windows of data or using prediction performance to infer concept drifts, we model and trace the concept drift by investigating the change of class posterior probability via ensemble of classifier chains directly. Building upon the intuitive concept drift modeling, CPP shows several attractive benefits: (a) It is capable of detecting and learning both gradual and abrupt concept drifts effectively, and thus supports accurate predictions. (b) CPP allows distinguishing real concept drifts from noisy instances or virtual concept drifts. (c) The time-changing concepts are captured and learned at the instance level, and this suggests that CPP lends itself to fast concept drift detection and learning. Empirical results show that our method allows effective and efficient concept drift detection and has good prediction performance compared to many baselines.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bach, S.H., Maloof, M.: Paired learners for concept drift. In: ICDM, pp. 23–32 (2008)
Baena-García, M., del Campo-Ávila, J., Fidalgo, R., Bifet, A., Gavaldà, R., Morales-Bueno, R.: Early drift detection method (2006)
Bifet, A., Gavalda, R.: Learning from time-changing data with adaptive windowing. In: SIAM SDM, vol. 7, p. 2007 (2007)
Bifet, A., Holmes, G., Pfahringer, B., Kirkby, R., Gavaldà, R.: New ensemble methods for evolving data streams. In: ACM SIGKDD, pp. 139–148 (2009)
Frank, E., Kramer, S.: Ensembles of nested dichotomies for multi-class problems. In: ICML, p. 39 (2004)
Gama, J., Medas, P., Castillo, G., Rodrigues, P.: Learning with drift detection. In: Bazzan, A.L.C., Labidi, S. (eds.) SBIA 2004. LNCS (LNAI), vol. 3171, pp. 286–295. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-28645-5_29
Geilke, M., Frank, E., Karwath, A., Kramer, S.: Online estimation of discrete densities. In: ICDM, pp. 191–200 (2013)
Hosseini, M.J., Ahmadi, Z., Beigy, H.: Using a classifier pool in accuracy based tracking of recurring concepts in data stream classification. Evol. Syst. 4(1), 43–60 (2013)
Hulten, G., Spencer, L., Domingos, P.: Mining time-changing data streams. In: ACM SIGKDD, pp. 97–106 (2001)
Koychev, I.: Tracking changing user interests through prior-learning of context. In: Adaptive Hypermedia and Adaptive Web-Based Systems, pp. 223–232 (2002)
Kuncheva, L.I.: Classifier ensembles for detecting concept change in streaming data: overview and perspectives. In: Proceedings of the 2nd Workshop SUEMA, vol. 2008, pp. 5–10 (2008)
Nishida, K., Yamauchi, K.: Detecting concept drift using statistical testing. In: Corruble, V., Takeda, M., Suzuki, E. (eds.) DS 2007. LNCS (LNAI), vol. 4755, pp. 264–269. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-75488-6_27
Page, E.: Continuous inspection schemes. Biometrika 41, 100–115 (1954)
Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85(3), 333–359 (2011)
Ross, G.J., Adams, N.M., Tasoulis, D.K., Hand, D.J.: Exponentially weighted moving average charts for detecting concept drift. Pattern Recogn. Lett. 33(2), 191–198 (2012)
Vorburger, P., Bernstein, A.: Entropy-based concept shift detection. In: ICDM, pp. 1113–1118 (2006)
Wang, H., Fan, W., Yu, P.S., Han, J.: Mining concept-drifting data streams using ensemble classifiers. In: ACM SIGKDD, pp. 226–235 (2003)
Yates, F.: Contingency tables involving small numbers and the \(\chi ^{2}\) test. Suppl. J. Roy. Stat. Soc. 1, 217–235 (1934)
Acknowledgments
This work is supported by the National Natural Science Foundation of China (61976044, 52079026), and Sichuan Science and Technology Program (2022YFG0260, 2020YFH0037).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Shao, J., Wang, K., Lu, J., Qin, Z., Wangyang, Q., Yang, Q. (2022). Learning Evolving Concepts with Online Class Posterior Probability. In: Bhattacharya, A., et al. Database Systems for Advanced Applications. DASFAA 2022. Lecture Notes in Computer Science, vol 13246. Springer, Cham. https://doi.org/10.1007/978-3-031-00126-0_47
Download citation
DOI: https://doi.org/10.1007/978-3-031-00126-0_47
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-00125-3
Online ISBN: 978-3-031-00126-0
eBook Packages: Computer ScienceComputer Science (R0)