Abstract
Case-based reasoning (CBR) is a problem-solving and learning methodology that applies records of past experiences, captured as cases, to solve new problems. The performance of CBR depends on retrieving cases relevant to each new problem that the reasoner encounters. In real-world applications, the distribution of problems can change over time, which can cause an issue for the competence and efficiency of CBR systems. This paper proposes addressing this issue through predictive case discovery, which involves predicting cases expected to be useful for future problems to acquire them in advance. It presents an overview of case discovery for problem-distribution drift, including the challenges involved, proposed strategies, and future research directions. It illustrates with a case study evaluating a clustering-based case discovery strategy in a path planning domain across four scenarios: no drift, non-cyclical drift, cyclical drift, and drift from obsolescence.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alippi, C., Roveri, M.: Just-in-time adaptive classifiers-part I: detecting nonstationary changes. IEEE Trans. Neural Netw. 19(7), 1145–1153 (2008)
Bifet, A., Gavalda, R.: Learning from time-changing data with adaptive windowing. In: Proceedings of the 2007 SIAM International Conference on Data Mining, pp. 443–448. SIAM (2007)
Cunningham, P., Nowlan, N., Delany, S., Haahr, M.: A case-based approach to spam filtering that can track concept drift. Technicaal report TCD-CS-2003-16, Computer Science Department, Trinity College Dublin (2003)
Dasu, T., Krishnan, S., Venkatasubramanian, S., Yi, K.: An information-theoretic approach to detecting changes in multi-dimensional data streams. In: Proceedings of Symposium on the Interface of Statistics, Computing Science, and Applications (Interface) (2006)
Delany, S.J., Cunningham, P., Tsymbal, A., Coyle, L.: A case-based technique for tracking concept drift in spam filtering. In: Macintosh, A., Ellis, R., Allen, T. (eds.) SGAI 2004, pp. 3–16. Springer, London (2005). https://doi.org/10.1007/1-84628-103-2_1
Fernández, A., Garcia, S., Herrera, F., Chawla, N.V.: Smote for learning from imbalanced data: progress and challenges, marking the 15-year anniversary. J. Artif. Intell. Res. 61, 863–905 (2018)
Hodál, J., Dvorák, J.: Using case-based reasoning for mobile robot path planning. Eng. Mech. 15(3), 181–191 (2008)
Hoens, T.R., Polikar, R., Chawla, N.V.: Learning from streaming data with concept drift and imbalance: an overview. Progr. Artif. Intell. 1(1), 89–101 (2012)
Iwana, B.K., Uchida, S.: An empirical survey of data augmentation for time series classification with neural networks. PLoS ONE 16(7), e0254841 (2021)
Kantchelian, A., et al.: Approaches to adversarial drift. In: Proceedings of the 2013 ACM Workshop on Artificial Intelligence and Security, pp. 99–110 (2013)
Köppen, M.: The curse of dimensionality. In: 5th Online World Conference on Soft Computing in Industrial Applications (WSC5), vol. 1, pp. 4–8 (2000)
Leake, D., Kinley, A., Wilson, D.: Learning to integrate multiple knowledge sources for case-based reasoning. In: Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence, pp. 246–251. Morgan Kaufmann (1997)
Leake, D., Schack, B.: Exploration vs. exploitation in case-base maintenance: leveraging competence-based deletion with ghost cases. In: Cox, M.T., Funk, P., Begum, S. (eds.) ICCBR 2018. LNCS (LNAI), vol. 11156, pp. 202–218. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01081-2_14
Leake, D.B., Wilson, D.C.: When experience is wrong: examining CBR for changing tasks and environments. In: Althoff, K.-D., Bergmann, R., Branting, L.K. (eds.) ICCBR 1999. LNCS, vol. 1650, pp. 218–232. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48508-2_16
Leake, D., Ye, X.: Harmonizing case retrieval and adaptation with alternating optimization. In: Sánchez-Ruiz, A.A., Floyd, M.W. (eds.) ICCBR 2021. LNCS (LNAI), vol. 12877, pp. 125–139. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-86957-1_9
López de Mántaras, R., et al.: Retrieval, reuse, revision, and retention in CBR. Knowl. Eng. Rev. 20(3) (2005)
Lu, J., Liu, A., Dong, F., Gu, F., Gama, J., Zhang, G.: Learning under concept drift: a review. IEEE Trans. Knowl. Data Eng. 31(12), 2346–2363 (2019)
Lu, N., Zhang, G., Lu, J.: Concept drift detection via competence models. Artif. Intell. 209, 11–28 (2014)
Massie, S., Craw, S., Wiratunga, N.: Complexity-guided case discovery for case based reasoning. In: AAAI 2005: Proceedings of the 20th National Conference on Artificial Intelligence, pp. 216–221. AAAI Press (2005)
McKenna, E., Smyth, B.: Competence-guided case discovery. In: Bramer, M., Coenen, F., Preece, A. (eds.) Research and Development in Intelligent Systems XVIII, pp. 97–108. Springer, London (2002). https://doi.org/10.1007/978-1-4471-0119-2_8
McSherry, D.: Automating case selection in the construction of a case library. In: Bramer, M., Macintosh, A., Coenen, F. (eds.) Research and Development in Intelligent Systems XVI, pp. 163–177. Springer, London (2000). https://doi.org/10.1007/978-1-4471-0745-3_11
McSherry, D.: Intelligent case-authoring support in casemaker-2. Comput. Intell. 17(2), 331–345 (2001)
Mehdi Owrang, O.M.: Case discovery in case-based reasoning systems. Inf. Syst. Manage. 15(1), 74–78 (1998)
Smyth, B., Keane, M.: Adaptation-guided retrieval: questioning the similarity assumption in reasoning. Artif. Intell. 102(2), 249–293 (1998)
Smyth, B., McKenna, E.: Competence models and the maintenance problem. Comput. Intell. 17, 235–249 (2001)
Smyth, B.: Case-base maintenance. In: Pasqual del Pobil, A., Mira, J., Ali, M. (eds.) IEA/AIE 1998. LNCS, vol. 1416, pp. 507–516. Springer, Heidelberg (1998). https://doi.org/10.1007/3-540-64574-8_436
Smyth, B., Cunningham, P.: The utility problem analysed: a case-based reasoning perspective. In: Smith, I., Faltings, B. (eds.) EWCBR 1996. LNCS, vol. 1168, pp. 392–399. Springer, Heidelberg (1996). https://doi.org/10.1007/BFb0020625
Smyth, B., Keane, M.T.: Remembering to forget. In: Proceedings of the 14th International Joint Conference on Artificial Intelligence, pp. 377–382. Citeseer (1995)
Smyth, B., McKenna, E.: Competence models and the maintenance problem. Comput. Intell. 17(2), 235–249 (2001)
Vasudevan, C., Ganesan, K.: Case-based path planning for autonomous underwater vehicles. Auton. Robot. 3(2–3), 79–89 (1996)
Veloso, M.: Planning and Learning by Analogical Reasoning. Springer, Berlin (1994). https://doi.org/10.1007/3-540-58811-6
Widmer, G., Kubat, M.: Learning in the presence of concept drift and hidden contexts. Mach. Learn. 23(1), 69–101 (1996)
Acknowledgments
This work was funded in part by the Department of the Navy, Office of Naval Research (Award N00014-19-1-2655).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Leake, D., Schack, B. (2023). Towards Addressing Problem-Distribution Drift with Case Discovery. In: Massie, S., Chakraborti, S. (eds) Case-Based Reasoning Research and Development. ICCBR 2023. Lecture Notes in Computer Science(), vol 14141. Springer, Cham. https://doi.org/10.1007/978-3-031-40177-0_16
Download citation
DOI: https://doi.org/10.1007/978-3-031-40177-0_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-40176-3
Online ISBN: 978-3-031-40177-0
eBook Packages: Computer ScienceComputer Science (R0)