Abstract
Case-based Reasoning (CBR) solves a new problem by retrieving a stored case for a similar problem and adapting its solution to fit. Acquiring the required case adaptation knowledge is a classic problem. A popular method for addressing it is the case difference heuristic (CDH) approach, which learns adaptations from pairs of cases based on their problem differences and solution differences. The CDH approach was originally used to generate adaptation rules, but recent CBR research on case-based regression has investigated replacing learning rules with learning CDH-based network models for adaptation. This paper presents and evaluates a neural network-based CDH approach for learning adaptation models for classification, C-NN-CDH. It examines three variants, (1) training a single neural network on problem-solution differences, (2) segmenting adaptation knowledge by the classes of source cases, with a separate neural network to generate adaptations for each class, and (3) adapting from an ensemble of source cases and taking the majority vote. Experimental results demonstrate improved performance compared to previous research on statistical methods for computing CDH differences for classification. Additional results support that C-NN-CDH achieves classification performance comparable to that of multiple classic classification approaches.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Aamodt, A., Plaza, E.: Case-based reasoning: foundational issues, methodological variations, and system approaches. AI Commun. 7(1), 39–52 (1994)
Aly, M.: Survey on multiclass classification methods. Technical report, Caltech (2005)
Badra, F., Cordier, A., Lieber, J.: Opportunistic adaptation knowledge discovery. In: McGinty, L., Wilson, D.C. (eds.) ICCBR 2009. LNCS (LNAI), vol. 5650, pp. 60–74. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02998-1_6
Corchado, J.M., Lees, B.: Adaptation of cases for case based forecasting with neural network support. In: Pal, S.K., Dillon, T.S., Yeung, D.S. (eds.) Soft Computing in Case Based Reasoning, pp. 293–319. Springer, London (2001). https://doi.org/10.1007/978-1-4471-0687-6_13
Craw, S., Wiratunga, N., Rowe, R.: Learning adaptation knowledge to improve case-based reasoning. Artif. Intell. 170, 1175–1192 (2006)
Cunningham, P., Doyle, D., Loughrey, J.: An evaluation of the usefulness of case-based explanation. In: Ashley, K.D., Bridge, D.G. (eds.) ICCBR 2003. LNCS (LNAI), vol. 2689, pp. 122–130. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-45006-8_12
Dua, D., Graff, C.: UCI machine learning repository (2017)
D’Aquin, M., Badra, F., Lafrogne, S., Lieber, J., Napoli, A., Szathmary, L.: Case base mining for adaptation knowledge acquisition. In: Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI-07), pp. 750–755. Morgan Kaufmann, San Mateo (2007)
Fuchs, B., Lieber, J., Mille, A., Napoli, A.: Differential adaptation: an operational approach to adaptation for solving numerical problems with CBR. Knowl.-Based Syst. (2014, in press)
Hanney, K., Keane, M.T.: Learning adaptation rules from a case-base. In: Smith, I., Faltings, B. (eds.) EWCBR 1996. LNCS, vol. 1168, pp. 179–192. Springer, Heidelberg (1996). https://doi.org/10.1007/BFb0020610
Jalali, V., Leake, D.: Enhancing case-based regression with automatically-generated ensembles of adaptations. J. Intell. Inf. Syst. 46(2), 237–258 (2015). https://doi.org/10.1007/s10844-015-0377-0
Jalali, V., Leake, D., Forouzandehmehr, N.: Learning and applying case adaptation rules for classification: an ensemble approach. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, pp. 4874–4878 (2017)
Keane, M.T., Smyth, B.: Good counterfactuals and where to find them: a case-based technique for generating counterfactuals for Explainable AI (XAI). arXiv:2005.13997 (2020)
Kenny, E.M., Keane, M.T.: On generating plausible counterfactual and semi-factual explanations for deep learning. arXiv:2009.06399 (2020)
Kingma, D., Ba, J.: Adam: a method for stochastic optimization. arXiv:1412.6980 (2017)
Leake, D.: CBR in context: the present and future. In: Leake, D. (ed.) Case-Based Reasoning: Experiences, Lessons, and Future Directions, pp. 3–30. AAAI Press, Menlo Park (1996)
Leake, D., Kinley, A., Wilson, D.: Acquiring case adaptation knowledge: a hybrid approach. In: Proceedings of the Thirteenth National Conference on Artificial Intelligence, pp. 684–689. AAAI Press, Menlo Park (1996)
Leake, D., Ye, X., Crandall, D.: Supporting case-based reasoning with neural networks: an illustration for case adaptation. In: AAAI Spring Symposium on Combining Machine Learning and Knowledge Engineering (AAAI-MAKE) (2021)
Liao, C., Liu, A., Chao, Y.: A machine learning approach to case adaptation. In: 2018 IEEE First International Conference on Artificial Intelligence and Knowledge Engineering (AIKE), pp. 106–109 (2018)
López de Mántaras, R., et al.: Retrieval, reuse, revision, and retention in CBR. Knowl. Eng. Rev. 20(3) (2005)
Mark, W., Simoudis, E., Hinkle, D.: Case-based reasoning: expectations and results. In: Leake, D. (ed.) Case-Based Reasoning: Experiences, Lessons, and Future Directions, pp. 269–294. AAAI Press, Menlo Park (1996)
McSherry, D.: An adaptation heuristic for case-based estimation. In: Smyth, B., Cunningham, P. (eds.) EWCBR 1998. LNCS, vol. 1488, pp. 184–195. Springer, Heidelberg (1998). https://doi.org/10.1007/BFb0056332
Nugent, C., Doyle, D., Cunningham, P.: Gaining insight through case-based explanation. J. Intell. Inf. Syst. 32, 267–295 (2009)
Patterson, D., Rooney, N., Galushka, M.: A regression based adaptation strategy for case-based reasoning. In: Proceedings of the Eighteenth National Conference on Artificial Intelligence, pp. 87–92. AAAI, Menlo Park (2002)
Policastro, C., Carvalho, A., Delbem, A.: Automatic knowledge learning and case adaptation with a hybrid committee approach. J. Appl. Log. 4(1), 26–38 (2006)
Riesbeck, C., Schank, R.: Inside Case-Based Reasoning. Lawrence Erlbaum, Hillsdale (1989)
Wetzel, S.J., Ryczko, K., Melko, R.G., Tamblyn, I.: Twin neural network regression. arXiv:2012.14873 (2020)
Ye, X.: The enemy of my enemy is my friend: class-to-class weighting in k-nearest neighbors algorithm. In: Proceedings of the Thirty-First International Florida Artificial Intelligence Research Society Conference, FLAIRS 2018, pp. 389–394 (2018)
Ye, X.: C2C trace retrieval: fast classification using class-to-class weighting. In: Proceedings of the Thirty-Second International Florida Artificial Intelligence Research Society Conference, FLAIRS 2019, pp. 353–358 (2019)
Ye, X., Leake, D., Huibregtse, W., Dalkilic, M.: Applying class-to-class Siamese networks to explain classifications with supportive and contrastive cases. In: Watson, I., Weber, R. (eds.) ICCBR 2020. LNCS (LNAI), vol. 12311, pp. 245–260. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58342-2_16
Zhang, C., Liu, C., Zhang, X., Almpanidis, G.: An up-to-date comparison of state-of-the-art classification algorithms. Expert Syst. Appl. 82 (2017)
Zhang, F., Ha, M., Wang, X., Li, X.: Case adaptation using estimators of neural network. In: Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826), vol. 4, pp. 2162–2166, August 2004
Acknowledgments
We acknowledge support from the Department of the Navy, Office of Naval Research (Award N00014-19-1-2655), and the US Department of Defense (Contract W52P1J2093009).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Ye, X., Leake, D., Jalali, V., Crandall, D.J. (2021). Learning Adaptations for Case-Based Classification: A Neural Network Approach. In: Sánchez-Ruiz, A.A., Floyd, M.W. (eds) Case-Based Reasoning Research and Development. ICCBR 2021. Lecture Notes in Computer Science(), vol 12877. Springer, Cham. https://doi.org/10.1007/978-3-030-86957-1_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-86957-1_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86956-4
Online ISBN: 978-3-030-86957-1
eBook Packages: Computer ScienceComputer Science (R0)