Skip to main content

Learning Adaptations for Case-Based Classification: A Neural Network Approach

  • Conference paper
  • First Online:
Case-Based Reasoning Research and Development (ICCBR 2021)

Abstract

Case-based Reasoning (CBR) solves a new problem by retrieving a stored case for a similar problem and adapting its solution to fit. Acquiring the required case adaptation knowledge is a classic problem. A popular method for addressing it is the case difference heuristic (CDH) approach, which learns adaptations from pairs of cases based on their problem differences and solution differences. The CDH approach was originally used to generate adaptation rules, but recent CBR research on case-based regression has investigated replacing learning rules with learning CDH-based network models for adaptation. This paper presents and evaluates a neural network-based CDH approach for learning adaptation models for classification, C-NN-CDH. It examines three variants, (1) training a single neural network on problem-solution differences, (2) segmenting adaptation knowledge by the classes of source cases, with a separate neural network to generate adaptations for each class, and (3) adapting from an ensemble of source cases and taking the majority vote. Experimental results demonstrate improved performance compared to previous research on statistical methods for computing CDH differences for classification. Additional results support that C-NN-CDH achieves classification performance comparable to that of multiple classic classification approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Aamodt, A., Plaza, E.: Case-based reasoning: foundational issues, methodological variations, and system approaches. AI Commun. 7(1), 39–52 (1994)

    Article  Google Scholar 

  2. Aly, M.: Survey on multiclass classification methods. Technical report, Caltech (2005)

    Google Scholar 

  3. Badra, F., Cordier, A., Lieber, J.: Opportunistic adaptation knowledge discovery. In: McGinty, L., Wilson, D.C. (eds.) ICCBR 2009. LNCS (LNAI), vol. 5650, pp. 60–74. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02998-1_6

    Chapter  Google Scholar 

  4. Corchado, J.M., Lees, B.: Adaptation of cases for case based forecasting with neural network support. In: Pal, S.K., Dillon, T.S., Yeung, D.S. (eds.) Soft Computing in Case Based Reasoning, pp. 293–319. Springer, London (2001). https://doi.org/10.1007/978-1-4471-0687-6_13

    Chapter  MATH  Google Scholar 

  5. Craw, S., Wiratunga, N., Rowe, R.: Learning adaptation knowledge to improve case-based reasoning. Artif. Intell. 170, 1175–1192 (2006)

    Article  MathSciNet  Google Scholar 

  6. Cunningham, P., Doyle, D., Loughrey, J.: An evaluation of the usefulness of case-based explanation. In: Ashley, K.D., Bridge, D.G. (eds.) ICCBR 2003. LNCS (LNAI), vol. 2689, pp. 122–130. Springer, Heidelberg (2003). https://doi.org/10.1007/3-540-45006-8_12

    Chapter  MATH  Google Scholar 

  7. Dua, D., Graff, C.: UCI machine learning repository (2017)

    Google Scholar 

  8. D’Aquin, M., Badra, F., Lafrogne, S., Lieber, J., Napoli, A., Szathmary, L.: Case base mining for adaptation knowledge acquisition. In: Proceedings of the Twentieth International Joint Conference on Artificial Intelligence (IJCAI-07), pp. 750–755. Morgan Kaufmann, San Mateo (2007)

    Google Scholar 

  9. Fuchs, B., Lieber, J., Mille, A., Napoli, A.: Differential adaptation: an operational approach to adaptation for solving numerical problems with CBR. Knowl.-Based Syst. (2014, in press)

    Google Scholar 

  10. Hanney, K., Keane, M.T.: Learning adaptation rules from a case-base. In: Smith, I., Faltings, B. (eds.) EWCBR 1996. LNCS, vol. 1168, pp. 179–192. Springer, Heidelberg (1996). https://doi.org/10.1007/BFb0020610

    Chapter  Google Scholar 

  11. Jalali, V., Leake, D.: Enhancing case-based regression with automatically-generated ensembles of adaptations. J. Intell. Inf. Syst. 46(2), 237–258 (2015). https://doi.org/10.1007/s10844-015-0377-0

    Article  Google Scholar 

  12. Jalali, V., Leake, D., Forouzandehmehr, N.: Learning and applying case adaptation rules for classification: an ensemble approach. In: Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI 2017, pp. 4874–4878 (2017)

    Google Scholar 

  13. Keane, M.T., Smyth, B.: Good counterfactuals and where to find them: a case-based technique for generating counterfactuals for Explainable AI (XAI). arXiv:2005.13997 (2020)

  14. Kenny, E.M., Keane, M.T.: On generating plausible counterfactual and semi-factual explanations for deep learning. arXiv:2009.06399 (2020)

  15. Kingma, D., Ba, J.: Adam: a method for stochastic optimization. arXiv:1412.6980 (2017)

  16. Leake, D.: CBR in context: the present and future. In: Leake, D. (ed.) Case-Based Reasoning: Experiences, Lessons, and Future Directions, pp. 3–30. AAAI Press, Menlo Park (1996)

    Google Scholar 

  17. Leake, D., Kinley, A., Wilson, D.: Acquiring case adaptation knowledge: a hybrid approach. In: Proceedings of the Thirteenth National Conference on Artificial Intelligence, pp. 684–689. AAAI Press, Menlo Park (1996)

    Google Scholar 

  18. Leake, D., Ye, X., Crandall, D.: Supporting case-based reasoning with neural networks: an illustration for case adaptation. In: AAAI Spring Symposium on Combining Machine Learning and Knowledge Engineering (AAAI-MAKE) (2021)

    Google Scholar 

  19. Liao, C., Liu, A., Chao, Y.: A machine learning approach to case adaptation. In: 2018 IEEE First International Conference on Artificial Intelligence and Knowledge Engineering (AIKE), pp. 106–109 (2018)

    Google Scholar 

  20. López de Mántaras, R., et al.: Retrieval, reuse, revision, and retention in CBR. Knowl. Eng. Rev. 20(3) (2005)

    Google Scholar 

  21. Mark, W., Simoudis, E., Hinkle, D.: Case-based reasoning: expectations and results. In: Leake, D. (ed.) Case-Based Reasoning: Experiences, Lessons, and Future Directions, pp. 269–294. AAAI Press, Menlo Park (1996)

    Google Scholar 

  22. McSherry, D.: An adaptation heuristic for case-based estimation. In: Smyth, B., Cunningham, P. (eds.) EWCBR 1998. LNCS, vol. 1488, pp. 184–195. Springer, Heidelberg (1998). https://doi.org/10.1007/BFb0056332

    Chapter  Google Scholar 

  23. Nugent, C., Doyle, D., Cunningham, P.: Gaining insight through case-based explanation. J. Intell. Inf. Syst. 32, 267–295 (2009)

    Article  Google Scholar 

  24. Patterson, D., Rooney, N., Galushka, M.: A regression based adaptation strategy for case-based reasoning. In: Proceedings of the Eighteenth National Conference on Artificial Intelligence, pp. 87–92. AAAI, Menlo Park (2002)

    Google Scholar 

  25. Policastro, C., Carvalho, A., Delbem, A.: Automatic knowledge learning and case adaptation with a hybrid committee approach. J. Appl. Log. 4(1), 26–38 (2006)

    Article  Google Scholar 

  26. Riesbeck, C., Schank, R.: Inside Case-Based Reasoning. Lawrence Erlbaum, Hillsdale (1989)

    Google Scholar 

  27. Wetzel, S.J., Ryczko, K., Melko, R.G., Tamblyn, I.: Twin neural network regression. arXiv:2012.14873 (2020)

  28. Ye, X.: The enemy of my enemy is my friend: class-to-class weighting in k-nearest neighbors algorithm. In: Proceedings of the Thirty-First International Florida Artificial Intelligence Research Society Conference, FLAIRS 2018, pp. 389–394 (2018)

    Google Scholar 

  29. Ye, X.: C2C trace retrieval: fast classification using class-to-class weighting. In: Proceedings of the Thirty-Second International Florida Artificial Intelligence Research Society Conference, FLAIRS 2019, pp. 353–358 (2019)

    Google Scholar 

  30. Ye, X., Leake, D., Huibregtse, W., Dalkilic, M.: Applying class-to-class Siamese networks to explain classifications with supportive and contrastive cases. In: Watson, I., Weber, R. (eds.) ICCBR 2020. LNCS (LNAI), vol. 12311, pp. 245–260. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58342-2_16

    Chapter  Google Scholar 

  31. Zhang, C., Liu, C., Zhang, X., Almpanidis, G.: An up-to-date comparison of state-of-the-art classification algorithms. Expert Syst. Appl. 82 (2017)

    Google Scholar 

  32. Zhang, F., Ha, M., Wang, X., Li, X.: Case adaptation using estimators of neural network. In: Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826), vol. 4, pp. 2162–2166, August 2004

    Google Scholar 

Download references

Acknowledgments

We acknowledge support from the Department of the Navy, Office of Naval Research (Award N00014-19-1-2655), and the US Department of Defense (Contract W52P1J2093009).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Leake .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ye, X., Leake, D., Jalali, V., Crandall, D.J. (2021). Learning Adaptations for Case-Based Classification: A Neural Network Approach. In: Sánchez-Ruiz, A.A., Floyd, M.W. (eds) Case-Based Reasoning Research and Development. ICCBR 2021. Lecture Notes in Computer Science(), vol 12877. Springer, Cham. https://doi.org/10.1007/978-3-030-86957-1_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-86957-1_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-86956-4

  • Online ISBN: 978-3-030-86957-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics