Abstract
The quality of case retrieval in case-based reasoning (CBR) systems depends on assigning appropriate case indices. Defining feature vocabularies for indexing is an important knowledge acquisition problem for CBR, often addressed by hand. The manual process may result in high-quality vocabularies, but at considerable effort and expense, and it may be difficult for non-symbolic input such as images. Recently, the ability of deep learning (DL) to identify important features has made it appealing for learning to assign case features. However, such methods may miss features apparent to knowledge engineers. This paper presents a case study on methods for combining benefits of both engineered and DL-generated features. It considers case-based classification of cases described by both symbolic features and images. It evaluates the power of both types of features individually, examines how quality of engineered feature information affects their combined benefit, and tests network methods to generate weights for their combination. Experimental results show that in the test domain under suitable circumstances, the combined approach can outperform either method individually.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aha, D., Kibler, D., Albert, M.: Instance-based learning algorithms. Mach. Learn. 6(1), 37–66 (1991)
Barletta, R., Mark, W.: Explanation-based indexing of cases. In: Kolodner, J. (ed.) Proceedings of a Workshop on Case-Based Reasoning, pp. 50–60. DARPA, Morgan Kaufmann, Palo Alto (1988)
Bhatta, S., Goel, A.: Model-based learning of structural indices to design cases. In: Proceedings of the IJCAI-93 Workshop on Reuse of Design, Chambery, France, pp. A1–A13. IJCAI (1993)
Bonzano, A., Cunningham, P., Smyth, B.: Using introspective learning to improve retrieval in CBR: a case study in air traffic control. In: Leake, D.B., Plaza, E. (eds.) ICCBR 1997. LNCS, vol. 1266, pp. 291–302. Springer, Heidelberg (1997). https://doi.org/10.1007/3-540-63233-6_500
Cox, M., Ram, A.: Introspective multistrategy learning: on the construction of learning strategies. Artif. Intell. 112(1–2), 1–55 (1999)
Domeshek, E.: Indexing stories as social advice. In: Proceedings of the Ninth National Conference on Artificial Intelligence, pp. 16–21. AAAI Press, Menlo Park (1991)
Fox, S., Leake, D.: Introspective reasoning for index refinement in case-based reasoning. J. Exp. Theor. Artif. Intell. 13(1), 63–88 (2001)
Grace, K., Maher, M.L., Wilson, D.C., Najjar, N.A.: Combining CBR and deep learning to generate surprising recipe designs. In: Goel, A., Díaz-Agudo, M.B., Roth-Berghofer, T. (eds.) ICCBR 2016. LNCS (LNAI), vol. 9969, pp. 154–169. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-47096-2_11
Hegdal, S., Kofod-Petersen, A.: A CBR-ANN hybrid for dynamic environments. In: Proceedings of the ICCBR 2019 Workshop on Case-Based Reasoning and Deep Learning, September 2019
Kenny, E.M., Keane, M.T.: Twin-systems to explain artificial neural networks using case-based reasoning: comparative tests of feature-weighting methods in ANN-CBR twins for XAI. In: Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (2019)
Kolodner, J.: Case-Based Reasoning. Morgan Kaufmann, San Mateo (1993)
Kraska, T., Beutel, A., Chi, E.H., Dean, J., Polyzotis, N.: The case for learned index structures. In: Sensors, pp. 489–504 (2019)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, vol. 1, pp. 1097–1105 (2012)
Leake, D.: An indexing vocabulary for case-based explanation. In: Proceedings of the Ninth National Conference on Artificial Intelligence, pp. 10–15. AAAI Press, Menlo Park, July 1991
López de Mántaras, R., et al.: Retrieval, reuse, revision, and retention in CBR. Knowl. Eng. Rev. 20(3) (2005)
Martin, K., Wiratunga, N., Sani, S., Massie, S., Clos, J.: A convolutional Siamese network for developing similarity knowledge in the selfBACK dataset. In: Sanchez-Ruiz, A.A., Kofod-Petersen, A. (eds.) Proceedings of the ICCBR 2017 Workshop on Case-Based Reasoning and Deep Learning, pp. 85–94. CEUR Workshop Proceedings (2017)
Mathisen, B.M., Aamodt, A., Bach, K., Langseth, H.: Learning similarity measures from data. Progress Artif. Intell. 9, 129–143 (2019)
Nasiri, S., Helsper, J.F., Jung, M., Fathi, M.: Enriching a CBR recommender system by classification of skin lesions using deep neural networks. In: Proceedings of the ICCBR 2018 Workshop on Case-Based Reasoning and Deep Learning, July 2018
Recio-García, J.A., Díaz-Agudo, B., Pino-Castilla, V.: CBR-LIME: a case-based reasoning approach to provide specific local interpretable model-agnostic explanations. In: Watson, I., Weber, R. (eds.) ICCBR 2020. LNCS (LNAI), vol. 12311, pp. 179–194. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58342-2_12
Samakovitis, G., Petridis, M., Lansley, M., Polatidis, N., Kapetanakis, S., Amin, K.: Seen the villains: detecting social engineering attacks using case-based reasoning and deep learning. In: Proceedings of the ICCBR 2019 Workshop on Case-Based Reasoning and Deep Learning, pp. 39–48 (2019)
Sani, S., Wiratunga, N., Massie, S.: Learning deep features for kNN-based human activity recognition. In: Proceedings of ICCBR 2017 Workshops (CAW, CBRDL, PO-CBR), Doctoral Consortium, and Competitions co-located with the 25th International Conference on Case-Based Reasoning (ICCBR 2017), Trondheim, Norway, 26–28 June 2017. CEUR Workshop Proceedings, vol. 2028, pp. 95–103. CEUR-WS.org (2017)
Schank, R., et al.: Towards a general content theory of indices. In: Proceedings of the 1990 AAAI Spring Symposium on Case-Based Reasoning. AAAI Press, Menlo Park (1990)
Tabian, I., Fu, H., Khodaei, Z.S.: A convolutional neural network for impact detection and characterization of complex composite structures. In: IEEE Trans. Pattern Anal. Mach. Intell. (T-PAMI) 19 (2018)
Turner, J.T., Floyd, M.W., Gupta, K.M., Aha, D.W.: Novel object discovery using case-based reasoning and convolutional neural networks. In: Cox, M.T., Funk, P., Begum, S. (eds.) ICCBR 2018. LNCS (LNAI), vol. 11156, pp. 399–414. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01081-2_27
Wettschereck, D., Aha, D., Mohri, T.: A review and empirical evaluation of feature-weighting methods for a class of lazy learning algorithms. Artif. Intell. Rev. 11(1–5), 273–314 (1997)
Xian, Y., Lampert, C.H., Schiele, B., Akata, Z.: Zero-shot learning - a comprehensive evaluation of the good, the bad and the ugly. IEEE Trans. Pattern Anal. Mach. Intell. (T-PAMI) 40, 1–14 (2018)
Acknowledgments
We acknowledge support from the Department of the Navy, Office of Naval Research (Award N00014-19-1-2655), and the US Department of Defense (Contract W52P1J2093009).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Wilkerson, Z., Leake, D., Crandall, D.J. (2021). On Combining Knowledge-Engineered and Network-Extracted Features for Retrieval. In: Sánchez-Ruiz, A.A., Floyd, M.W. (eds) Case-Based Reasoning Research and Development. ICCBR 2021. Lecture Notes in Computer Science(), vol 12877. Springer, Cham. https://doi.org/10.1007/978-3-030-86957-1_17
Download citation
DOI: https://doi.org/10.1007/978-3-030-86957-1_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86956-4
Online ISBN: 978-3-030-86957-1
eBook Packages: Computer ScienceComputer Science (R0)