Skip to main content

Critiquing with Confidence

  • Conference paper
Case-Based Reasoning Research and Development (ICCBR 2005)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3620))

Included in the following conference series:

Abstract

The ability of a CBR system to evaluate its own confidence in a proposed solution is likely to have an important impact on its problem solving and reasoning ability; if nothing else it allows a system to respond with “I don’t know” instead of suggesting poor solutions. This ability is especially important in interactive CBR recommender systems because to be successful these systems must build trust with their users. This often means helping users to understand the reasons behind a particular recommendation, and presenting them with explanations, and confidence information is an important way to achieve this. In this paper we propose an explicit model of confidence for conversational recommendation systems. We explain how confidence can be evaluated at the feature-level, during each cycle of a recommendation session, and how this can be effectively communicated to the user. In turn, we also show how case-level confidence can be usefully incorporated into the recommendation logic to guide the recommender in the direction of more confident suggestions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aha, D.W., Breslow, L.A., Mun̂oz-Avila, H.: Conversational Case-based Reasoning. Applied Intelligence 14(1), 9–32 (2001)

    Article  MATH  Google Scholar 

  2. Allen, J., Ferguson, G., Stent, A.: An Architecture for More Realistic Conversational Systems. In: Proceedings of Intelligent User Interfaces 2001 (IUI-01), Santa Fe, NM, pp. 1–8 (2001)

    Google Scholar 

  3. Bridge, D.: Product Recommendation Systems: A New Direction. In: Aha, D., Watson, I. (eds.) Workshop on CBR in Electronic Commerce at The International Conference on Case-Based Reasoning (ICCBR 2001), Vancouver, Canada (2001)

    Google Scholar 

  4. Burke, R.: Interactive Critiquing for Catalog Navigation in E-Commerce. Artificial Intelligence Review 18(3-4), 245–267 (2002)

    Article  Google Scholar 

  5. Burke, R., Hammond, K., Young, B.C.: The FindMe Approach to Assisted Browsing. Journal of IEEE Expert 12(4), 32–40 (1997)

    Article  Google Scholar 

  6. Cheetham, W.: Case-Based Reasoning with Confidence. Ph.D. Thesis, Rensselaer Polytechnic Institute (1996)

    Google Scholar 

  7. Cheetham, W.: Case-Based Reasoning with Confidence. In: Blanzieri, E., Portinale, L. (eds.) EWCBR 2000. LNCS (LNAI), vol. 1898, pp. 15–25. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  8. Cheetham, W.: Benefits of Case-Based Reasoning in Color Matching. In: Aha, D.W., Watson, I. (eds.) ICCBR 2001. LNCS (LNAI), vol. 2080, pp. 589–596. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  9. Cheetham, W., Price, J.: Measures of Solution Accuracy in Case-Based Reasoning Systems. In: Funk, P., González Calero, P.A. (eds.) ECCBR 2004. LNCS (LNAI), vol. 3155, pp. 106–118. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  10. Doyle, M., Cunningham, P.: A Dynamic Approach to Reducing Dialog in On-Line Decision Guides. In: Blanzieri, E., Portinale, L. (eds.) EWCBR 2000. LNCS (LNAI), vol. 1898, pp. 49–60. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  11. Faltings, B., Pu, P., Torrens, M., Viappiani, P.: Designing Example-Critiquing Interaction. In: Proceedings of the International Conference on Intelligent User Interface(IUI-2004), Funchal, Madeira, Portugal, pp. 22–29. ACM Press, New York (2004)

    Chapter  Google Scholar 

  12. Göker, M., Thompson, C.: Personalized Conversational Case-based Recommendation. In: Blanzieri, E., Portinale, L. (eds.) EWCBR 2000. LNCS (LNAI), vol. 1898, pp. 99–111. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  13. Hammond, K.J.: CHEF: A Model of Case-Based Blanning. In: Proceedings of AAAI 1986. AAAI Press/MIT Press, Cambridge (1986)

    Google Scholar 

  14. Harmon, M.E.: Reinforcement Learning: A Tutorial (1996)

    Google Scholar 

  15. Herlocker, J.L., Konstan, J.A., Riedl, J.: Explaining Collaborative Filtering Recommendations. In: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 241–250. ACM Press, New York (2000)

    Chapter  Google Scholar 

  16. Massie, S., Craw, S., Wiratunga, N.: Visualisation of Case-Based Reasoning for Explanation. In: Proceedings of the the Explanation Workshop of the Seventh European Conference on Case-Based Reasoning (ECCBR 2004), Madrid, Spain, pp. 135–144 (2004)

    Google Scholar 

  17. McGinty, L., Smyth, B.: Comparison-Based Recommendation. In: Craw, S., Preece, A.D. (eds.) ECCBR 2002. LNCS (LNAI), vol. 2416, pp. 575–589. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  18. McGinty, L., Smyth, B.: Tweaking Critiquing. In: Proceedings of the Workshop on Personalization and Web Techniques at the International Joint Conference on Artificial Intelligence (IJCAI 2003), Acapulco, Mexico. Morgan-Kaufmann, San Francisco (2003)

    Google Scholar 

  19. McLaren, B., Ashley, K.: Helping a CBR Program Know What It Knows. In: Aha, D.W., Watson, I. (eds.) ICCBR 2001. LNCS (LNAI), vol. 2080, pp. 377–391. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  20. McSherry, D.: Minimizing Dialog Length in Interactive Case-based Reasoning. In: Nebel, B. (ed.) Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI 2001), Seattle, Washington, pp. 993–998. Morgan Kaufmann, San Francisco (2001)

    Google Scholar 

  21. McSherry, D.: Explanation in Case-based Reasoning: An Evidential Approach. In: Lees, B. (ed.) Proceedings of the Eighth UK Workshop on Case-Based Reasoning (UKCBR 2003), pp. 47–55 (2003)

    Google Scholar 

  22. Nguyen, Q.N., Ricci, F., Cavada, D.: User Preferences Initialization and Integration in Critique-Based Mobile Recommender Systems. In: Proceedings of Artificial Intelligence in Mobile Systems 2004, in conjunction with UbiComp 2004, pp. 71–78. Iniversitat des Saarlandes Press, Nottingham (2004)

    Google Scholar 

  23. Nugent, C., Cunningham, P.: A Case-Based Explanation System for ’Black-Box’ Systems. In: Proceedings of the Explanation Workshop of the 7th European Conference on Case-Based Reasoning (ECCBR 2004), Madrid, Spain, pp. 155–164 (2004)

    Google Scholar 

  24. Pu, P., Faltings, B.: Decision Tradeoff Using Example Critiquing and Constraint Programming. Special Issue on User-Interaction in Constraint Satisfaction. CONSTRAINTS: an International Journal 9(4) (2004)

    Google Scholar 

  25. Pu, P., Faltings, B., Torrens, M.: User-Involved Preference Elicitation. In: Proceedings of the Workshop on Configuration at the Eighteenth International Joint Conference on Artificial Intelligence (IJCAI 2003), Acapulco, Mexico (2003)

    Google Scholar 

  26. Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)

    Google Scholar 

  27. Reilly, J., McCarthy, K., McGinty, L., Smyth, B.: Dynamic Critiquing. In: Funk, P., González Calero, P.A. (eds.) ECCBR 2004. LNCS (LNAI), vol. 3155, pp. 763–777. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  28. Reilly, J., McCarthy, K., McGinty, L., Smyth, B.: Incremental Critiquing. In: Bramer, M., Coenen, F., Allen, T. (eds.) Research and Development in Intelligent Systems XXI. Proceedings of AI 2004, pp. 101–114. Springer, Cambridge (2004)

    Google Scholar 

  29. Schafer, J.B., Konstan, J.A., Riedl, J.: E-Commerce Recommendation Applications. Data Mining and Knowledge Discovery 5(1/2), 115–153 (2001)

    Article  MATH  Google Scholar 

  30. Shimazu, H., Shibata, A., Nihei, K.: ExpertGuide: A Conversational Case-based Reasoning Tool for Developing Mentors in Knowledge Spaces. Applied Intelligence 14(1), 33–48 (2002)

    Article  Google Scholar 

  31. Smyth, B., McGinty, L.: An Analysis of Feedback Strategies in Conversational Recommender Systems. In: Cunningham, P. (ed.) Proceedings of the Fourteenth National Conference on Artificial Intelligence and Cognitive Science (AICS 2003), Dublin, Ireland (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Reilly, J., Smyth, B., McGinty, L., McCarthy, K. (2005). Critiquing with Confidence. In: Muñoz-Ávila, H., Ricci, F. (eds) Case-Based Reasoning Research and Development. ICCBR 2005. Lecture Notes in Computer Science(), vol 3620. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11536406_34

Download citation

  • DOI: https://doi.org/10.1007/11536406_34

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-28174-0

  • Online ISBN: 978-3-540-31855-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics