Abstract
A comprehensive methodology for evaluating a user model presents challenges in choosing metrics and in assessing usefulness from both user and system perspectives. In this paper, we describe such a methodology and use it to assess the effectiveness of an adaptive user model embedded in a medical information retrieval. We demonstrate that the user model helps to improve the retrieval quality without degrading the system performance and identify usability problems overlooked in the user model architecture. Empirical data help us in analyzing drawbacks in our user model and develop solutions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Brajnik G.; Mizzaro S.; and Tasso C. 1996. Evaluating User Interfaces to Information Retrieval Systems. In Proceedings of SIGIR 96. 128–136.
Chin N. David. 2001. Empirical Evaluation of User Models and User-Adapted Systems. In User Modeling and User-Adapted Interaction. Vol 11. 181–194.
Harter S. P.; and Hert C. A. 1997. Evaluation of Information Retrieval Systems: Approaches, Issues and Methods. In Annual Review of Information Science and Technology. Vol 32. 3–94.
Hart, S. G.; and Staveland, L. E. 1988. Development of the NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. InHuman Mental Workload, Hancock, P. and Meshkati, N. (Ed.). North Holland B.V., Amsterdam. 139–183
Koenemann, J.; and Belkin, N. 1996. A case for interaction: a study of interactive information retrieval behavior and effectiveness. In Proceedings of CHI 96. 205–212.
McLeod, M.; Bowden, R., Bevan, N. 1997. The MUSiC Performance Measurement Method. Behaviour and Information Technology. Volume 16(4). 279–293.
Santos E. Jr.; Nguyen H.; and Brown M.S. 2001. Kavanah: An active user interface Information Retrieval Application. In Proceedings of 2nd Asia-Pacific Conference on Intelligent Agent Technology. 412–423.
Salton, G.; and McGill, M. 1983. Introduction to Modern Information Retrieval. McGraw-Hill Book Company.
Shneiderman, B. 1998. Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Santos, E., Nguyen, H., Zhao, Q., Pukinskis, E. (2003). Empirical Evaluation of Adaptive User Modeling in a Medical Information Retrieval Application. In: Brusilovsky, P., Corbett, A., de Rosis, F. (eds) User Modeling 2003. UM 2003. Lecture Notes in Computer Science(), vol 2702. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44963-9_39
Download citation
DOI: https://doi.org/10.1007/3-540-44963-9_39
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40381-4
Online ISBN: 978-3-540-44963-8
eBook Packages: Springer Book Archive