Keith Andrews
ABSTRACT
As more experience is being gained with the evaluation of information visualisation interfaces, weaknesses in current evaluation practice are coming to the fore.This position paper presents an overview of currently used evaluation methods, followed by a discussion of my experiences and lessons learned from a series of studies comparing hierarchy browsers.
- K. Andrews. Human-Computer Interaction: Lecture Notes. 2006. http://courses.iicm.edu/hci/hci.pdf.]]Google Scholar
- K. Andrews, W. Kienreich, V. Sabol, J. Becker, G. Droschl, F. Kappe, M. Granitzer, P. Auer, and K. Tochtermann. The InfoSky Visual Explorer: Exploiting Hierarchical Structure and Document Similarities. Information Visualization, 1(3/4):166--181, December 2002. doi:10.1057/palgrave.ivs.9500023.]] Google ScholarDigital Library
- M. D. Byrne, B. E. John, and E. Joyce. A Day in the Life of Ten WWW Users, 2000. http://citeseer.ist.psu.edu/400156.html. Unpublished paper.]]Google Scholar
- M. D. Byrne, B. E. John, N. S. Wehrle, and D. C. Crow. The Tangled Web We Wove: A Taskonomy of WWW Use. In Proc. Conference on Human Factors in Computing Systems (CHI'99), pages 544--551. ACM, Pittsburgh, Pennsylvania, USA, May 1999. ISBN 0201485591. doi:10.1145/302979.303154.]] Google ScholarDigital Library
- I. Ceaparu, J. Lazar, K. Bessiere, J. Robinson, and B. Shneiderman. Determining Causes and Severity of End-User Frustration. Technical Report CS-TR-4371, University of Maryland, Computer Science Department, May 2003. http://hcil.cs.umd.edu/trs/2002--11/2002--11.pdf. Revised Version.]]Google Scholar
- C. Chen and Y. Yu. Empirical Studies of Information Visualization: A Meta-Analysis. International Journal of Human-Computer Studies, 53(5):851--866, November 2000. doi:10.1109/6.469330.]] Google ScholarDigital Library
- K. A. Ericsson and H. A. Simon. Protocol Analysis: Verbal Reports As Data. MIT Press, revised edition, May 1993. ISBN 0262550237.]]Google Scholar
- J.-D. Fekete and C. Plaisant. Information Visualization Benchmarks Repository. 2003. http://www.cs.umd.edu/hcil/InfovisRepository/contest-2003/.]]Google Scholar
- A. Field. Discovering Statistics Using SPSS for Windows. Sage Publications, 2000. ISBN 0761957553.]] Google ScholarDigital Library
- A. Field and G. Hole. How to Design and Report Experiments. Sage Publications, 2002. ISBN 0761973834.]]Google Scholar
- M. Granitzer, W. Kienreich, V. Sabol, K. Andrews, and W. Klieber. Evaluating a System for Interactive Exploration of Large, Hierarchically Structured Document Repositories. In Proc. IEEE Symposium on Information Visualization (Info Vis 2004), pages 127--134. Austin, Texas, October 2004. doi:10.1109/INFOVIS.2004.19.]] Google ScholarDigital Library
- E. Hetzler and A. Turner. Analysis Experiences Using Information Visualization. IEEE Computer Graphics and Applications, 24(5):22--26, September/October 2004. doi:10.1109/MCG.2004.22.]] Google ScholarDigital Library
- D. M. Hilbert and D. F. Redmiles. Extracting Usability Information from User Interface Events. ACM Computing Surveys, 32(4):384--421, December 2000. doi:10.1145/371578.371593.]] Google ScholarDigital Library
- A. Kobsa. User Experiments with Tree Visualization Systems. In Proc. IEEE Symposium on Information Visualization (Info Vis 2004), pages 9--16. Austin, Texas, USA, October 2004. doi:10.1109/INFVIS.2004.70.]] Google ScholarDigital Library
- J. Kort. CHI2005 Workshop 6 Results. April 2005. http://usage.n1/workshop.html.]]Google Scholar
- J. Kort and H. de Poot. Usage Analysis: Combining Logging and Qualitative Methods. In Proc. CHI2005 Workshop. ACM, Portland, Oregon, USA, April 2005. doi:10.1145/1056808.1057117. http://www.usage.n1/workshop.html.]] Google ScholarDigital Library
- T. Landauer. Research Methods in HCI. In M. G. Helander, editor, Handbook of Human-Computer Interaction, chapter 42, pages 905--928. North-Holland, 1988. ISBN 0444705368.]]Google Scholar
- G. Modes. A Usage Study of Desktop Users: Technical Realisation and Coding Software. Master's thesis, Graz University of Technology, Austria, September 2005.]]Google Scholar
- C. Plaisant. The Challenge of Information Visualization Evaluation. In Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2004), pages 109--116. May 2004. doi:10.1145/989863.989880.]] Google ScholarDigital Library
- W. Putz. The Hierarchical Visualization System: A General Framework for Visualizing Information Hierarchies Using the Example of Information Pyramids. Master's thesis, Graz University of Technology, Austria, March 2005. ftp://ftp.iicm.edu/pub/theses/wputz.pdf.]]Google Scholar
- A. J. Sellen, R. Murphy, and K. L. Shaw. How Knowledge Workers Use the Web. In Proc. Conference on Human Factors in Computing Systems (CHI 2002), pages 227--234. ACM, Minneapolis, Minnesota, USA, April 2002. doi:10.1145/503376.503418.]] Google ScholarDigital Library
Index Terms
- Evaluating information visualisations
Recommendations
On evaluating information visualization techniques
AVI '02: Proceedings of the Working Conference on Advanced Visual InterfacesEvaluating user interfaces is usually accomplished to detect design problems in layout and interaction. One possible way to evaluate image quality in computer graphics is visual inspection by experts. Information visualization techniques are usually ...
Charting the path towards effective knowledge visualisations
SAICSIT '17: Proceedings of the South African Institute of Computer Scientists and Information TechnologistsKnowledge visualisation is enjoying increasing attention from researchers and organisations, due to its potential for expediting knowledge transfer. Despite the availability of many information visualisation guidelines, those who are tasked to produce ...
Evaluating the Information Behaviour methods: Formative evaluations of two methods for assessing the functionality and usability of electronic information resources
The importance of user-centred evaluation is stressed by HCI academics and practitioners alike. However, there have been few recent evaluation studies of User Evaluation Methods (UEMs), especially those with the aim of improving methods rather than ...
Comments