Abstract
In this paper we discuss techniques on how task models can enhance visualization of the usability test log. Evaluation of the usability tests is a traditional method in user centered design. It is a part of the methodology for design of usable products. We developed a tool for visualization of usability logs that uses the hierarchical structure of the task models to group and visualize observers’ annotations. This way of visualization is very natural and allows investigation of the test dynamics and comparison of participant’s behavior in various parts of the test. We also describe methods of visualization of multiple logs that allow for comparison of the test results between participants. For that purpose we present a new visualization method based on alignment of the visual representations of tasks, where binding between the task model and the log visualization is used. Finally, we present an evaluation of our tool on two usability tests, which were conducted in our laboratory and we discuss observed findings.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Badre, A.N., Hudson, S.E., Santos, P.J.: Synchronizing video and event logs for usability studies. In: Costabile, M.F., et al. (eds.) Proceedings of the Workshop on Advanced Visual interfaces, Bari, Italy, June 01 - 04, 1994, pp. 222–224. ACM Press, New York (1994)
CTT Environment: http://giove.cnuce.cnr.it/ctte.html
Forbrig, P., et al.: Model-Based Software Development and Usability Testing. In: Proceedings of INTERACT 2005 Workshop, Rome, Italy, September 13 (2005)
Guzdial, M., et al.: Analyzing and Visualizing Log Files: A Computational Science of Usability. GVU Center TR GIT-GVU-94-8, Georgia Institute of Technology (1994)
Harrison, B.L., Owen, R., Baecker, R.M.: Timelines: An Interactive System for the Collection of Visualization of Temporal Data. In: Proc. of Graphics Interface’94, pp. 141–148. Canadian lnfo. Proc. Society, Toronto (1994)
Jakob Nielsen’s Alertbox: Why You Only Need to Test With 5 Users (March 19, 2000)
Klug, T., Kangasharju, J.: Executable task models. In: Proceedings of the 4th international Workshop on Task Models and Diagrams, TAMODIA ’05, Gdansk, Poland, September 26 - 27, 2005. ACM International Conference Proceeding Series, vol. 127, pp. 119–122. ACM Press, New York (2005)
Lecerof, A., Paternò, F.: Automatic Support for Usability Evaluation. IEEE Trans. Softw. Eng. 24(10), 863–888 (1998)
Morae: http://www.techsmith.com
Mori, G., Paternò, F., Santoro, C.: CTTE: Support for Developing and Analyzing Task Models for Interactive System Design. IEEE Transactions on Software Engineering 28(8), 797–813 (2002)
Nielsen, J.: Usability Engineering. Morgan Kaufmann, San Francisco (1994)
Noldus Observer: http://www.noldus.com
Paternò, F.: Model-Based Design and Evaluation of Interactive Applications. Springer, Heidelberg (2000)
Rubin, J.: Handbook of Usability Testing. John Wiley and Sons, New York (1994)
Sousa, K., Furtado, E.: From usability tasks to usable user interfaces. In: Proceedings of the 4th international Workshop on Task Models and Diagrams, TAMODIA ’05, Gdansk, Poland, September 26 - 27, 2005. ACM International Conference Proceeding Series, vol. 127, pp. 103–110. ACM Press, New York (2005)
Spence, R.: Information visualization. ACM Press, Addison Wesley (2000)
Winckler, M.A., Palanque, P., Freitas, C.M.: Tasks and scenario-based evaluation of information visualization techniques. In: Proceedings of the 3rd Annual Conference on Task Models and Diagrams, TAMODIA ’04, Prague, Czech Republic, November 15 - 16, 2004. ACM International Conference Proceeding Series, vol. 86, pp. 165–172. ACM Press, New York (2004)
Yost, B., North, C.: Single complex glyphs versus multiple simple glyphs. In: CHI ’05 Extended Abstracts on Human Factors in Computing Systems, CHI ’05, Portland, OR, USA, April 02 - 07, 2005, pp. 1889–1892. ACM Press, New York (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Malý, I., Slavík, P. (2007). Towards Visual Analysis of Usability Test Logs Using Task Models. In: Coninx, K., Luyten, K., Schneider, K.A. (eds) Task Models and Diagrams for Users Interface Design. TAMODIA 2006. Lecture Notes in Computer Science, vol 4385. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-70816-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-70816-2_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-70815-5
Online ISBN: 978-3-540-70816-2
eBook Packages: Computer ScienceComputer Science (R0)