Abstract
Learnability is a fundamental usability factor. It is included in several well known and widely used software usability evaluation models such as: IBM’s Computer Usability Satisfaction Questionnaire (CUSQ), System Usability Measurement Inventory (SUMI), System Usability Scale (SUS), and others. However, all of them assess learnability only subjectively. Taking into account the fact of presence of differences in perceived duration in interaction between human and computer, development of a new approach targeting usability, as well as learnability, in objective measures could be of great interest. This paper describes our endeavour in pursuing this task. We present our approach to the problem, introduce an instrument for calculating objective learnability out of times of completion, and reveal results of a user study among 101 participants conducted to test adequacy of the method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Brooke, J.: SUS-A quick and dirty usability scale. Usability evaluation in industry (1996). https://books.google.es/books?hl=en&lr=&id=IfUsRmzAqvEC&oi=fnd&pg=PA189&dq=system+usability+scale&ots=G9nzEaok2k&sig=loVNNDnWmvkLWHmkrfrdgCy8HZY
Dix, A.: Human-Computer Interaction. Springer, New York (2009)
Frøkjær, E., Hertzum, M., Hornbæk, K.: Measuring usability: are effectiveness, efficiency, and satisfaction really correlated? In: CHI 2000 Proceedings of the SIGCHI conference on Human, vol. 2, pp. 345–352 (2000) http://doi.acm.org/10.1145/332040.332455
Gediga, G., Hamborg, K.C., Düntsch, I.: The isometrics usability inventory: an operationalization of ISO 9241–10 supporting summative and formative evaluation of software systems. Behav. Inf. Technol. 18(3), 151–164 (1999)
Hoffman, R., Marx, M.: Measurement for evaluating the learnability and resilience of methods of cognitive work. Theor. Issues Ergon. Sci. 11, 561–575 (2010). http://www.tandfonline.com/doi/abs/10.1080/14639220903386757
Hornbæk, K.: Current practice in measuring usability: challenges to usability studies and research. Int. J. Hum Comput. Stud. 64(2), 79–102 (2006). http://linkinghub.elsevier.com/retrieve/pii/S1071581905001138
Kirakowski, J., Corbett, M.: SUMI: the software usability measurement inventory. Br. J. Educ. Technol. 24, 210–212 (1993). http://onlinelibrary.wiley.com/doi/10.1111/j.1467-8535.1993.tb00076.x/abstract
Kirakowski, J., Cierlik, B.: Measuring the usability of web sites. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 42, pp. 424–428. SAGE Publications (1998)
Kitchenham, B.A., Hughes, R.T., Linkman, S.G.: Modeling software measurement data. IEEE Trans. Softw. Eng. 27(9), 788–804 (2001)
Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum. Comput. Interact. 7(1), 57–78 (1995)
Lewis, J.R., Sauro, J.: The factor structure of the system usability scale. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 94–103. Springer, Heidelberg (2009). doi:10.1007/978-3-642-02806-9_12. http://link.springer.com/chapter/10.1007/978-3-642-02806-9_12
Löwgren, J.: Human-Computer Interaction: What Every System Developer Should Know. Studentlitteratur, Lund (1993)
Molich, R., Nielsen, J.: Improving a human-computer dialogue. Commun. ACM 33(3), 338–348 (1990)
Nielsen, J.: Usability Engineering, vol. 11. Elsevier Science (1994). https://books.google.com/books?hl=en&lr=&id=DBOowF7LqIQC&pgis=1
Padayachee, I., Kotze, P., van Der Merwe, A.: ISO 9126 external systems quality characteristics, sub-characteristics and domain specific criteria for evaluating e-learning systems. In: The Southern African Computer Lecturers’ Association, University of Pretoria, South Africa (2010)
Rafique, I., Weng, J., Wang, Y., Abbasi, M.Q., Lew, P., Wang, X.: Evaluating software learnability: a learnability attributes model. In: 2012 International Conference on Systems and Informatics (ICSAI2012), pp. 2443–2447. IEEE, May 2012. http://ieeexplore.ieee.org/articleDetails.jsp?arnumber=6223548
Shackel, B.: Usability-context, framework, definition, design and evaluation. In: Shackel, B., Richardson, S. (eds.) Human Factors for Informatics Usability, pp. 21–37. Cambridge University Press, Cambridge (1991)
Tractinsky, N., Meyer, J.: Task structure and the apparent duration of hierarchical search. Int. J. Hum. Comput. Stud. 55(5), 845–860 (2001)
Wharton, C., Rieman, J., Lewis, C., Polson, P.: The cognitive walkthrough method: a practitioner’s guide. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, pp. 105–140. John Wiley & Sons, Inc., New York (1994)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Chistyakov, A., Soto-Sanfiel, M.T., Martí, E., Igarashi, T., Carrabina, J. (2016). Objective Learnability Estimation of Software Systems. In: García, C., Caballero-Gil, P., Burmester, M., Quesada-Arencibia, A. (eds) Ubiquitous Computing and Ambient Intelligence. UCAmI 2016. Lecture Notes in Computer Science(), vol 10069. Springer, Cham. https://doi.org/10.1007/978-3-319-48746-5_52
Download citation
DOI: https://doi.org/10.1007/978-3-319-48746-5_52
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48745-8
Online ISBN: 978-3-319-48746-5
eBook Packages: Computer ScienceComputer Science (R0)