Abstract
The tendency to empower users in the software development process encourages the continuing search for ways to reconcile the interests of agile methodologies and Human-Computer Interaction (HCI) activities. The practice of agile methods, e.g. Scrum, is normally focused on high productivity, sometimes leaving aside other important aspects of software development such as usability. On the other hand, HCI methods usually attempt to reach solid conclusions through extensive and formal studies, which can consume significant resources and time. In this paper we present an instrumental single case study which offers an example of how usability evaluations can be integrated into a Scrum project by using Remote Synchronous User Testing (RS). Our approach suggests that the RS process should be conducted by the same developers who integrate the developing team. Our results indicate that RS can be used as a strategy to efficiently and easily integrate usability evaluations into Scrum projects. The most valuable benefit obtained in this integration is related to the opportune feedback offered by usability testing, which can be incorporated to the developing process immediately as is provided through agile principles. Other elements of our approach could help solve other problems normally present in other efforts made in order to integrate usability evaluations into agile methods. The major problem in our case study was related to the difficulty presented by software developers in terms of changing their usual focus when they have to conduct usability evaluations.
Chapter PDF
References
Andreasen, M.S., Nielsen, H.V., Schrøder, S.O., Stage, J.: What happened to remote usability testing?: an empirical study of three methods. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1405–1414. ACM (2007)
Ardito, C., Buono, P., Caivano, D., Costabile, M.F., Lanzilotti, R., Bruun, A., Stage, J.: Usability Evaluation: a survey of software development organizations. In: Proceedings of 33rd International Conference on Software Engineering & Knowledge Engineering, Miami, FL, USA (2011)
Bak, J.O., Nguten, K., Risgaard, P., Stage, J.: Obstacles to Usability Evaluation in Practice: A Survey of Software Development Organizations. In: Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges, pp. 23–32. ACM, New York (2008)
Beck, K., Beedle, M., Van Bennekum, A., Cockburn, A., Cunnimgham, W., Fowler, M., ...Thomas, D.: Principles behind the agile manifesto (2001) (retrieved 11, 2008)
Bruun, A., Stage, J.: Training software development practitioners in usability testing: an assessment acceptance and prioritization. In: Proc. OzCHI, pp. 52–60. ACM Press (2012)
Capra, M.G.: Usability problem description and the evaluator effect in usability testing (Doctoral dissertation, Virginia Polytechnic Institute and State University) (2006)
Ferré, X., Juristo, N., Moreno, A.: Which, When and How Usability Techniques and Activities Should be Integrated. In: Seffah, A., Gulliksen, J., Desmarais, M.C. (eds.) Human-Centered Software Engineering - Integrating Usability in the Software Development Lifecycle. Human-Computer Interaction Series, vol. 8. Kluwer, Dordrecht (2005)
Fischer, H.: Integrating usability engineering in the software development lifecycle based on international standards. In: Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 321–324. ACM (June 2012)
Hoegh, R.T., Nielsen, C.M., Overgaard, M., Pedersen, M.B., Stage, J.: The impact of usability reports and user test observations on developers’ understanding of usability data: An exploratory study. International Journal of Human-Computer Interaction 21(2), 173–196 (2006)
Hussain, Z., Lechner, M., Milchrahm, H., Shahzad, S., Slany, W., Umgeher, M., ...Wolkerstorfer, P.: Practical Usability in XP Software Development Processes. In: The Fifth International Conference on Advances in Computer-Human Interactions, ACHI 2012, pp. 208–217 (January 2012)
Jerome, B., Kazman, R.: Surveying the solitudes: An investigation into the relationships between human computer interaction and software engineering in practice. In: Human-Centered Software Engineering—Integrating Usability in the Software Development Lifecycle, pp. 59–70 (2005)
Jia, Y.: Examining Usability Activities in Scrum Projects–A Survey Study, Doctoral dissertation, Uppsala University (2012)
Kjeldskov, J., Skov, M.B., Stage, J.: Instant data analysis: conducting usability evaluations in a day. In: Proceedings of the Third Nordic Conference on Human-Computer Interaction, pp. 233–240. ACM (October 2004)
Kniberg, H.: Scrum and XP from the Trenches. InfoQ Enterprise Software Development Series (2007)
Lazar, J., Feng, J.H., Hochheiser, H.: Research methods in human-computer interaction. Wiley (2010)
Lazar, J., Feng, J.H., Hochheiser, H.: Research methods in human-computer interaction. Wiley (2010)
Lee, J.C.: Embracing agile development of usable software systems. In: CHI 2006 Extended Abstracts on Human Factors in Computing Systems, pp. 1767–1770. ACM (April 2006)
Lee, J.C., McCrickard, D.S.: Towards extreme (ly) usable software: Exploring tensions between usability and agile software development. In: Agile Conference (AGILE), pp. 59–71. IEEE (August 2007)
Pyla, P., Pérez-Quiñones, M., Arthur, J., Hartson, H.: Ripple: An event driven design representation framework for integrating usability and software engineering life cycles. In: Human-Centered Software Engineering—Integrating Usability in the Software Development Lifecycle, pp. 245–265 (2005)
Rubin, J., Chisnell, D.: Handbook of usability testing: how to plan, design and conduct effective tests. John Wiley & Sons (2008)
Seffah, A., Desmarais, M.C., Metzker, E.: HCI, Usability and Software Engineering Integration: Present and Future. In: Seffah, A., et al. (eds.) Human-Centered Software Engineering. Springer, Berlin (2005)
Seffah, A., Metzker, E.: The obstacles and myths of usability and software engineering. Commun. ACM 47, 71–76 (2004)
Skov, M.B., Stage, J.: Training software developers and designers to conduct usability evaluations. Behaviour & Information Technology 31(4), 425–435 (2012)
Sohaib, O., Khan, K.: Integrating usability engineering and agile software development: A literature review. In: 2010 International Conference on Computer Design and Applications (ICCDA), vol. 2, p. V2-32. IEEE (2010)
Yin, R.K.: Case Study Research: Design and Methods. Sage, Thousand Oaks (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Lizano, F., Sandoval, M.M., Stage, J. (2014). Integrating Usability Evaluations into Scrum: A Case Study Based on Remote Synchronous User Testing. In: Kurosu, M. (eds) Human-Computer Interaction. Theories, Methods, and Tools. HCI 2014. Lecture Notes in Computer Science, vol 8510. Springer, Cham. https://doi.org/10.1007/978-3-319-07233-3_46
Download citation
DOI: https://doi.org/10.1007/978-3-319-07233-3_46
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07232-6
Online ISBN: 978-3-319-07233-3
eBook Packages: Computer ScienceComputer Science (R0)