Abstract
As part of the OPTIMOS 2.0 funding project of the German Federal Ministry for Economic Affairs and Energy (BMWi), a partner develops the TicketIssuance app for secure hardware-based storage of high-priced tickets. The app has implemented a previously unknown technology using the Secure Element and the NFC interface. It is therefore imperative to investigate the usability of the app for a successful market launch. For this purpose, user tests of a prototype of the app were conducted using the think-aloud method. This study analyses the results of five tasks. Test subjects rate the expected and perceived difficulty level for each task. That forms the basis for identifying improvement strategies. The test subjects’ performance, the frequency of errors and problems encountered, and the need for moderator’s support form the basis for prioritizing usability items within the tasks. The developed structure to determine the test tasks’ prioritization and usability items, layout, navigation, handling, wording, system, and data economy offers improvements to increase usability.
Furthermore, the study investigates the determination of a suitable sample size for usability testing.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Albert, W., Dixon, E.: Is this what you expected? The use of expectation measures in usability testing. In: Proceedings of the Usability Professionals Association 2003 Conference, Scottsdale, AZ (2003)
Albert, W., Tullis, T.: Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Morgan Kaufmann, Burlington (2013)
Alhadreti, O., Mayhew, P.: Rethinking thinking aloud: a comparison of three think-aloud protocols. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12 (2018)
Barnum, C.M.: Usability Testing Essentials: Ready, Set … Test! Elsevier, Inc., Burlington (2011)
Berliner Verkehrsbetriebe: BVG Lagebericht & Jahresabschluss (2018). https://unternehmen.bvg.de/wp-content/uploads/2020/10/BVG-Lagebericht-2018.pdf. Accessed 23 Feb 2021
Bevan, N.: Classifying and selecting UX and usability measures. In: International Workshop on Meaningful Measures: Valid Useful User Experience Measurement, vol. 11, pp. 13–18 (2008)
Bilandzic, H., Trapp, B.: Die Methode des lauten Denkens: Grundlagen des Verfahrens und die Anwendung bei der Untersuchung selektiver Fernsehnutzung bei Jugendlichen. In: Paus-Haase, I., Schorb, B. (eds.) Qualitative Kinder-und Jugendmedienforschung, pp. 183–209, KoPäd - Kommunik. u. Päd., München (2000)
Ericsson, K.A., Simon, H.A.: Protocol Analysis: Verbal Reports as Data, 2nd edn. MIT Press, Cambridge (1993)
Fonteyn, M.A., Kuipers, B., Grobe, S.J.: A description of think aloud method and protocol analysis. Qual. Health Res. 3(4), 430–441 (1993)
Frühwald, A.: Das REFA-Gedankengut – Eine Darstellung für den Kaufmann. Gabler, Wiesbaden (1955)
Gerike, R., Hubrich, S., Ließke, F., Wittig, S., Wittwer, R.: Tabellenbericht zum Forschungsprojekt. In: Mobilität in Städten – SrV 2018, Berlin. Technische Universität Dresden (2020)
Harrison, R., Flood, D., Duce, D.: Usability of mobile applications: literature review and rationale for a new usability model. J. Interact. Sci. 1(1), 1–16 (2013)
Henry, S.B., Lebreck, D.B., Holzemer, W.L.: The effect of verbalization of cognitive processes on clinical decision making. Res. Nurs. Health 12(3), 187–193 (1989)
Jakobitz, D., Krüger, S.: Tickets auf dem Smartphone - das wünschen sich Fahrgäste im ÖPNV (2018). Unter: https://marktforschungsanbieter.de/files/profiles/249/12387354437530.pdf. Accessed 23 Feb 2021
Kaiser, M.O.: Erfolgsfaktor Kundenzufriedenheit – Dimensionen und Messmöglichkeiten, 2nd edn. Erich Schmidt Verlag, Berlin (2005)
Lewis, J.R.: Sample sizes for usability studies: Additional considerations. Hum. Factors 36(2), 368–378 (1994)
Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, pp. 25–62. Wiley, New York (1994)
Nielsen, J.: Usability Engineering. Academic Press Inc., Cambridge (1993)
Nielsen, J., Landauer, T.K.: A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems, pp. 206–213 (1993)
Nielsen Norman Group: Why you only need to test with 5 users. https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users. Accessed 23 Feb 2021
Nielsen Norman Group: Thinking Aloud: The #1 Usability Tool. https://www.nngroup.com/articles/thinking-aloud-the-1-usability-tool. Accessed 23 Feb 2021
Olmsted-Hawala, E.L., Murphy, E.D, Hawala, S., Ashenfelter, K.T.: Think-aloud protocols: a comparison of three think-aloud protocols for use in testing data-dissemination web sites for usability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2381–2390 (2010)
Rhenius, D., Deffner, G.: Evaluation of concurrent thinking aloud using eye-tracking data. Proc. Hum. Factors Soc. Annu. Meet. 34(17), 1265–1269 (1990)
Schlittgen, R.: Einführung in die Statistik – Analyse und Modellierung von Daten, 8th edn. Oldenbourg München Wien (1998)
Spool, J., Schroeder, W.: Testing web sites: five users is nowhere near enough. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, pp. 285–186 (2001)
Tergan, S.O.: Grundlagen der Evaluation: ein Überblick. In: Schenkel, P., Tergan, S.O., Lottmann, A. (eds.): Qualitätsbeurteilung multimedialer Lern- und Informationssysteme – Evaluationsmethoden auf dem Prüfstand, pp. 22–51. BW Bildung und Wissen, Nürnberg (2000)
Virzi, R.A.: Streamlining the design process: Running fewer subjects. Proc. Hum. Factors Soc. Annu. Meet. 34(4), 291–294 (1990)
YouGov: App in die Tonne – Wie Ihre App geladen, getestet und schließlich nicht wieder gelöscht wird. YouGov Reports, Köln (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Schäfer, G., Kreisel, A., Stopka, U. (2021). Usability Study of an Innovative Application in Public Transport by Using Hardware-Based Security Technology. In: Krömker, H. (eds) HCI in Mobility, Transport, and Automotive Systems. HCII 2021. Lecture Notes in Computer Science(), vol 12791. Springer, Cham. https://doi.org/10.1007/978-3-030-78358-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-78358-7_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78357-0
Online ISBN: 978-3-030-78358-7
eBook Packages: Computer ScienceComputer Science (R0)