Abstract
The usability of mobile applications is critical for their adoption particularly because of the relatively small screen and awkward (sometimes virtual) keyboard, despite the recent advances of smartphones. Traditional laboratory-based usability testing is often tedious, expensive, and does not reflect real use cases. In this paper, we propose a toolkit that embeds into mobile applications the ability to automatically collect user interface (UI) events as the user interacts with the applications. The events are fine-grained and useful for quantified usability analysis. We have implemented the toolkit on Android devices and we evaluated the toolkit with a real deployed Android application by comparing event analysis (state-machine based) with traditional laboratory testing (expert based). The results show that our toolkit is effective at capturing detailed UI events for accurate usability analysis.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kerr, R.: Us mobile internet usage to near 50% in 2013. Vator News (August 2009)
Budiu, R., Nielsen, J.: Usability of mobile websites: 85 design guidelines for improving access to web-based content and services through mobile devices. Nielsen Norman Group Research Report (July 2009)
Why the mobile web is disappointing end-users. Equation Research Report (October 2009)
Tullis, T., Fleischman, S., McNulty, M., Cianchette, C., Bergel, M.: An empirical comparison of lab and remote usability testing of web sites. In: Usability Professional Association Conference, Orlando (2002)
Bastien, J.M.C.: Usability testing: a review of some methodological and technical aspects of the method. Computing Research Repository 79, 18–23 (2010)
West, R., Lehman, K.: Automated summative usability studies: an empirical evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2006, pp. 631–639. ACM, New York (2006)
Waterson, S., James, A.L.: In the lab and out in the wild: remote web usability testing for mobile devices. In: Conference on Human Factors in Computing Systems, pp. 296–297 (2002)
Yan, B., Chen, G.: Appjoy: personalized mobile application discovery. In: Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services, MobiSys 2011, pp. 113–126. ACM, New York (2011), http://doi.acm.org/10.1145/1999995.2000007
Rosenbaum, S., Rohn, J.A., Humburg, J.: A toolkit for strategic usability: results from workshops, panels, and surveys. In: Proceedings of the ACM CHI 2000 Conference on Human Factors in Computing Systems, New York, pp. 337–344 (2000)
Upa 2007 salary survey, Usability Professionals’ Association (2008)
Ericsson, K.A., Simon, H.A.: Verbal reports as data. Psychological Review 87, 215–251 (1980)
Nieslen, J.: Severity ratings for usability problems, in Retrieved June 4th from UseIt (2007), http://www.useit.com/papers/heuristic/severityrating.html
Hilbert, D.M., Redmiles, D.F.: Extracting usability information from user interface events. ACM Comput. Surv. 32, 384–421 (2000)
Akers, D.: Backtracking events as indicators of software usability problems. Ph.D. dissertation (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Ma, X., Yan, B., Chen, G., Zhang, C., Huang, K., Drury, J. (2012). A Toolkit for Usability Testing of Mobile Applications. In: Zhang, J.Y., Wilkiewicz, J., Nahapetian, A. (eds) Mobile Computing, Applications, and Services. MobiCASE 2011. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 95. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32320-1_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-32320-1_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32319-5
Online ISBN: 978-3-642-32320-1
eBook Packages: Computer ScienceComputer Science (R0)