skip to main content
10.1145/2525194.2525202acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Usability evaluation of messenger applications for Android phones using cognitive walkthrough

Authors Info & Claims
Published:24 September 2013Publication History

ABSTRACT

Android - the open source operating system for mobile phones is grabbing more and more user attention and thousands of Android applications are currently being developed. This research aims at usability evaluation of three messenger applications on Android phones, chosen based on a user survey. The applications include WhatsApp, Skype and GO SMS Pro, focusing on primary tasks such as chatting, file transfer, profile viewing and updating contacts. For usability evaluation, Cognitive Walkthrough is selected as it helps in evaluation of tasks providing correct execution paths, while revealing reasons for error occurrences. Cognitive Walkthrough also highlights many usability problems such as lack of provision for multiple smiley selection, no confirmation message for file transfer and ineffective 'Search' functionality. In future, the identified usability problems should be resolved by designing improved mobile interfaces for messenger applications that has an ever-growing user-base.

References

  1. Akolkar, S., Muthuswamy, K. and Lebech, D. Space Wars on Android#8482;. University of Oregon, Eugene, 2009.Google ScholarGoogle Scholar
  2. Amant, R., Horton, T. and Ritter, F. Model-Based Evaluation of Cell Phone Menu Interaction. In Proc. ACM CHI 2004, Vienna, Austria (2004), 343--350. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bareiss, R., Griss, M., Rosenberg, S. and Zhang, Y. Semantic Geotagging: A Location-Based Hypermedia Approach to Creating Situational Awareness. In Proc. MobiCase 2011, Los Angeles, USA, 2011.Google ScholarGoogle Scholar
  4. Bhutkar, G., Karande, J. and Dhore, M. Major Challenges with Mobile Healthcare Applications. The British Journal of Healthcare Computing and Information Management, 2009.Google ScholarGoogle Scholar
  5. Bhutkar, G., Poovaiah, R., Katre, D. and Karmarkar, S. Semiotic Analysis Combined with Usability and Ergonomic Testing for Evaluation of Icons in Medical User Interface. In Proc. ACM India HCI 2011, Bangalore, India (2011), 57--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bias, R. and Mayhew, D. (Eds). Cost-Justifying Usability: An Update for the Internet Age. Morgan Kaufmann, California, USA, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Boneva, B., Quinn, A., Kraut, R., Kiesler, S. and Shklovski, I. Teenage Communication in the Instant Messaging Era. Carnegie Mellon University, Pittsburgh, USA (2006), 612--672.Google ScholarGoogle Scholar
  8. Brown, B., Harmon, E., Chetty, M. and Grimes, A. Reflecting on Health: A System for Students to Monitor Diet and Exercise. In Proc. ACM CHI 2006, Montreal, Canada, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Buchanan, G., Farrant, S., Jones, M., Thimbleby, H., Marsden, G. and Pazzani, M. Improving Mobile Internet Usability. In Proc. ACM WWW10, Hong Kong, China (2001), 673--680. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chan, S., Fang, X., Brzezinski, J., Zhou, Y., Xu, S., & Lam, J. Usability for Mobile Commerce Across Multiple Form Factors. Journal of Electronic Commerce Research, 3(3), (2002), 187--199.Google ScholarGoogle Scholar
  11. Charlton, T., Devlin, M., Marshall, L. and Drummond, S. Encouraging Interaction and Status Awareness in Undergraduate Software Engineering Projects. The Role of Social Networking Services. In Proc. IEEE EDUCON 2010, Madrid, Spain (2010), 1--7.Google ScholarGoogle ScholarCross RefCross Ref
  12. Duh, H., Tan, G. and Chen, V. Usability Evaluation for Mobile Device: A Comparison of Laboratory and Field Tests. In Proc. MobileHCI 2006, Helsinki, Finland (2006), 181--186. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Jaspers, M. A Comparison of Usability Methods for Testing Interactive Health Technologies: Methodological Aspects. International Journal of Medical Informatics, 78(5), (2009), 340--353.Google ScholarGoogle ScholarCross RefCross Ref
  14. Karahoca, A., Karahoca, D., Yengin, I., Yuce, B., Berkman, I., Simsek, S., Dagyar, C. and Yalcin, S. Individual Differences in Usability of Cell Phone SMS Menus. In Proc. WSEAS 5th International Conference on Telecommunications and Informatics, Istanbul, Turkey (2006), 485--90. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Kothari, C. Research Methodology - Methods and Techniques. Second Revised Edition, New Age International Publishers, (2010), 96.Google ScholarGoogle Scholar
  16. Larsson, K. Improvements of Capgemini's Internal Staffing Process through Implementation and Evaluation of the "DreamTeam" Android Mobile Application. Royal Institute of Technology, Stockholm, Sweden, 2011.Google ScholarGoogle Scholar
  17. Lewis, C. and Wharton, C. Cognitive Walkthroughs. In: Helander, M., Landauer, T. and Prabhu, P. (Eds). Handbook of Human-Computer Interaction. Elsevier Science B. V., North-Holland (1997), 717--730.Google ScholarGoogle Scholar
  18. Nicholson, S. Socialization in the "Virtual Hallway": Instant Messaging in the Asynchronous Web-Based Distance Education Classroom. International Journal of the Internet and Higher Education, 5(4), (2002), 363--372.Google ScholarGoogle ScholarCross RefCross Ref
  19. Nielsen J. Usability Engineering. Volume 125184069, Academic Press, Boston, 1993. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Norman, D. and Nielsen, J. Gestural Interfaces: A Step Backward In Usability. In Proc. ACM interactions, 17(5), (2010), 46--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Patil, S. and Kobsa, A. Instant Messaging and Privacy. In Proc. HCI 2004, Leeds, England, 2004.Google ScholarGoogle Scholar
  22. Tsai, C., Lee, G., Raab, F., Norman, G., Sohn, T., Griswold, W. and Patrick, K. Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance. In Proc. Mobile Network Applications, (2007), 173--184. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Wharton, C., Rieman, J., Lewis, C. and Polson, P. The Cognitive Walkthrough Method: A Practitioner's Guide. In Nielsen, J. and Mack, R. (Eds.). Usability Inspection Methods, John Wiley & Sons, New York, USA (1994), 105--140. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Xiao, Z., Guo, L. and Tracey, J. Understanding Instant Messaging Traffic Characteristics, In Proc. 27th International Conference on Distributed Computing Systems (ICDCS'07), Toronto, Ontario, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Android Applications Categories https://play.google.com/store/apps/category/APPLICATION Accessed on 3rd Nov. 2012.Google ScholarGoogle Scholar
  26. Android Applications Statistics http://www.tomsguide.com/us/Google-Play-Android-Apple-iOS,news-16235.html Accessed on 10th Oct. 2012.Google ScholarGoogle Scholar
  27. Android Phone features http://en.wikipedia.org/wiki/List_of_features_in_Android Accessed on 22nd Sept. 2012.Google ScholarGoogle Scholar
  28. Best 100 Android apps, PCMAG review http://www.pcmag.com/article2/0,2817,2393097,00.asp Accessed on 20th Nov. 2012.Google ScholarGoogle Scholar
  29. Evolution of Mobile Phones http://www.hongkiat.com/blog/evolution-of-mobile-phones/ Accessed on 2nd Sept. 2012.Google ScholarGoogle Scholar
  30. File transfer in messenger application http://en.wikipedia.org/wiki/Instant_messaging Accessed on 1st Dec. 2012.Google ScholarGoogle Scholar
  31. GO SMS Pro https://play.google.com/store/apps/details?id=com.jb.gosms&hl=en Accessed on 25th Nov. 2012.Google ScholarGoogle Scholar
  32. Mobile operating systems http://en.wikipedia.org/wiki/Mobile_OS Accessed on 10th Sept. 2012.Google ScholarGoogle Scholar
  33. Skype http://www.skype.com/en/features/ Accessed on 25th Nov. 2012.Google ScholarGoogle Scholar
  34. WhatsApp http://www.whatsapp.com/ Accessed on 25th Nov. 2012.Google ScholarGoogle Scholar

Index Terms

  1. Usability evaluation of messenger applications for Android phones using cognitive walkthrough

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in
            • Published in

              cover image ACM Conferences
              APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction
              September 2013
              420 pages
              ISBN:9781450322539
              DOI:10.1145/2525194

              Copyright © 2013 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 24 September 2013

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • research-article

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader