ABSTRACT
Android - the open source operating system for mobile phones is grabbing more and more user attention and thousands of Android applications are currently being developed. This research aims at usability evaluation of three messenger applications on Android phones, chosen based on a user survey. The applications include WhatsApp, Skype and GO SMS Pro, focusing on primary tasks such as chatting, file transfer, profile viewing and updating contacts. For usability evaluation, Cognitive Walkthrough is selected as it helps in evaluation of tasks providing correct execution paths, while revealing reasons for error occurrences. Cognitive Walkthrough also highlights many usability problems such as lack of provision for multiple smiley selection, no confirmation message for file transfer and ineffective 'Search' functionality. In future, the identified usability problems should be resolved by designing improved mobile interfaces for messenger applications that has an ever-growing user-base.
- Akolkar, S., Muthuswamy, K. and Lebech, D. Space Wars on Android#8482;. University of Oregon, Eugene, 2009.Google Scholar
- Amant, R., Horton, T. and Ritter, F. Model-Based Evaluation of Cell Phone Menu Interaction. In Proc. ACM CHI 2004, Vienna, Austria (2004), 343--350. Google ScholarDigital Library
- Bareiss, R., Griss, M., Rosenberg, S. and Zhang, Y. Semantic Geotagging: A Location-Based Hypermedia Approach to Creating Situational Awareness. In Proc. MobiCase 2011, Los Angeles, USA, 2011.Google Scholar
- Bhutkar, G., Karande, J. and Dhore, M. Major Challenges with Mobile Healthcare Applications. The British Journal of Healthcare Computing and Information Management, 2009.Google Scholar
- Bhutkar, G., Poovaiah, R., Katre, D. and Karmarkar, S. Semiotic Analysis Combined with Usability and Ergonomic Testing for Evaluation of Icons in Medical User Interface. In Proc. ACM India HCI 2011, Bangalore, India (2011), 57--67. Google ScholarDigital Library
- Bias, R. and Mayhew, D. (Eds). Cost-Justifying Usability: An Update for the Internet Age. Morgan Kaufmann, California, USA, 2005. Google ScholarDigital Library
- Boneva, B., Quinn, A., Kraut, R., Kiesler, S. and Shklovski, I. Teenage Communication in the Instant Messaging Era. Carnegie Mellon University, Pittsburgh, USA (2006), 612--672.Google Scholar
- Brown, B., Harmon, E., Chetty, M. and Grimes, A. Reflecting on Health: A System for Students to Monitor Diet and Exercise. In Proc. ACM CHI 2006, Montreal, Canada, 2006. Google ScholarDigital Library
- Buchanan, G., Farrant, S., Jones, M., Thimbleby, H., Marsden, G. and Pazzani, M. Improving Mobile Internet Usability. In Proc. ACM WWW10, Hong Kong, China (2001), 673--680. Google ScholarDigital Library
- Chan, S., Fang, X., Brzezinski, J., Zhou, Y., Xu, S., & Lam, J. Usability for Mobile Commerce Across Multiple Form Factors. Journal of Electronic Commerce Research, 3(3), (2002), 187--199.Google Scholar
- Charlton, T., Devlin, M., Marshall, L. and Drummond, S. Encouraging Interaction and Status Awareness in Undergraduate Software Engineering Projects. The Role of Social Networking Services. In Proc. IEEE EDUCON 2010, Madrid, Spain (2010), 1--7.Google ScholarCross Ref
- Duh, H., Tan, G. and Chen, V. Usability Evaluation for Mobile Device: A Comparison of Laboratory and Field Tests. In Proc. MobileHCI 2006, Helsinki, Finland (2006), 181--186. Google ScholarDigital Library
- Jaspers, M. A Comparison of Usability Methods for Testing Interactive Health Technologies: Methodological Aspects. International Journal of Medical Informatics, 78(5), (2009), 340--353.Google ScholarCross Ref
- Karahoca, A., Karahoca, D., Yengin, I., Yuce, B., Berkman, I., Simsek, S., Dagyar, C. and Yalcin, S. Individual Differences in Usability of Cell Phone SMS Menus. In Proc. WSEAS 5th International Conference on Telecommunications and Informatics, Istanbul, Turkey (2006), 485--90. Google ScholarDigital Library
- Kothari, C. Research Methodology - Methods and Techniques. Second Revised Edition, New Age International Publishers, (2010), 96.Google Scholar
- Larsson, K. Improvements of Capgemini's Internal Staffing Process through Implementation and Evaluation of the "DreamTeam" Android Mobile Application. Royal Institute of Technology, Stockholm, Sweden, 2011.Google Scholar
- Lewis, C. and Wharton, C. Cognitive Walkthroughs. In: Helander, M., Landauer, T. and Prabhu, P. (Eds). Handbook of Human-Computer Interaction. Elsevier Science B. V., North-Holland (1997), 717--730.Google Scholar
- Nicholson, S. Socialization in the "Virtual Hallway": Instant Messaging in the Asynchronous Web-Based Distance Education Classroom. International Journal of the Internet and Higher Education, 5(4), (2002), 363--372.Google ScholarCross Ref
- Nielsen J. Usability Engineering. Volume 125184069, Academic Press, Boston, 1993. Google ScholarDigital Library
- Norman, D. and Nielsen, J. Gestural Interfaces: A Step Backward In Usability. In Proc. ACM interactions, 17(5), (2010), 46--49. Google ScholarDigital Library
- Patil, S. and Kobsa, A. Instant Messaging and Privacy. In Proc. HCI 2004, Leeds, England, 2004.Google Scholar
- Tsai, C., Lee, G., Raab, F., Norman, G., Sohn, T., Griswold, W. and Patrick, K. Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance. In Proc. Mobile Network Applications, (2007), 173--184. Google ScholarDigital Library
- Wharton, C., Rieman, J., Lewis, C. and Polson, P. The Cognitive Walkthrough Method: A Practitioner's Guide. In Nielsen, J. and Mack, R. (Eds.). Usability Inspection Methods, John Wiley & Sons, New York, USA (1994), 105--140. Google ScholarDigital Library
- Xiao, Z., Guo, L. and Tracey, J. Understanding Instant Messaging Traffic Characteristics, In Proc. 27th International Conference on Distributed Computing Systems (ICDCS'07), Toronto, Ontario, 2007. Google ScholarDigital Library
- Android Applications Categories https://play.google.com/store/apps/category/APPLICATION Accessed on 3rd Nov. 2012.Google Scholar
- Android Applications Statistics http://www.tomsguide.com/us/Google-Play-Android-Apple-iOS,news-16235.html Accessed on 10th Oct. 2012.Google Scholar
- Android Phone features http://en.wikipedia.org/wiki/List_of_features_in_Android Accessed on 22nd Sept. 2012.Google Scholar
- Best 100 Android apps, PCMAG review http://www.pcmag.com/article2/0,2817,2393097,00.asp Accessed on 20th Nov. 2012.Google Scholar
- Evolution of Mobile Phones http://www.hongkiat.com/blog/evolution-of-mobile-phones/ Accessed on 2nd Sept. 2012.Google Scholar
- File transfer in messenger application http://en.wikipedia.org/wiki/Instant_messaging Accessed on 1st Dec. 2012.Google Scholar
- GO SMS Pro https://play.google.com/store/apps/details?id=com.jb.gosms&hl=en Accessed on 25th Nov. 2012.Google Scholar
- Mobile operating systems http://en.wikipedia.org/wiki/Mobile_OS Accessed on 10th Sept. 2012.Google Scholar
- Skype http://www.skype.com/en/features/ Accessed on 25th Nov. 2012.Google Scholar
- WhatsApp http://www.whatsapp.com/ Accessed on 25th Nov. 2012.Google Scholar
Index Terms
- Usability evaluation of messenger applications for Android phones using cognitive walkthrough
Recommendations
Experimenting on the cognitive walkthrough with users
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesThis paper presents a case study aiming to investigate which variant of the Think-Aloud Protocol (i.e., the Concurrent Think-Aloud and the Retrospective Think-Aloud) better integrates with the Cognitive Walkthrough with Users. To this end we performed a ...
Design and Evaluation of Intelligent Menu Interface through Cognitive Walkthrough Procedure and Automated Logging for Management Information System
Computer Supported Cooperative Work in Design IVOne of the critcal issues in Managment Information System (MIS) is the information overload from complicated hierachical menu. Novice users easily get lost when an important and frequently used menu item is rooted and hidden in a deeper level of a ...
Gamification in mobile applications usability evaluation: A New Approach
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services AdjunctUsability evaluation of mobile application interfaces is continuously gaining importance, due to the spread of mobile devices in everyday life and to the varied nature of mobile applications. Unfortunately, usability is always a secondary aspect when ...
Comments