research-article

Usability evaluation of messenger applications for Android phones using cognitive walkthrough

Authors:

Ganesh Bhutkar,

Vishal MehtaAuthors Info & Claims

APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

Pages 9 - 18

https://doi.org/10.1145/2525194.2525202

Published: 24 September 2013 Publication History

Abstract

Android - the open source operating system for mobile phones is grabbing more and more user attention and thousands of Android applications are currently being developed. This research aims at usability evaluation of three messenger applications on Android phones, chosen based on a user survey. The applications include WhatsApp, Skype and GO SMS Pro, focusing on primary tasks such as chatting, file transfer, profile viewing and updating contacts. For usability evaluation, Cognitive Walkthrough is selected as it helps in evaluation of tasks providing correct execution paths, while revealing reasons for error occurrences. Cognitive Walkthrough also highlights many usability problems such as lack of provision for multiple smiley selection, no confirmation message for file transfer and ineffective 'Search' functionality. In future, the identified usability problems should be resolved by designing improved mobile interfaces for messenger applications that has an ever-growing user-base.

References

[1]

Akolkar, S., Muthuswamy, K. and Lebech, D. Space Wars on Android^#8482;. University of Oregon, Eugene, 2009.

[2]

Amant, R., Horton, T. and Ritter, F. Model-Based Evaluation of Cell Phone Menu Interaction. In Proc. ACM CHI 2004, Vienna, Austria (2004), 343--350.

Digital Library

[3]

Bareiss, R., Griss, M., Rosenberg, S. and Zhang, Y. Semantic Geotagging: A Location-Based Hypermedia Approach to Creating Situational Awareness. In Proc. MobiCase 2011, Los Angeles, USA, 2011.

[4]

Bhutkar, G., Karande, J. and Dhore, M. Major Challenges with Mobile Healthcare Applications. The British Journal of Healthcare Computing and Information Management, 2009.

[5]

Bhutkar, G., Poovaiah, R., Katre, D. and Karmarkar, S. Semiotic Analysis Combined with Usability and Ergonomic Testing for Evaluation of Icons in Medical User Interface. In Proc. ACM India HCI 2011, Bangalore, India (2011), 57--67.

Digital Library

[6]

Bias, R. and Mayhew, D. (Eds). Cost-Justifying Usability: An Update for the Internet Age. Morgan Kaufmann, California, USA, 2005.

Digital Library

[7]

Boneva, B., Quinn, A., Kraut, R., Kiesler, S. and Shklovski, I. Teenage Communication in the Instant Messaging Era. Carnegie Mellon University, Pittsburgh, USA (2006), 612--672.

[8]

Brown, B., Harmon, E., Chetty, M. and Grimes, A. Reflecting on Health: A System for Students to Monitor Diet and Exercise. In Proc. ACM CHI 2006, Montreal, Canada, 2006.

Digital Library

[9]

Buchanan, G., Farrant, S., Jones, M., Thimbleby, H., Marsden, G. and Pazzani, M. Improving Mobile Internet Usability. In Proc. ACM WWW10, Hong Kong, China (2001), 673--680.

Digital Library

[10]

Chan, S., Fang, X., Brzezinski, J., Zhou, Y., Xu, S., & Lam, J. Usability for Mobile Commerce Across Multiple Form Factors. Journal of Electronic Commerce Research, 3(3), (2002), 187--199.

[11]

Charlton, T., Devlin, M., Marshall, L. and Drummond, S. Encouraging Interaction and Status Awareness in Undergraduate Software Engineering Projects. The Role of Social Networking Services. In Proc. IEEE EDUCON 2010, Madrid, Spain (2010), 1--7.

[12]

Duh, H., Tan, G. and Chen, V. Usability Evaluation for Mobile Device: A Comparison of Laboratory and Field Tests. In Proc. MobileHCI 2006, Helsinki, Finland (2006), 181--186.

Digital Library

[13]

Jaspers, M. A Comparison of Usability Methods for Testing Interactive Health Technologies: Methodological Aspects. International Journal of Medical Informatics, 78(5), (2009), 340--353.

[14]

Karahoca, A., Karahoca, D., Yengin, I., Yuce, B., Berkman, I., Simsek, S., Dagyar, C. and Yalcin, S. Individual Differences in Usability of Cell Phone SMS Menus. In Proc. WSEAS 5^th International Conference on Telecommunications and Informatics, Istanbul, Turkey (2006), 485--90.

Digital Library

[15]

Kothari, C. Research Methodology - Methods and Techniques. Second Revised Edition, New Age International Publishers, (2010), 96.

[16]

Larsson, K. Improvements of Capgemini's Internal Staffing Process through Implementation and Evaluation of the "DreamTeam" Android Mobile Application. Royal Institute of Technology, Stockholm, Sweden, 2011.

[17]

Lewis, C. and Wharton, C. Cognitive Walkthroughs. In: Helander, M., Landauer, T. and Prabhu, P. (Eds). Handbook of Human-Computer Interaction. Elsevier Science B. V., North-Holland (1997), 717--730.

[18]

Nicholson, S. Socialization in the "Virtual Hallway": Instant Messaging in the Asynchronous Web-Based Distance Education Classroom. International Journal of the Internet and Higher Education, 5(4), (2002), 363--372.

[19]

Nielsen J. Usability Engineering. Volume 125184069, Academic Press, Boston, 1993.

Digital Library

[20]

Norman, D. and Nielsen, J. Gestural Interfaces: A Step Backward In Usability. In Proc. ACM interactions, 17(5), (2010), 46--49.

Digital Library

[21]

Patil, S. and Kobsa, A. Instant Messaging and Privacy. In Proc. HCI 2004, Leeds, England, 2004.

[22]

Tsai, C., Lee, G., Raab, F., Norman, G., Sohn, T., Griswold, W. and Patrick, K. Usability and Feasibility of PmEB: A Mobile Phone Application for Monitoring Real Time Caloric Balance. In Proc. Mobile Network Applications, (2007), 173--184.

Digital Library

[23]

Wharton, C., Rieman, J., Lewis, C. and Polson, P. The Cognitive Walkthrough Method: A Practitioner's Guide. In Nielsen, J. and Mack, R. (Eds.). Usability Inspection Methods, John Wiley & Sons, New York, USA (1994), 105--140.

Digital Library

[24]

Xiao, Z., Guo, L. and Tracey, J. Understanding Instant Messaging Traffic Characteristics, In Proc. 27th International Conference on Distributed Computing Systems (ICDCS'07), Toronto, Ontario, 2007.

Digital Library

[25]

Android Applications Categories https://play.google.com/store/apps/category/APPLICATION Accessed on 3^rd Nov. 2012.

[26]

Android Applications Statistics http://www.tomsguide.com/us/Google-Play-Android-Apple-iOS,news-16235.html Accessed on 10^th Oct. 2012.

[27]

Android Phone features http://en.wikipedia.org/wiki/List_of_features_in_Android Accessed on 22^nd Sept. 2012.

[28]

Best 100 Android apps, PCMAG review http://www.pcmag.com/article2/0,2817,2393097,00.asp Accessed on 20^th Nov. 2012.

[29]

Evolution of Mobile Phones http://www.hongkiat.com/blog/evolution-of-mobile-phones/ Accessed on 2^nd Sept. 2012.

[30]

File transfer in messenger application http://en.wikipedia.org/wiki/Instant_messaging Accessed on 1^st Dec. 2012.

[31]

GO SMS Pro https://play.google.com/store/apps/details?id=com.jb.gosms&hl=en Accessed on 25^th Nov. 2012.

[32]

Mobile operating systems http://en.wikipedia.org/wiki/Mobile_OS Accessed on 10^th Sept. 2012.

[33]

Skype http://www.skype.com/en/features/ Accessed on 25^th Nov. 2012.

[34]

WhatsApp http://www.whatsapp.com/ Accessed on 25^th Nov. 2012.

Cited By

Holder BFinseth TLubold N(2024)Cognitive Skills for Flight Path ManagementJournal of Cognitive Engineering and Decision Making10.1177/1555343424124829818:3(209-240)Online publication date: 27-May-2024
https://doi.org/10.1177/15553434241248298
Caro-Alvaro SGarcía-López EGarcía-Cabot AMavri A(2024)Measuring the Effects of Usability Recommendations for Mobile Instant Messaging Apps on User Performance and User BehaviourInternational Journal of Human–Computer Interaction10.1080/10447318.2024.230355341:1(608-626)Online publication date: 23-Jan-2024
https://doi.org/10.1080/10447318.2024.2303553
Shah BAbhyankar M(2024)Touchtalk: Enhancing Messaging in Smartphones for Visually ImpairedProceedings of the 14th Indian Conference on Human-Computer Interaction10.1007/978-981-97-4335-3_7(133-148)Online publication date: 3-Aug-2024
https://doi.org/10.1007/978-981-97-4335-3_7
Show More Cited By

Index Terms

Usability evaluation of messenger applications for Android phones using cognitive walkthrough
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Interaction design theory, concepts and paradigms

Recommendations

Experimenting on the cognitive walkthrough with users
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

This paper presents a case study aiming to investigate which variant of the Think-Aloud Protocol (i.e., the Concurrent Think-Aloud and the Retrospective Think-Aloud) better integrates with the Cognitive Walkthrough with Users. To this end we performed a ...
Design and Evaluation of Intelligent Menu Interface through Cognitive Walkthrough Procedure and Automated Logging for Management Information System
Computer Supported Cooperative Work in Design IV

One of the critcal issues in Managment Information System (MIS) is the information overload from complicated hierachical menu. Novice users easily get lost when an important and frequently used menu item is rooted and hidden in a deeper level of a ...
Gamification in mobile applications usability evaluation: A New Approach
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Usability evaluation of mobile application interfaces is continuously gaining importance, due to the spread of mobile devices in everyday life and to the varied nature of mobile applications. Unfortunately, usability is always a secondary aspect when ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

September 2013

420 pages

ISBN:9781450322539

DOI:10.1145/2525194

General Chairs:
Sanjay Tripathi
ABB Corporate Research, India
,
Anirudha Joshi
IIT Bombay, India

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 September 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

APCHI '13

Sponsor:

SIGCHI

APCHI '13: 11th Asia Pacific Conference on Computer Human Interaction

September 24 - 27, 2013

Bangalore, India

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
1,209
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)3

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Holder BFinseth TLubold N(2024)Cognitive Skills for Flight Path ManagementJournal of Cognitive Engineering and Decision Making10.1177/1555343424124829818:3(209-240)Online publication date: 27-May-2024
https://doi.org/10.1177/15553434241248298
Caro-Alvaro SGarcía-López EGarcía-Cabot AMavri A(2024)Measuring the Effects of Usability Recommendations for Mobile Instant Messaging Apps on User Performance and User BehaviourInternational Journal of Human–Computer Interaction10.1080/10447318.2024.230355341:1(608-626)Online publication date: 23-Jan-2024
https://doi.org/10.1080/10447318.2024.2303553
Shah BAbhyankar M(2024)Touchtalk: Enhancing Messaging in Smartphones for Visually ImpairedProceedings of the 14th Indian Conference on Human-Computer Interaction10.1007/978-981-97-4335-3_7(133-148)Online publication date: 3-Aug-2024
https://doi.org/10.1007/978-981-97-4335-3_7
Alahmadi AAlbaqami SFoltz A(2023)Using technology-based vocabulary instruction inside and outside of the classroomFrontiers in Communication10.3389/fcomm.2023.11622198Online publication date: 18-May-2023
https://doi.org/10.3389/fcomm.2023.1162219
Bagheri FAbbasi FSadeghi MKhajouei R(2023)Evaluating the usability of a cancer registry system using Cognitive Walkthrough, and assessing user agreement with its problemsBMC Medical Informatics and Decision Making10.1186/s12911-023-02120-823:1Online publication date: 30-Jan-2023
https://doi.org/10.1186/s12911-023-02120-8
Hasan MFakih AIbna Seraj PHasmirati (2022)The effect of technology-assisted language programme on vocabulary learning among EFL students at the tertiary levelHeliyon10.1016/j.heliyon.2022.e10313(e10313)Online publication date: Aug-2022
https://doi.org/10.1016/j.heliyon.2022.e10313
Santos Gonçalves TIvars-Nicolás BMartínez-Cano F(2021)Mobile Applications Accessibility: An Evaluation of the Local Portuguese PressInformatics10.3390/informatics80300528:3(52)Online publication date: 10-Aug-2021
https://doi.org/10.3390/informatics8030052
Caro‐Álvaro SGarcía‐López EGarcía‐Cabot Ade‐Marcos LDomínguez‐Díaz A(2021)Applying usability recommendations when developing mobile instant messaging applicationsIET Software10.1049/sfw2.1203916:1(73-93)Online publication date: 7-Sep-2021
https://doi.org/10.1049/sfw2.12039
Jiang J(2020)A Study on Usability of Mobile Software Targeted at Elderly People in Chinaundefined10.12794/metadc1703296Online publication date: May-2020
https://doi.org/10.12794/metadc1703296
Khaleel FAshaari NWook T(2019)Designing Usable Gamified Programming Learning Website2019 International Conference on Electrical Engineering and Informatics (ICEEI)10.1109/ICEEI47359.2019.8988818(164-169)Online publication date: Jul-2019
https://doi.org/10.1109/ICEEI47359.2019.8988818
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten