skip to main content
10.1145/3210459.3210480acmotherconferencesArticle/Chapter ViewAbstractPublication PageseaseConference Proceedingsconference-collections
short-paper

Usability Evaluation Framework for Mobile Apps using Code Analysis

Published: 28 June 2018 Publication History

Abstract

The increasing usage of smart-phones has resulted in mobile applications replacing or supplementing traditional web-based applications. Given the limitations of the form factor in smartphones, usability can be considered as one of the important attributes that determine the success of a mobile application. The measures available for assessing the usability of mobile applications tend to focus more on human aspects and less on the functional aspects of usability. As part of this paper, we propose a usability evaluation framework to identify functional usability issues specific to mobile applications. This framework uses usability guidelines and code analysis to improve the usability of a mobile application. As a proof of concept, we have built an end-to-end system using the framework to validate and verify usability issues in Android mobile applications. We also generate code recommendations to implement failed usability guidelines.

References

[1]
2018. UMETRIX - GitHub Repository. https://goo.gl/KCwxEz. (2018).
[2]
M. Al-Ismail and A. S. M. Sajeev. 2014. Usability challenges in mobile web. In 2014 IEEE International Conference on Communication, Networks and Satellite (COMNETSAT). 50--55.
[3]
Nurul Zakiah Binti Ayob, Ab. Razak Che Hussin, and Halina Mohamed Dahlan. 2009. Three Layers Design Guideline for Mobile Application. 2009 International Conference on Information Management and Engineering (2009).
[4]
Rosnita Baharuddin, Dalbir Singh, and Rozilawati Razali. 2013. Usability dimensions for mobile applications-a review. Research Journal of Applied Sciences, Engineering and Technology 5, 6 (2013), 2225--2231.
[5]
Bill Cassidy, Gemma Stringer, and Moi Hoon Yap. 2014. Mobile Framework for Cognitive Assessment: Trail Making Test and Reaction Time Test. 2014 IEEE International Conference on Computer and Information Technology (2014).
[6]
Ed H. Chi, Adam Rosien, Gesara Supattanasiri, Amanda Williams, Christiaan Royer, Celia Chow, Erica Robles, Brinda Dalal, Julie Chen, and Steve Cousins. 2003. The bloodhound project: Automating discovery of web usability issues using the InfoScent™ simulator. 505--512.
[7]
Constantinos K. Coursaris and Dan J. Kim. 2011. A Meta-Analytical Review of Empirical Mobile Usability Studies. J. Usability Studies 6, 3, Article 11 (May 2011), 55 pages. http://dl.acm.org/citation.cfm?id=2007456.2007459
[8]
Henry Been-Lirn Duh, Gerald C. B. Tan, and Vivian Hsueh-hua Chen. 2006. Usability Evaluation for Mobile Device: A Comparison of Laboratory and Field Tests. In Proceedings of the 8th Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '06). ACM, New York, NY, USA, 181--186.
[9]
Juan Miguel Lopez Gil, Maite Urretavizcaya Loinaz, Begona Losada, and Isabel Fernandez Castro. 2016. Field vs. Laboratory Usability Evaluations: a Study on a Context Dependent Mobile Application Developed with an Agile Methodology. IEEE Latin America Transactions 14, 1 (2016), 339--348.
[10]
Stephen Griffichs. 2015. Mobile App UX Principles - Improving User Experience and Optimizing Conversion. Technical Report. Google, April 2015.
[11]
Rachel Harrison, Derek Flood, and David Duce. 2013. Usability of mobile applications: literature review and rationale for a new usability model. Journal of Interaction Science 1, 1 (07 May 2013), 1.
[12]
A. Hussain and M Kutar. 2009. Usability Metric Framework for Mobile Phone Application. PGNet (2009).
[13]
ISO-9241-11. 1998. Ergonomic requirements for office work with visual display terminals (VDTs) - Part 11: Guidance on usability. Technical Report. International Organization for Standardization, Geneva, Switzerland.
[14]
Philip Kortum and Mary Sorber. 2015. Measuring the Usability of Mobile Applications for Phones and Tablets. International Journal of Human-Computer Interaction 31, 8 (2015), 518--529.
[15]
Justin Mifsud and Alexiei Dingli. 2011. USEFul: A Framework to Mainstream Web Site Usability through Automated Evaluation. International Journal of Recent Trends in Human Computer Interaction (IJHCI) 2, 1 (31 March 2011), 10--30.
[16]
L. Mohan, N. Mathur, and Y. R. Reddy. 2015. Mobile App Usability Index (MAUI) for improving mobile banking adoption. In 2015 International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE). 313--320.
[17]
Fiona Fui-Hoon Nah, Keng Siau, and Hong Sheng. 2005. The Value of Mobile Applications: A Utility Company Study. Commun. ACM 48, 2 (Feb. 2005), 85--90.
[18]
Fatih Nayebi, Jean-Marc Desharnais, and Alain Abran. 2013. An Expert-Based Framework for Evaluating iOS Application Usability. 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement (2013).
[19]
J. Nielsen. 1994. Heuristic evaluation. 24 (1994), 413.
[20]
Jakob Nielsen and Raluca Budiu. 2015. User Experience for Mobile Applications and Websites - Design Gudielines for Improving the Usability of Mobile Sites and Apps. Technical Report. 3rd Edition.
[21]
Hazwani Rahmat, Hazura Zulzalil, Abdul Azim Abd Ghani, and Azrina Kamaruddin. 2015. An approach towards development of evaluation framework for usability of smartphone applications. 2015 9th Malaysian Software Engineering Conference (MySEC) (2015).
[22]
Results. 2018. Validation Results. https://goo.gl/kf9jHb. (2018).
[23]
Maximilian Wich and Tommi Kramer. 2015. Enhanced Human-Computer Interaction for Business Applications on Mobile Devices: A Design-Oriented Development of a Usability Evaluation Questionnaire. In 48th Hawaii International Conference on System Sciences, HICSS 2015, Kauai, Hawaii, USA, January 5--8, 2015. 472--481.

Cited By

View all
  • (2022)Mobile Application for TourismInternational Journal of Customer Relationship Marketing and Management10.4018/IJCRMM.29041513:1(1-29)Online publication date: 30-Jun-2022
  • (2022)Definition of Guideline-Based Metrics to Evaluate AAL Ecosystem’s UsabilityHuman Behavior and Emerging Technologies10.1155/2022/89390722022(1-19)Online publication date: 14-Nov-2022
  • (2022)Inclusivity Bugs in Online Courseware: A Field StudyProceedings of the 2022 ACM Conference on International Computing Education Research - Volume 110.1145/3501385.3543973(356-372)Online publication date: 3-Aug-2022
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
EASE '18: Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018
June 2018
223 pages
ISBN:9781450364034
DOI:10.1145/3210459
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • The University of Canterbury

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Automation
  2. Code Analysis
  3. Mobile Apps
  4. Mobile Usability
  5. Usability Evaluation
  6. Usability Guidelines

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

EASE'18

Acceptance Rates

Overall Acceptance Rate 71 of 232 submissions, 31%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)17
  • Downloads (Last 6 weeks)1
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Mobile Application for TourismInternational Journal of Customer Relationship Marketing and Management10.4018/IJCRMM.29041513:1(1-29)Online publication date: 30-Jun-2022
  • (2022)Definition of Guideline-Based Metrics to Evaluate AAL Ecosystem’s UsabilityHuman Behavior and Emerging Technologies10.1155/2022/89390722022(1-19)Online publication date: 14-Nov-2022
  • (2022)Inclusivity Bugs in Online Courseware: A Field StudyProceedings of the 2022 ACM Conference on International Computing Education Research - Volume 110.1145/3501385.3543973(356-372)Online publication date: 3-Aug-2022
  • (2022)TTAG+R: A Dataset of Google Play Store's Top Trending Android Games and User Reviews2022 IEEE 22nd International Conference on Software Quality, Reliability, and Security Companion (QRS-C)10.1109/QRS-C57518.2022.00093(580-586)Online publication date: Dec-2022
  • (2021)AIDProceedings of the 43rd International Conference on Software Engineering10.1109/ICSE43902.2021.00128(1423-1435)Online publication date: 22-May-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media