skip to main content
10.1145/2957265.2961834acmconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
demonstration

Affective-ready, contextual and automated usability test for mobile software

Published: 06 September 2016 Publication History

Abstract

This work proposes the use of system to perform affective-ready, contextual and automated usability tests for mobile software. Our proposal augments the traditional methods of software usability evaluation by monitoring users' location, weather conditions, moving/stationary status, data connection availability and spontaneous facial expressions automatically. This aims to identify the moment of negative and positive events. Identifying those situations and systematically associating them to the context of interaction, assisted software creators to overcome design flaws and enhancing interfaces' strengths.
The validation of our approach include post-test questionnaires with test subjects. The results indicate that the automated user-context logging can be a substantial supplement to mobile software usability tests.

References

[1]
Brajnik, G., June. "Automatic web usability evaluation: what needs to be done". In Proc. Human Factors and the Web, 6th Conference.
[2]
Harty, J., "Finding Usability Bugs with Automated Tests." Commun. ACM 54, no. 2 (2011): 44--49
[3]
Witold, A., "Consolidating the ISO Usability Models," presented at the 11th International Software Quality Management Conference and 8th Annual INSPIRE Conference, 2003.
[4]
J. Rubin and D. Chisnell, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, 2 ed. New York, NY: Wiley, 2008.
[5]
L. Vukelja, et al., "Are engineers condemned to design? a survey on software engineering and UI design in Switzerland," presented at the 11th IFIP TC 13 international conference on Human-computer interaction, Rio de Janeiro, Brazil, 2007.
[6]
J. S. Dumas and J. C. Redish, A Practical Guide to Usability Testing: Intellect Books, 1999.
[7]
Oztoprak, A., and Erbug, C. Field versus laboratory usability testing: A first comparison. Tech. rep., Department of Industrial Design - Middle East Technical University, Faculty of Architecture, 2008.
[8]
Lettner, Florian, and Clemens Holzmann. "Automated and unsupervised user interaction logging as basis for usability evaluation of mobile applications." In Proceedings of the 10th International Conference on Advances in Mobile Computing & Multimedia, pp. 118--127. ACM, 2012.
[9]
de Lera, Eva, and Muriel Garreta-Domingo. "Ten emotion heuristics: guidelines for assessing the user's affective dimension easily and cost-effectively." In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI... but not as we know it-Volume 2, pp. 163--166. British Computer Society, 2007.
[10]
Spillers, F.: Emotion as a Cognitive Artifact and the Design Implications for Products that are Perceived as Pleasurable. Retrieved on 18 February, 2007 from http://www.experiencedy-namics.com/pdfs/published_works/Spillers-EmotionDesign-Proceedings.pdf
[11]
Madrigal, D., and McClain, B. Usability for mobile devices, September 2010. http://www.ux-matters.com/mt/archives/2010/09/usabilityformobile-devices.php.
[12]
Kaikkonen, A., Kallio, T., Kekäläinen, A., Kankainen, A., and Cankar, M. Usability testing of mobile applications: A comparison between laboratory and field testing. Journal of Usability Studies 1 (2005), 4--16.
[13]
Hertzum, M. User testing in industry: A case study of laboratory, workshop, and field tests. In Proceedings of the 5th ERCIM Workshop on "User Interfaces for All" (1999).
[14]
Kjeldskov, Jesper, and Mikael B. Skov. "Was it worth the hassle?: ten years of mobile HCI research discussions on lab and field evaluations." Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services. ACM, 2014.
[15]
Feijó Filho, Jackson, Wilson Prata, and Thiago Valle. "Mobile Software Emotions Logging: Towards an Automatic Usability Evaluation." Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 2015.
[16]
Balagtas-Fernandez, F., and Hussmann, H. A methodology and framework to simplify usability analysis of mobile applications. In Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering (2009).
[17]
J. Staiano, M. Menendez, A. Battocchi, A. De Angeli, N. Sebe, UX Mate: From facial expres-sions to UX evaluation, Proceedings of the Designing Interactive Systems Conference, 741--750, ACM DIS 2012;
[18]
Zhang, D. and Adipat, B., 2005. Challenges, methodologies, and issues in the usability testing of mobile applications. International Journal of Human-Computer Interaction, 18(3), pp. 293--308.
[19]
Picard, R. W., and Daily, S. B. Evaluating affective interactions: Alternatives to asking what users feel. Presented at CHI 2005 Workshop 'Evaluating Affective Interfaces' (Portland, OR, April 2-7, 2005). Anderson, R. E. Social impacts of computing: Codes of professional ethics. Social Science Computing Review 10, 2 (1992), 453--469.

Cited By

View all
  • (2022)Definition of Guideline-Based Metrics to Evaluate AAL Ecosystem’s UsabilityHuman Behavior and Emerging Technologies10.1155/2022/89390722022(1-19)Online publication date: 14-Nov-2022
  • (2021)Facial Emotion Recognition in UX Evaluation: A Systematic ReviewHuman-Computer Interaction. Theory, Methods and Tools10.1007/978-3-030-78462-1_40(521-534)Online publication date: 3-Jul-2021
  • (2019)Toward usability problem identification based on user emotions derived from facial expressionsProceedings of the 4th International Workshop on Emotion Awareness in Software Engineering10.1109/SEmotion.2019.00008(1-7)Online publication date: 28-May-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MobileHCI '16: Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct
September 2016
664 pages
ISBN:9781450344135
DOI:10.1145/2957265
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 September 2016

Check for updates

Author Tags

  1. affective computing
  2. mobile software
  3. usability

Qualifiers

  • Demonstration

Conference

MobileHCI '16
Sponsor:

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 27 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Definition of Guideline-Based Metrics to Evaluate AAL Ecosystem’s UsabilityHuman Behavior and Emerging Technologies10.1155/2022/89390722022(1-19)Online publication date: 14-Nov-2022
  • (2021)Facial Emotion Recognition in UX Evaluation: A Systematic ReviewHuman-Computer Interaction. Theory, Methods and Tools10.1007/978-3-030-78462-1_40(521-534)Online publication date: 3-Jul-2021
  • (2019)Toward usability problem identification based on user emotions derived from facial expressionsProceedings of the 4th International Workshop on Emotion Awareness in Software Engineering10.1109/SEmotion.2019.00008(1-7)Online publication date: 28-May-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media