short-paper

Reflections on Temporal Factors in Interaction Design: A Study of User Engagement in a Platform for Professional Learning

Authors:

Martin Tomitsch,

Jen Scott Curwood,

Kate ThomsonAuthors Info & Claims

OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-Interaction

Pages 442 - 446

https://doi.org/10.1145/3369457.3369513

Published: 10 January 2020 Publication History

Abstract

This paper reflects on insights from the design process and evaluation of an online tool for supporting professional learning in a higher education setting. The online tool was developed through an iterative user-centred design process to ensure that it supported the needs and goals of academics. However, findings from a semester-long evaluation study showed that it found relatively little uptake despite participants' positive feedback in post-study interviews. This prompted us to conduct a further analysis of our results, which revealed that our process had failed to capture some of the more nuanced factors emerging from the users' work environment relating to time and timing. Drawing on those insights, the paper highlights the need to capture temporal factors during the design process and offers three design considerations to better support the adoption of online tools into daily work practices.

References

[1]

Abowd, G. D., Dey, A. K., Brown, P. J., Davies, N., Smith, M., & Steggles, P. (1999, September). Towards a better understanding of context and context-awareness. In International symposium on handheld and ubiquitous computing (pp. 304--307). Springer, Berlin, Heidelberg.

[2]

Andersen, P. B. (2006). Activity-based design. European Journal of Information Systems, 15(1), 9--25.

Digital Library

[3]

Bevan, Nigel, James Carter, and Susan Harker. "ISO 9241-11 revised: What have we learnt about usability since 1998?." In International Conference on Human-Computer Interaction, pp. 143--151. Springer, Cham, 2015.

[4]

Blackler, A. L., Gomez, R., Popovic, V., & Thompson, M. H. (2014). Life is too short to RTFM: how users relate to documentation and excess features in consumer products. Interacting with Computers, 28(1), 27--46.

[5]

Bødker, S., & Andersen, P. B. (2005). Complex mediation. Human-computer interaction, 20(4), 353--402.

[6]

Curwood, J. S., Tomitsch, M., Thomson, K., & Hendry, G. (2015). Professional learning in higher education: Understanding how academics interpret student feedback and access resources to improve their teaching. Australasian Journal of Educational Technology, 31(5).

[7]

Garrett, Jesse James. Elements of user experience, the: user-centered design for the web and beyond. Pearson Education, 2010.

Digital Library

[8]

Grudin, J. (1988). Why CSCW applications fail: Problems in the design and evaluation of organizational interfaces. In CSCW '88: Proceedings of the 1988 ACM conference on Computer-supported cooperative work, pp. 85--93, ACM.

Digital Library

[9]

Guskey, T. R. (2007). Closing achievement gaps: revisiting Benjamin S. Bloom's "Learning for Mastery". Journal of advanced academics, 19(1), 8--31.

[10]

Hassenzahl, Marc, and Noam Tractinsky. "User experience-a research agenda." Behaviour & information technology 25, no. 2 (2006): 91--97.

[11]

Hung, M. L., Chou, C., Chen, C. H., & Own, Z. Y. (2010). Learner readiness for online learning: Scale development and student perceptions. Computers & Education, 55(3), 1080--1090.

Digital Library

[12]

Konzett, M., Tomitsch, M., & Grechenig, T. Designing an SMS-based application for seaweed farmers in Zanzibar (and why it failed for now). INTERACT 2009 Workshop: Ethics, Roles & Relationships in Interaction Design in Developing Regions.

[13]

Lew, Philip, Luis Olsina, and Li Zhang. "Quality, quality in use, actual usability and user experience as key drivers for web application evaluation." In International Conference on Web Engineering, pp. 218--232. Springer, Berlin, Heidelberg, 2010.

[14]

O'Brien, H. L., & Toms, E. G. (2008). What is user engagement? A conceptual framework for defining user engagement with technology. Journal of the American society for Information Science and Technology, 59(6), 938--955.

[15]

Preece, Jenny, Yvonne Rogers, and Helen Sharp. Interaction design: beyond human-computer interaction. John Wiley & Sons, 2015.

Digital Library

[16]

Saffer, Dan. Designing for interaction: creating innovative applications and devices. New Riders, 2010.

[17]

Thomke, S., & Reinertsen, D. (2012). Six myths of product development. Harvard Business Review, 90(5), 84--94.

[18]

Thomson, K., Curwood, J.S., & Tomitsch, M. (2016). Participatory professional development: designing a mobile website that links student feedback with best practice teaching resources. In Proceedings of the 39th annual conference of the Higher Education research and Development Society of Australasia (HERDSA), 4-7 July 2016, Fremantle, WA.

[19]

van Kuijk, J., Kanis, H., Christiaans, H., & van Eijk, D. (2017). Barriers to and enablers of usability in electronic consumer product development: a multiple case study. Human-Computer Interaction, 32(1), 1--71.

Digital Library

[20]

Yoo, Sun Joo, and Wenhao David Huang. "Engaging online adult learners in higher education: Motivational factors impacted by gender, age, and prior experiences." The Journal of Continuing Higher Education 61, no. 3 (2013): 151--164.

Cited By

Tomitsch MJanssen ACurwood JThomson K(2020)Insights into the interrelationship between the design process and user practice: a case study on user engagement in a platform for professional learningEnterprise Information Systems10.1080/17517575.2020.185641615:10(1546-1561)Online publication date: 6-Dec-2020
https://doi.org/10.1080/17517575.2020.1856416

Index Terms

Reflections on Temporal Factors in Interaction Design: A Study of User Engagement in a Platform for Professional Learning
1. Human-centered computing
  1. Interaction design
    1. Empirical studies in interaction design
2. Information systems
  1. Information systems applications
    1. Enterprise information systems
      1. Enterprise applications

Recommendations

On the development of electronic design tools and associated guidelines for supporting the early stages of the design process
DESIRE '11: Procedings of the Second Conference on Creativity and Innovation in Design

According to the user-centred design (UCD) philosophy, users should be involved as much as possible in the different stages of the design process, to optimize the likelihood that design proposals will be appreciated by users. In this paper, first we ...
User-Sensitive Inclusive Design
Special Issue: Innovations in user sensitive design, research and development

Although “User-Centred”, “Participatory”, and other similar design approaches have proved to be very valuable for mainstream design, their principles are more difficult to apply successfully when the user group contains, or is composed of, older and/or ...
As with Wine, Life Gets Better with Age. Redefining Mobile User Interface (UI) Components in the Age-Friendly Design Transformation
Cross-Cultural Design
Abstract
Due to the lack of experience in the age-friendly design transformation, small and medium-sized enterprises typically do not have relevant research capabilities for pursuing relevant data to meet the standards. Currently they rigidly apply the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

OzCHI '19: Proceedings of the 31st Australian Conference on Human-Computer-Interaction

December 2019

631 pages

ISBN:9781450376969

DOI:10.1145/3369457

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

In-Cooperation

HFESA: Human Factors and Ergonomics Society of Australia Inc.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 January 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Conference

OZCHI'19

OZCHI'19: 31ST AUSTRALIAN CONFERENCE ON HUMAN-COMPUTER-INTERACTION

December 2 - 5, 2019

WA, Fremantle, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
100
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tomitsch MJanssen ACurwood JThomson K(2020)Insights into the interrelationship between the design process and user practice: a case study on user engagement in a platform for professional learningEnterprise Information Systems10.1080/17517575.2020.185641615:10(1546-1561)Online publication date: 6-Dec-2020
https://doi.org/10.1080/17517575.2020.1856416

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten