research-article

Using diaries for evaluating interactive products: the relevance of form and context

Authors:

OZCHI '10: Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction

Pages 204 - 207

https://doi.org/10.1145/1952222.1952266

Published: 22 November 2010 Publication History

Get Access

Abstract

In this paper we discuss two studies, in which we used incident diaries to evaluate different aspects of a web-based tool and a wearable display. For the web-based tool we used a diary in form of a table distributed in digital form, which resulted in a very low number of responses. Results from follow-up interviews revealed that one of the reasons for this low response rate was a mismatch between diary form and study context. For the wearable display we designed booklets, which featured predefined sections and questions as well as space for open comments. Although previous research has identified disadvantages of paper-based diaries, this method proved to be valuable for collecting feedback in a mobile context. Based on our experiences and the results from the studies, we provide a qualitative discussion of design issues for diaries used in mobile and desktop-based contexts.

References

[1]

Adler, A., Gujar, A., Harrison, B.L., O'Hara, K and Sellen, A. A diary study of work-related reading: design implications for digital reading devices. In Proc. CHI '98, ACM Press (1998), 241--248

Digital Library

Google Scholar

[2]

Baxter, I. and Oatley, K. Measuring the learnability of spreadsheets in inexperienced users and those with previous spreadsheet experience. In Behaviour & Information Technology, 10, 6 (1991), 475--490.

Google Scholar

[3]

Beilharz, K., Vande Moere, A., Stiel, B., Calvo, C., Tomitsch, M. and Lombard, A. Expressive Wearable Sonification and Visualisation: Design and Evaluation of a Flexible Display. In Proc. NIME 2010, 323--326.

Google Scholar

[4]

Carter, S. and Mankoff, J. When participants do the capturing: the role of media in diary Studies. In Proc. CHI '05, ACM Press (2005), 899--908.

Digital Library

Google Scholar

[5]

Czerwinski, M., Horvitz, E. and Wilhite, S. A diary study of task switching and interruptions. In Proc. CHI '04, ACM Press (2004), 175--182.

Digital Library

Google Scholar

[6]

Rieman, J. The diary study: A workplace-oriented research tool to guide laboratory efforts. In Proc. INTERACT and CHI '93, ACM Press (1993), 321--326.

Digital Library

Google Scholar

[7]

Lichtner, V., Kounkou, A. P., Dotan, A., Kooken, J. P. and Maiden, N. M. A. An online forum as a user diary for remote workplace evaluation of a work-integrated learning system. In Proc. CHI '09, ACM Press (2009), 2955--2970.

Digital Library

Google Scholar

[8]

Palen, L. and Salzman, M. Voice-mail diary studies for naturalistic data capture under mobile conditions. In Proc. CSCW '02, ACM Press (2002), 87--95.

Digital Library

Google Scholar

[9]

Schacter, D. L. The seven sins of memory: Insights from psychology and cognitive neuroscience. American Psychology, 54 (1999), 182--203.

Crossref

Google Scholar

[10]

Sellen, A. and Harper, R. Paper as an analytic Resource for the design of new technologies. In Proc. CHI '97, ACM Press (1997), 319--326.

Digital Library

Google Scholar

[11]

Sohn, T., Li, K. A., Griswold, W. G. and Hollan, J. D. A diary study of mobile information needs. In Proc. CHI '08, ACM Press (2008), 433--442.

Digital Library

Google Scholar

Cited By

View all

Rajabiyazdi FRamesh SLangstone BKulik DPontalba J(2024)TextVista: NLP-Enriched Time-Series Text Data VisualizationsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670971(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670971
Shek D(2024)Enhancement of Psychosocial Competence and Well-Being of Chinese High School Students under the COVID-19 Pandemic: Tin Ka Ping P.A.T.H.S. Project in Mainland ChinaApplied Research in Quality of Life10.1007/s11482-024-10350-919:5(2727-2748)Online publication date: 7-Aug-2024
https://doi.org/10.1007/s11482-024-10350-9
Martins ACerqueira M(2019)Ambient Assisted Living – A Multi-method Data Collection Approach to Evaluate the Usability of AAL SolutionsUsability, Accessibility and Ambient Assisted Living10.1007/978-3-319-91226-4_5(65-74)Online publication date: 22-Jan-2019
https://doi.org/10.1007/978-3-319-91226-4_5
Show More Cited By

Index Terms

Using diaries for evaluating interactive products: the relevance of form and context
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods

Recommendations

Using diaries in group based information behavior research: a methodological study
IIiX: Proceedings of the 1st international conference on Information interaction in context

This paper presents and discusses the usage of the diary method in two case studies of group members' information behavior and reflects upon the results and implications for future work. The diary focused on group members' activities and emotional ...
On the use of mobile tools in everyday life
OZCHI '07: Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces

This paper explores how mobile tools are used in everyday life and investigates the issues surrounding their usage, or indeed, their lack of usage. Personal computers support us in a wide range of our desk-bound activities, but there is still relatively ...
Enhancing self-reflection with wearable sensors
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

Advances in ubiquitous technologies have changed the way humans interact with the world around them. Technology has the power not only to inform and perform but also to further peoples' experiences of the world. It has enhanced the methodological ...

Comments

Information & Contributors

Information

Published In

OZCHI '10: Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction

November 2010

462 pages

ISBN:9781450305020

DOI:10.1145/1952222

Conference Chair:
Margot Brereton
Queensland University of Technology
,
Program Chairs:
Stephen Viller
The University of Queensland
,
Ben Kraal
Queensland University of Technology

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 November 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

OZCHI '10

Sponsor:

Symplicit
Microsoft
Smart Services CRC
NICTA
PTG Global

OZCHI '10: Proceedings of the 22th conference of the computer-human interaction special interest group of Australia on Computer-human interaction

November 22 - 26, 2010

Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 362 of 729 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
305
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rajabiyazdi FRamesh SLangstone BKulik DPontalba J(2024)TextVista: NLP-Enriched Time-Series Text Data VisualizationsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670971(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670971
Shek D(2024)Enhancement of Psychosocial Competence and Well-Being of Chinese High School Students under the COVID-19 Pandemic: Tin Ka Ping P.A.T.H.S. Project in Mainland ChinaApplied Research in Quality of Life10.1007/s11482-024-10350-919:5(2727-2748)Online publication date: 7-Aug-2024
https://doi.org/10.1007/s11482-024-10350-9
Martins ACerqueira M(2019)Ambient Assisted Living – A Multi-method Data Collection Approach to Evaluate the Usability of AAL SolutionsUsability, Accessibility and Ambient Assisted Living10.1007/978-3-319-91226-4_5(65-74)Online publication date: 22-Jan-2019
https://doi.org/10.1007/978-3-319-91226-4_5
Martins AQueirós ASilva ARocha N(2016)Usability Evaluation MethodsHuman-Computer Interaction10.4018/978-1-4666-8789-9.ch027(613-636)Online publication date: 2016
https://doi.org/10.4018/978-1-4666-8789-9.ch027
Almahmoud JAlmalki AAlrashed TAlwabil A(2016)Prototyping Complex Systems: A Diary Study Approach to Understand the Design ProcessDesign, User Experience, and Usability: Design Thinking and Methods10.1007/978-3-319-40409-7_19(187-196)Online publication date: 22-Jun-2016
https://doi.org/10.1007/978-3-319-40409-7_19
Martins AQueirós ASilva ARocha N(2015)Usability Evaluation MethodsHuman Factors in Software Development and Design10.4018/978-1-4666-6485-2.ch013(250-273)Online publication date: 2015
https://doi.org/10.4018/978-1-4666-6485-2.ch013

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Using diaries in group based information behavior research: a methodological study

On the use of mobile tools in everyday life

Enhancing self-reflection with wearable sensors

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations