skip to main content
10.1145/3301019.3323905acmconferencesArticle/Chapter ViewAbstractPublication PagesdisConference Proceedingsconference-collections
Work in Progress

Towards Low-burden In-situ Self-reporting: A Design Space Exploration

Published: 18 June 2019 Publication History

Abstract

In-situ self-reporting is a widely-used data collection method which offers many benefits in the clinical, psychological and social research fields. However, high capture burden issues have surfaced as in-situ self-reporting expands and diversifies in various studies. Thus, we draw attention to the design space of low-burden in-situ self-reporting. In this work-in-progress, drawing on literature analysis, we explore the design space by analyzing and mapping context-dependent attention resources, current interactive methods, and associated design requirements. In the case study, we further demonstrate the use of the design space to derive low-burden experience sampling solutions. Overall, we stress that reducing in-situ self-report burdens requires research attention, and the design space can help designers make sensible design decisions.

References

[1]
Alexander T. Adams, Elizabeth L. Murnane, Phil Adams, Michael Elfenbein, Pamara F. Chang, Shruti Sannon, Geri Gay, and Tanzeem Choudhury. 2018. Keppi: A Tangible User Interface for Self-Reporting Pain. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 502, 502:1--502:13 pages.
[2]
Phil Adams, Mashfiqui Rabbi, Tauhidur Rahman, Mark Matthews, Amy Voida, Geri Gay, Tanzeem Choudhury, and Stephen Voida. 2014. Towards Personal Stress Informatics: Comparing Minimally Invasive Techniques for Measuring Daily Stress in the Wild. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth '14). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 72--79.
[3]
Madeline Alsmeyer, Rosemary Luckin, and Judith Good. 2008. Developing a Novel Interface for Capturing Self Reports of Affect. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 2883--2888.
[4]
Daniel Ashbrook, Patrick Baudisch, and Sean White. 2011. Nenya: Subtle and Eyes-free Mobile Input with a Magnetically-tracked Finger Ring. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2043--2046.
[5]
Sinem Aslan, Eda Okur, Nese Alyuz, Sinem Emine Mete, Ece Oktay, Utku Genc, and Asli Arslan Esme. 2017. Students' Emotional Self-labels for Personalized Models. In Proceedings of the Seventh International Learning Analytics & Knowledge Conference (LAK '17). ACM, New York, NY, USA, 550--551.
[6]
Shiri Azenkot, Cynthia L. Bennett, and Richard E. Ladner. 2013. DigiTaps: Eyes-free Number Entry on Touchscreens with Minimal Audio Feedback. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 85--90.
[7]
Kayne Barclay, Danny Wei, Christof Lutteroth, and Robert Sheehan. 2011. A Quantitative Quality Model for Gesture Based User Interfaces. In Proceedings of the 23rd Australian Computer-Human Interaction Conference (OzCHI '11). ACM, New York, NY, USA, 31--39.
[8]
Niall Bolger, Angelina Davis, and Eshkol Rafaeli. 2003. Diary methods: Capturing life as it is lived. Annual review of psychology 54, 1 (2003), 579--616.
[9]
Vikram Cannanure, Xiang Chen, and Jennifer Mankoff. 2016. Twist $&$ Knock: A One-handed Gesture for Smart Watches. In Proceedings of the 42Nd Graphics Interface Conference (GI '16). Canadian Human-Computer Communications Society, School of Computer Science, University of Waterloo, Waterloo, Ontario, Canada, 189--193.
[10]
Scott Carter, Jennifer Mankoff, and Jeffrey Heer. 2007. Momento: support for situated ubicomp experimentation. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 125--134.
[11]
Larry Chan, Vedant Das Swain, Christina Kelley, Kaya de Barbaro, Gregory D. Abowd, and Lauren Wilcox. 2018. Students' Experiences with Ecological Momentary Assessment Tools to Report on Emotional Well-being. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 3 (March 2018), 3:1--3:20 pages.
[12]
Nelson Cowan. 1988. Evolving conceptions of memory storage, selective attention, and their mutual constraints within the human information-processing system. Psychological bulletin 104, 2 (1988), 163.
[13]
Andrew Crossan, John Williamson, Stephen Brewster, and Rod Murray-Smith. 2008. Wrist Rotation for Interaction in Mobile Contexts. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services (MobileHCI '08). ACM, New York, NY, USA, 435--438.
[14]
Rajkumar Darbar, Prasanta Kr Sen, and Debasis Samanta. 2016. PressTact: Side Pressure-Based Input for Smartwatch Interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 2431--2438.
[15]
Euan Freeman, Gareth Griffiths, and Stephen A. Brewster. 2017. Rhythmic Micro-gestures: Discreet Interaction On-the-go. In Proceedings of the 19th ACM International Conference on Multimodal Interaction (ICMI '17). ACM, New York, NY, USA, 115--119.
[16]
Jon Froehlich, Mike Y Chen, Sunny Consolvo, Beverly Harrison, and James A Landay. 2007a. MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones. In Proceedings of the 5th international conference on Mobile systems, applications and services. ACM, 57--70.
[17]
Jon Froehlich, Mike Y. Chen, Sunny Consolvo, Beverly Harrison, and James A. Landay. 2007b. MyExperience: A System for in Situ Tracing and Capturing of User Feedback on Mobile Phones. In Proceedings of the 5th International Conference on Mobile Systems, Applications and Services (MobiSys '07). ACM, New York, NY, USA, 57--70.
[18]
Julian Frommel, Katja Rogers, Julia Brich, Daniel Besserer, Leonard Bradatsch, Isabel Ortinau, Ramona Schabenberger, Valentin Riemer, Claudia Schrader, and Michael Weber. 2015. Integrated Questionnaires: Maintaining Presence in Game Environments for Self-Reported Data Acquisition. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '15). ACM, New York, NY, USA, 359--368.
[19]
Andrea Gaggioli, Giovanni Pioggia, Gennaro Tartarisco, Giovanni Baldus, Daniele Corda, Pietro Cipresso, and Giuseppe Riva. 2013. A Mobile Data Collection Platform for Mental Health Research. Personal Ubiquitous Comput. 17, 2 (Feb. 2013), 241--251.
[20]
Sarah E. Garcia and Laura M. Hammond. 2016. Capturing & Measuring Emotions in UX. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 777--785.
[21]
Javier Hernandez, Daniel McDuff, Christian Infante, Pattie Maes, Karen Quigley, and Rosalind Picard. 2016. Wearable ESM: Differences in the Experience Sampling Method Across Wearable Devices. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM, New York, NY, USA, 195--205.
[22]
John Hicks, Nithya Ramanathan, Donnie Kim, Mohamad Monibi, Joshua Selsky, Mark Hansen, and Deborah Estrin. 2010. AndWellness: An Open Mobile System for Activity and Experience Sampling. In Wireless Health 2010 (WH '10). ACM, New York, NY, USA, 34--43.
[23]
Stephen Intille, Caitlin Haynes, Dharam Maniar, Aditya Ponnada, and Justin Manjourides. 2016. μEMA: Microinteraction-based Ecological Momentary Assessment (EMA) Using a Smartwatch. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 1124--1128.
[24]
Rushil Khurana, Nikola Banovic, and Kent Lyons. 2018. In Only 3 Minutes: Perceived Exertion Limits of Smartwatch Use. In Proceedings of the 2018 ACM International Symposium on Wearable Computers (ISWC '18). ACM, New York, NY, USA, 208--211.
[25]
Predrag Klasnja, Beverly L. Harrison, Louis LeGrand, Anthony LaMarca, Jon Froehlich, and Scott E. Hudson. 2008. Using Wearable Sensors and Real Time Inference to Understand Human Recall of Routine Activities. In Proceedings of the 10th International Conference on Ubiquitous Computing (UbiComp '08). ACM, New York, NY, USA, 154--163.
[26]
Sven Kratz and Michael Rohs. 2009. HoverFlow: Expanding the Design Space of Around-device Interaction. In Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '09). ACM, New York, NY, USA, Article 4, 4:1--4:8 pages.
[27]
Shu-Yang Lin, Chao-Huai Su, Kai-Yin Cheng, Rong-Hao Liang, Tzu-Hao Kuo, and Bing-Yu Chen. 2011. Pub - Point Upon Body: Exploring Eyes-free Interaction and Methods on an Arm. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 481--488.
[28]
Andreas Möller, Matthias Kranz, Barbara Schmid, Luis Roalter, and Stefan Diewald. 2013a. Investigating Self-reporting Behavior in Long-term Studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2931--2940.
[29]
Andreas Möller, Matthias Kranz, Barbara Schmid, Luis Roalter, and Stefan Diewald. 2013b. Investigating Self-reporting Behavior in Long-term Studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2931--2940.
[30]
Rafael Morales González, Caroline Appert, Gilles Bailly, and Emmanuel Pietriga. 2017. Passive Yet Expressive TouchTokens. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3741--3745.
[31]
Ken Nakagaki, Sean Follmer, and Hiroshi Ishii. 2015. LineFORM: Actuated Curve Interfaces for Display, Interaction, and Constraint. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 333--339.
[32]
Gaurav Paruthi, Shriti Raj, Seungjoo Baek, Chuyao Wang, Chuan-che Huang, Yung-Ju Chang, and Mark W. Newman. 2018. Heed: Exploring the Design of Situated Self-Reporting Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 3, Article 132 (Sept. 2018), 132:1--132:21 pages.
[33]
Jerome Pasquero, Scott J. Stobbe, and Noel Stonehouse. 2011a. A Haptic Wristwatch for Eyes-free Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3257--3266.
[34]
Jerome Pasquero, Scott J. Stobbe, and Noel Stonehouse. 2011b. A Haptic Wristwatch for Eyes-free Interactions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3257--3266.
[35]
Simon T. Perrault, Eric Lecolinet, James Eagan, and Yves Guiard. 2013. Watchit: Simple Gestures and Eyes-free Interaction for Wristwatches and Bracelets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1451--1460.
[36]
Tauhidur Rahman, Mi Zhang, Stephen Voida, and Tanzeem Choudhury. 2014. Towards Accurate Non-intrusive Recollection of Stress Levels Using Mobile Sensing and Contextual Recall. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth '14). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 166--169.
[37]
Anne Roudaut, Andreas Rau, Christoph Sterz, Max Plauth, Pedro Lopes, and Patrick Baudisch. 2013. Gesture Output: Eyes-free Output Using a Force Feedback Touch Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 2547--2556.
[38]
Philipp M. Scholl, Marko Borazio, Martin J"ansch, and Kristof Van Laerhoven. 2014. Diary-Like Long-Term Activity Recognition: Touch or Voice Interaction?. In Proceedings of the 2014 11th International Conference on Wearable and Implantable Body Sensor Networks Workshops (BSNWORKSHOPS '14). IEEE Computer Society, Washington, DC, USA, 42--45.
[39]
Lei Shi, Maryam Ashoori, Yunfeng Zhang, and Shiri Azenkot. 2018. Knock Knock, What's There: Converting Passive Objects into Customizable Smart Controllers. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). ACM, New York, NY, USA, Article 31, 31:1--31:13 pages.
[40]
Hyewon Suh, Nina Shahriaree, Eric B. Hekler, and Julie A. Kientz. 2016. Developing and Validating the User Burden Scale: A Tool for Assessing User Burden in Computing Systems. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3988--3999.
[41]
Shelley E Taylor, William T Welch, Heejung S Kim, and David K Sherman. 2007. Cultural differences in the impact of social support on psychological and biological stress responses. Psychological Science 18, 9 (2007), 831--837.
[42]
Khai N. Truong, Thariq Shihipar, and Daniel J. Wigdor. 2014. Slide to X: Unlocking the Potential of Smartphone Unlocking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3635--3644.
[43]
Julio Vega, Samuel Couth, Ellen Poliakoff, Sonja Kotz, Matthew Sullivan, Caroline Jay, Markel Vigo, and Simon Harper. 2018. Back to Analogue: Self-Reporting for Parkinson's Disease. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, New York, NY, USA, Article 74, 74:1--74:13 pages.
[44]
Cheng-Yao Wang, Min-Chieh Hsiu, Po-Tsung Chiu, Chiao-Hui Chang, Liwei Chan, Bing-Yu Chen, and Mike Y. Chen. 2015. PalmGesture: Using Palms As Gesture Interfaces for Eyes-free Input. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 217--226.
[45]
Rui Wang, Fanglin Chen, Zhenyu Chen, Tianxing Li, Gabriella Harari, Stefanie Tignor, Xia Zhou, Dror Ben-Zeev, and Andrew T. Campbell. 2014. StudentLife: Assessing Mental Health, Academic Performance and Behavioral Trends of College Students Using Smartphones. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, New York, NY, USA, 3--14.
[46]
Christopher D Wickens. 2002. Multiple resources and performance prediction. Theoretical issues in ergonomics science 3, 2 (2002), 159--177.
[47]
Christopher D Wickens. 2008. Multiple resources and mental workload. Human factors 50, 3 (2008), 449--455.
[48]
Graham Wilson, Euan Freeman, and Stephen Brewster. 2016. Multimodal Affective Feedback: Combining Thermal, Vibrotactile, Audio and Visual Signals. In Proceedings of the 18th ACM International Conference on Multimodal Interaction (ICMI '16). ACM, New York, NY, USA, 400--401.
[49]
Xiaoyi Zhang, Laura R. Pina, and James Fogarty. 2016. Examining Unlock Journaling with Diaries and Reminders for In Situ Self-Report in Health and Wellness. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 5658--5664.
[50]
Shengdong Zhao, Pierre Dragicevic, Mark Chignell, Ravin Balakrishnan, and Patrick Baudisch. 2007. Earpod: Eyes-free Menu Selection Using Touch Input and Reactive Audio Feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1395--1404.

Cited By

View all
  • (2022)Domain-Specific Keyword Extraction Using Joint Modeling of Local and Global Contextual SemanticsACM Transactions on Knowledge Discovery from Data10.1145/349456016:4(1-30)Online publication date: 8-Jan-2022
  • (2022)Tangible Self-Report Devices: Accuracy and Resolution of Participant InputProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501309(1-14)Online publication date: 13-Feb-2022
  • (2021)To See or Not to SeeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34481235:1(1-25)Online publication date: 30-Mar-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DIS '19 Companion: Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion
June 2019
410 pages
ISBN:9781450362702
DOI:10.1145/3301019
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2019

Check for updates

Author Tags

  1. design space analysis
  2. in-situ self-reporting
  3. interaction techniques
  4. low-burden

Qualifiers

  • Work in progress

Conference

DIS '19
Sponsor:
DIS '19: Designing Interactive Systems Conference 2019
June 23 - 28, 2019
CA, San Diego, USA

Acceptance Rates

DIS '19 Companion Paper Acceptance Rate 105 of 415 submissions, 25%;
Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25
Designing Interactive Systems Conference
July 5 - 9, 2025
Funchal , Portugal

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)10
  • Downloads (Last 6 weeks)5
Reflects downloads up to 05 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2022)Domain-Specific Keyword Extraction Using Joint Modeling of Local and Global Contextual SemanticsACM Transactions on Knowledge Discovery from Data10.1145/349456016:4(1-30)Online publication date: 8-Jan-2022
  • (2022)Tangible Self-Report Devices: Accuracy and Resolution of Participant InputProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501309(1-14)Online publication date: 13-Feb-2022
  • (2021)To See or Not to SeeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34481235:1(1-25)Online publication date: 30-Mar-2021
  • (2021)User Burden of Microinteractions: An In-lab Experiment Examining User Performance and Perceived Burden Related to In-situ Self-reportingProceedings of the 23rd International Conference on Mobile Human-Computer Interaction10.1145/3447526.3472046(1-14)Online publication date: 27-Sep-2021
  • (2021)Evaluating User Experiences in Mixed RealityExtended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411763.3441337(1-5)Online publication date: 8-May-2021
  • (2020)Toward Lightweight In-situ Self-reportingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34322124:4(1-22)Online publication date: 18-Dec-2020

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media