Javier Hernandez
Daniel McDuff
Karen Quigley
ABSTRACT
The Experience Sampling Method is widely used for collecting self-report responses from people in natural settings. While most traditional approaches rely on using a phone to trigger prompts and record information, wearable devices now offer new opportunities that may improve this method. This research quantitatively and qualitatively studies the experience sampling process on head-worn and wrist-worn wearable devices, and compares them to the traditional "smartphone in the pocket." To enable this work, we designed and implemented a custom application to provide similar prompts across the three types of devices and evaluated it with 15 individuals for five days (75 days total), in the context of real-life stress measurement. We found significant differences in response times across devices, and captured tradeoffs in interaction types, screen size, and device familiarity that can affect both users' experience and the reports made by users.
- Phil Adams, Mashfiqui Rabbi, Tauhidur Rahman, et al. 2014. Towards Personal Stress Informatics: Comparing Minimally Invasive Techniques for Measuring Daily Stress in the Wild. Proceedings of International Conference on Pervasive Computing Technologies for Healthcare, 72--79. Google Scholar
Digital Library
- Yadid Ayzenberg, Javier Hernandez, and Rosalind W. Picard. 2012. FEEL: frequent EDA and event logging - a mobile social interaction stress monitoring system. Extended Abstracts of Human Factors in Computing Systems, 2357--2362. Google ScholarDigital Library
- Arnold B. Bakker and Evangelia Demerouti. 2007. The Job Demands-Resources model: state of the art. Journal of Managerial Psychology 22, 3: 309--328.Google ScholarCross Ref
- Daniel J. Beal. 2015. ESM 2.0: State of the Art Of, Future Potential Sampling, Experience Organizational, Methods in Research. The Annual Review of Organizational Psychology and Organizational Behavior, 383--407.Google Scholar
- Elliot T. Berkman, Nicole R. Giuliani, and Alicia K. Pruitt. 2014. Comparison of text messaging and paper-and-pencil for ecological momentary assessment of food craving and intake. Appetite 81: 131--137.Google ScholarCross Ref
- Niall Bolger, Angelina Davis, and Eshkol Rafaeli. 2003. Diary methods: capturing life as it is lived. Annual Review of Psychology 54: 579--616.Google ScholarCross Ref
- Chris. J. Burgin, Paul J. Silvia, Kari M. Eddington, and Thomas R. Kwapil. 2012. Palm or Cell? Comparing Personal Digital Assistants and Cell Phones for Experience Sampling Research. Social Science Computer Review 31, 2: 244--251. Google ScholarDigital Library
- Karen Church, Mauro Cherubini, and Nuria Oliver. 2014. A large-scale study of daily information needs captured in situ. ACM Transactions on Computer-Human Interaction 21, 2: 1--46. Google ScholarDigital Library
- Tamlin S. Conner, Howard Tennen, William Fleeson, and Lisa Feldman Barrett. 2009. Experience Sampling Methods: A Modern Idiographic Approach to Personality Research. Social and Personality Psychology Compass 3, 3: 292--313.Google ScholarCross Ref
- Tamlin S. Conner. 2015. Experience sampling and ecological momentary assessment with mobile phones, http://www.otago.ac.nz/psychology/otago047475.pdfGoogle Scholar
- Sunny Consolvo and Miriam Walker. 2003. Using the experience sampling method to evaluate Ubicomp applications. IEEE Pervasive Computing 2, 2: 24--31. Google ScholarDigital Library
- Mihaly Csikszentmihalyi, Reed Larson, and Suzanne Prescott. 1977. The ecology of adolescent activity and experience. Journal of Youth and Adolescence 6, 3: 281--294.Google ScholarCross Ref
- Evangelia Demerouti, Arnold B. Bakker, Friedhelm Nachreiner, and Wilmar B. Schaufeli. 2001. The job demands-resources model of burnout. Journal of Applied Psychology 86, 3: 499--512.Google ScholarCross Ref
- Jon Froehlich, Mike Y. Chen, Sunny Consolvo, Beverly Harrison, and James A. Landay. 2007. MyExperience: A System for In situ Tracing and Capturing of User Feedback on Mobile Phones. Proceedings of Mobile Systems, Applications and Services, 57--70. Google ScholarDigital Library
- Joel M. Hektner, Jennifer A. Schmidt, and Mihaly Csikszentmihalyi. 2007. Experience Sampling Method: Measuring the Quality of Everyday Life. SAGE Publications.Google Scholar
- Grace Hu, Lily Chen, Johanna Okerlund, and Orit Shaer. 2015. Exploring the Use of Google Glass in Wet Laboratories. Proceedings of Extended Abstracts on Human Factors in Computing Systems, 2103--2108. Google ScholarDigital Library
- Daniel Kahneman, Alan B. Krueger, David A. Schkade, Norbert Schwarz, and Arthur A. Stone. 2004. A survey method for characterizing daily life experience: the day reconstruction method. Science (New York) 306, 5702: 1776--1780.Google Scholar
- Vassilis-Javed Khan, Panos Markopoulos, Berry Eggen, Wijnand IJsselsteijn, and Boris de Ruyter. 2008. Reconexp: a way to reduce the data loss of the experiencing sampling method. Proceedings on Human Computer Interaction with Mobile Devices and Services, 471--476. Google ScholarDigital Library
- Reed Larson and Mihaly Csikszentmihalyi. 1983. The Experience Sampling Method. New Directions for Methodology of Social & Behavioral Science 15: 41--56.Google Scholar
- James A. Russell. 1980. A Circumplex model of affect. Journal of Personality and Social Psychology 39, 6: 1161--1178.Google ScholarCross Ref
- Philipp M. Scholl, Marko Borazio, Martin Jansch, and Kristof Van Laerhoven. 2014. Diary-Like Long-Term Activity Recognition: Touch or Voice Interaction? International Conference on Wearable and Implantable Body Sensor Networks Workshops, 42--45. Google ScholarDigital Library
- Saul Shiffman, Arthur A. Stone, and Michael R. Hufford. 2008. Ecological momentary assessment. Annual Review of Clinical Psychology 4: 1--32.Google ScholarCross Ref
- Janko Timmermann, Wilko Heuten, and Susanne Boll. 2015. Input Methods for the Borg-RPE-Scale on Smartwatches. International Conference on Pervasive Computing Technologies for Healthcare, 80--83. Google ScholarDigital Library
Index Terms
- Wearable ESM: differences in the experience sampling method across wearable devices
Recommendations
Microinteraction Ecological Momentary Assessment Response Rates: Effect of Microinteractions or the Smartwatch?
Mobile-based ecological-momentary-assessment (EMA) is an in-situ measurement methodology where an electronic device prompts a person to answer questions of research interest. EMA has a key limitation: interruption burden. Microinteraction-EMA(µEMA) may ...
MyMove: Facilitating Older Adults to Collect In-Situ Activity Labels on a Smartwatch with Speech
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsCurrent activity tracking technologies are largely trained on younger adults’ data, which can lead to solutions that are not well-suited for older adults. To build activity trackers for older adults, it is crucial to collect training data with them. To ...
Effect of experience sampling schedules on response rate and recall accuracy of objective self-reports
Research highlights- We investigate the effect of random, interval, and smartphone-unlock based questionnaires
AbstractThe Experience Sampling Method is widely used to collect human labelled data in the wild. Using this methodology, study participants repeatedly answer a set of questions, constructing a rich overview of the studied phenomena. One of ...
Comments