skip to main content
10.1145/3613905.3650767acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Work in Progress

Contextual AI Journaling: Integrating LLM and Time Series Behavioral Sensing Technology to Promote Self-Reflection and Well-being using the MindScape App

Published: 11 May 2024 Publication History

Abstract

MindScape aims to study the benefits of integrating time series behavioral patterns (e.g., conversational engagement, sleep, location) with Large Language Models (LLMs) to create a new form of contextual AI journaling, promoting self-reflection and well-being. We argue that integrating behavioral sensing in LLMs will likely lead to a new frontier in AI. In this Late-Breaking Work paper, we discuss the MindScape contextual journal App design that uses LLMs and behavioral sensing to generate contextual and personalized journaling prompts crafted to encourage self-reflection and emotional development. We also discuss the MindScape study of college students based on a preliminary user study and our upcoming study to assess the effectiveness of contextual AI journaling in promoting better well-being on college campuses. MindScape represents a new application class that embeds behavioral intelligence in AI.

Supplemental Material

MP4 File - Video Preview
Video Preview
Transcript for: Video Preview

References

[1]
Dorit Alt and Nirit Raichel. 2020. Reflective journaling and metacognitive awareness: Insights from a longitudinal study in higher education. Reflective Practice 21, 2 (2020), 145–158.
[2]
Apple. 2024. Get started with Journal on iPhone. https://support.apple.com/guide/iphone/get-started-with-journal-iph0e5ca7dd3/ios
[3]
Louise Aronson. 2010. Twelve tips for teaching reflection at all levels of medical education. Medical Teacher 33, 3 (Sept. 2010), 200–205. https://doi.org/10.3109/0142159x.2010.507714
[4]
American College Health Association. 2024. American College Health Association-National College Health Assessment III: Reference Group Executive Summary Spring 2023. https://www.acha.org/documents/ncha/NCHA-III_SPRING_2023_REFERENCE_GROUP_EXECUTIVE_SUMMARY.pdf
[5]
Ruth A Baer, Gregory T Smith, Jaclyn Hopkins, Jennifer Krietemeyer, and Leslie Toney. 2006. Using self-report assessment methods to explore facets of mindfulness. Assessment 13, 1 (2006), 27–45.
[6]
David Bakker and Nikki Rickard. 2018. Engagement in mobile phone app for self-monitoring of emotional wellbeing predicts changes in mental health: MoodPrism. Journal of Affective Disorders 227 (Feb. 2018), 432–442. https://doi.org/10.1016/j.jad.2017.11.016
[7]
Rebecca Beiter, Ryan Nash, Melissa McCrady, Donna Rhoades, Mallori Linscomb, Molly Clarahan, and Stephen Sammut. 2015. The prevalence and correlates of depression, anxiety, and stress in a sample of college students. Journal of affective disorders 173 (2015), 90–96.
[8]
Herbert Benson and Eileen M Stuart. 1993. The wellness book: The comprehensive guide to maintaining health and treating stress-related illness. Simon and Schuster.
[9]
Ananya Bhattacharjee, Dana Kulzhabayeva, Mohi Reza, Harsh Kumar, Eunchae Seong, Xuening Wu, Mohammad Rashidujjaman Rifat, Robert Bowman, Rachel Kornfield, Alex Mariakakis, Syed Ishtiaque Ahmed, Munmun De Choudhury, Gavin Doherty, Mary P Czerwinski, and Joseph Jay Williams. 2023. Integrating Individual and Social Contexts into Self-Reflection Technologies. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI EA ’23). Association for Computing Machinery, New York, NY, USA, Article 356, 6 pages. https://doi.org/10.1145/3544549.3573803
[10]
Ananya Bhattacharjee, Yuchen Zeng, Sarah Yi Xu, Dana Kulzhabayeva, Minyi Ma, Rachel Kornfield, Syed Ishtiaque Ahmed, Alex Mariakakis, Mary P Czerwinski, Anastasia Kuzminykh, 2023. Understanding the Role of Large Language Models in Personalizing and Scaffolding Strategies to Combat Academic Procrastination. arXiv preprint arXiv:2312.13581 (2023).
[11]
R Biswas-Diener. 2009. New measures of well-being: Flourishing and positive and negative feelings. Social Indicators Research 39 (2009), 247–266.
[12]
Canan Cengiz. 2020. The effect of structured journals on reflection levels: With or without question prompts?Australian Journal of Teacher Education (Online) 45, 2 (2020), 23–43.
[13]
Nian-Shing Chen, Chun-Wang Wei, Kuen-Ting Wu, and Lorna Uden. 2009. Effects of high level prompts and peer assessment on online learners’ reflection levels. Computers & Education 52, 2 (Feb. 2009), 283–291. https://doi.org/10.1016/j.compedu.2008.08.007
[14]
Yu Ying Chiu, Ashish Sharma, Inna Wanyin Lin, and Tim Althoff. 2024. A Computational Framework for Behavioral Assessment of LLM Therapists. arXiv preprint arXiv:2401.00820 (2024).
[15]
Janghee Cho, Tian Xu, Abigail Zimmermann-Niefield, and Stephen Voida. 2022. Reflection in Theory and Reflection in Practice: An Exploration of the Gaps in Reflection Support among Personal Informatics Apps. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 142, 23 pages. https://doi.org/10.1145/3491102.3501991
[16]
Leah R Dickens. 2017. Using gratitude to promote positive change: A series of meta-analyses investigating the effectiveness of gratitude interventions. Basic and Applied Social Psychology 39, 4 (2017), 193–208.
[17]
Lynda J. Dimitroff, Linda Sliwoski, Sue O’Brien, and Lynn W. Nichols. 2016. Change your life through journaling–The benefits of journaling for registered nurses. Journal of Nursing Education and Practice 7, 2 (Oct. 2016). https://doi.org/10.5430/jnep.v7n2p90
[18]
Alessio Ferrara. 2022. Empowering emotional well-being through a LLM-based chatbot: a comparative study with the standard journaling technique. (2022).
[19]
Xun Ge and Susan M. Land. 2003. Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions. Educational Technology Research and Development 51, 1 (March 2003), 21–38. https://doi.org/10.1007/bf02504515
[20]
Inga Glogger, Lars Holzäpfel, Rolf Schwonke, Matthias Nückles, and Alexander Renkl. 2009. Activation of Learning Strategies in Writing Learning Journals: The Specificity of Prompts Matters. Zeitschrift für Pädagogische Psychologie 23, 2 (Jan. 2009), 95–104. https://doi.org/10.1024/1010-0652.23.2.95
[21]
James J Gross and Oliver P John. 2003. Individual differences in two emotion regulation processes: implications for affect, relationships, and well-being.Journal of personality and social psychology 85, 2 (2003), 348.
[22]
Barbara A Gueldner, Laura L Feuerborn, and Kenneth W Merrell. 2020. Social and emotional learning in the classroom: Promoting mental health and academic success. Guilford Publications.
[23]
Yining Hua, Fenglin Liu, Kailai Yang, Zehan Li, Yi-han Sheu, Peilin Zhou, Lauren V Moran, Sophia Ananiadou, and Andrew Beam. 2024. Large Language Models in Mental Health Care: a Scoping Review. arXiv preprint arXiv:2401.02984 (2024).
[24]
Karsen N Keech and Patricia G Coberly-Holt. 2021. Journaling for Mental Health. In Strategies and Tactics for Multidisciplinary Writing. IGI Global, 39–44.
[25]
Mina J Kian, Mingyu Zong, Katrin Fischer, Abhyuday Singh, Anna-Maria Velentza, Pau Sang, Shriya Upadhyay, Anika Gupta, Misha A Faruki, Wallace Browning, 2024. Can an LLM-Powered Socially Assistive Robot Effectively and Safely Deliver Cognitive Behavioral Therapy? A Study With University Students. arXiv preprint arXiv:2402.17937 (2024).
[26]
Taewan Kim, Seolyeong Bae, Hyun Ah Kim, Su-woo Lee, Hwajung Hong, Chanmo Yang, and Young-Ho Kim. 2023. MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients’ Journaling. arXiv preprint arXiv:2310.05231 (2023).
[27]
Taewan Kim, Donghoon Shin, Young-Ho Kim, and Hwajung Hong. 2024. DiaryMate: Exploring the Roles of Large Language Models in Facilitating AI-mediated Journaling. (2024).
[28]
Rafal Kocielnik, Lillian Xiao, Daniel Avrahami, and Gary Hsieh. 2018. Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 1–26. https://doi.org/10.1145/3214273
[29]
Harsh Kumar, Yiyi Wang, Jiakai Shi, Ilya Musabirov, Norman AS Farb, and Joseph Jay Williams. 2023. Exploring the use of large language models for improving the awareness of mindfulness. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1–7.
[30]
Zhuoyang Li, Minhui Liang, Hai Trung Le, Ray Lc, and Yuhan Luo. 2023. Exploring Design Opportunities for Reflective Conversational Agents to Reduce Compulsive Smartphone Use. In Proceedings of the 5th International Conference on Conversational User Interfaces (Eindhoven, Netherlands) (CUI ’23). Association for Computing Machinery, New York, NY, USA, Article 37, 6 pages. https://doi.org/10.1145/3571884.3604305
[31]
SC Matz, JD Teeny, H Peters, GM Harari, and M Cerf. 2024. The potential of generative AI for personalized persuasion at scale. Scientific Reports 14, 1 (2024), 4692.
[32]
William Miller. 2014. Interactive journaling as a clinical tool. Journal of Mental Health Counseling 36, 1 (2014), 31–42.
[33]
Mohammad Mofatteh. 2021. Risk factors associated with stress, anxiety, and depression among university undergraduate students. AIMS public health 8, 1 (2021), 36.
[34]
Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Nick Barnes, and Ajmal Mian. 2023. A Comprehensive Overview of Large Language Models. arXiv preprint arXiv:2307.06435 (2023).
[35]
Subigya Nepal, Wenjun Liu, Arvind Pillai, Weichen Wang, Vlado Vojdanovski, Jeremy F. Huckins, Courtney Rogers, Meghan L. Meyer, and Andrew T. Campbell. 2024. Capturing the College Experience: A Four-Year Mobile Sensing Study of Mental Health, Resilience and Behavior of College Students during the Pandemic. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 1, Article 38 (mar 2024), 37 pages. https://doi.org/10.1145/3643501
[36]
Jingping Nie, Hanya Shao, Yuang Fan, Qijia Shao, Haoxuan You, Matthias Preindl, and Xiaofan Jiang. 2024. LLM-based Conversational AI Therapist for Daily Functioning Screening and Psychotherapeutic Intervention via Everyday Smart Devices. arXiv preprint arXiv:2403.10779 (2024).
[37]
OpenAI. 2023. GPT-4 Technical Report. arxiv:2303.08774 [cs.CL]
[38]
OpenAI. 2024. OpenAI. https://openai.com
[39]
Sarah Rudrum, Rebecca Casey, Lesley Frank, Rachel K. Brickner, Sami MacKenzie, Jesse Carlson, and Elisabeth Rondinelli. 2022. Qualitative Research Studies Online: Using Prompted Weekly Journal Entries During the COVID-19 Pandemic. International Journal of Qualitative Methods 21 (Jan. 2022), 160940692210931. https://doi.org/10.1177/16094069221093138
[40]
Carol D Ryff and Corey Lee M Keyes. 1995. The structure of psychological well-being revisited.Journal of personality and social psychology 69, 4 (1995), 719.
[41]
Ashish Sharma, Kevin Rushton, Inna Wanyin Lin, Theresa Nguyen, and Tim Althoff. 2023. Facilitating self-guided mental health interventions through human-language model interaction: A case study of cognitive restructuring. arXiv preprint arXiv:2310.15461 (2023).
[42]
Joshua M Smyth, Jillian A Johnson, Brandon J Auer, Erik Lehman, Giampaolo Talamo, and Christopher N Sciamanna. 2018. Online Positive Affect Journaling in the Improvement of Mental Distress and Well-Being in General Medical Patients With Elevated Anxiety Symptoms: A Preliminary Randomized Controlled Trial. JMIR Mental Health 5, 4 (Dec. 2018), e11290. https://doi.org/10.2196/11290
[43]
Monika Sohal, Pavneet Singh, Bhupinder Singh Dhillon, and Harbir Singh Gill. 2022. Efficacy of journaling in the management of mental illness: a systematic review and meta-analysis. Family medicine and community health 10, 1 (2022).
[44]
Bryce E Stoliker and Kathryn D Lafreniere. 2015. The influence of perceived stress, loneliness, and learning burnout on university students’ educational experience. College student journal 49, 1 (2015), 146–160.
[45]
Dusica L Tosevski, Milica P Milovancevic, and Saveta D Gajic. 2010. Personality and psychopathology of university students. Current opinion in psychiatry 23, 1 (2010), 48–52.
[46]
Weichen Wang, Subigya Nepal, Jeremy F Huckins, Lessley Hernandez, Vlado Vojdanovski, Dante Mack, Jane Plomp, Arvind Pillai, Mikio Obuchi, Alex Dasilva, 2022. First-gen lens: Assessing mental health of first-generation students across their first year at college using mobile sensing. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 6, 2 (2022), 1–32.
[47]
Gail B Williams, Margit B Gerardi, Sara L Gill, Mark D Soucy, and Donna H Taliaferro. 2009. Reflective journaling: Innovative strategy for self-awareness for graduate nursing students. International Journal of Human Caring 13, 3 (2009), 36–43.
[48]
Ruolan Wu, Chun Yu, Xiaole Pan, Yujia Liu, Ningning Zhang, Yue Fu, Yuhan Wang, Zhi Zheng, Li Chen, Qiaolei Jiang, Xuhai Xu, and Yuanchun Shi. 2023. MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Intervention. https://doi.org/10.48550/ARXIV.2309.16639
[49]
Xuhai Xu, Bingsheng Yao, Yuanzhe Dong, Saadia Gabriel, Hong Yu, James Hendler, Marzyeh Ghassemi, Anind K. Dey, and Dakuo Wang. 2024. Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 1, Article 31 (mar 2024), 32 pages. https://doi.org/10.1145/3643540
[50]
Shun Yi Yeo, Gionnieve Lim, Jie Gao, Weiyu Zhang, and Simon Tangi Perrault. 2024. Help Me Reflect: Leveraging Self-Reflection Interface Nudges to Enhance Deliberativeness on Online Deliberation Platforms. arXiv preprint arXiv:2401.10820 (2024).
[51]
Andrea Zaccaro, Andrea Piarulli, Marco Laurino, Erika Garbella, Danilo Menicucci, Bruno Neri, and Angelo Gemignani. 2018. How Breath-Control Can Change Your Life: A Systematic Review on Psycho-Physiological Correlates of Slow Breathing. Frontiers in Human Neuroscience 12 (Sept. 2018). https://doi.org/10.3389/fnhum.2018.00353

Cited By

View all
  • (2024)Mean-Field-Type TransformersMathematics10.3390/math1222350612:22(3506)Online publication date: 9-Nov-2024
  • (2024)Models for exploring the credibility of large language models for mental health support: Protocol for a scoping review (Preprint)JMIR Research Protocols10.2196/62865Online publication date: 3-Jun-2024
  • (2024)MindScape Study: Integrating LLM and Behavioral Sensing for Personalized AI-Driven Journaling ExperiencesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997618:4(1-44)Online publication date: 21-Nov-2024
  • Show More Cited By

Index Terms

  1. Contextual AI Journaling: Integrating LLM and Time Series Behavioral Sensing Technology to Promote Self-Reflection and Well-being using the MindScape App

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems
      May 2024
      4761 pages
      ISBN:9798400703317
      DOI:10.1145/3613905
      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 11 May 2024

      Check for updates

      Author Tags

      1. AI
      2. Behavioral Sensing
      3. Journaling
      4. Large Language Models
      5. Mental Health
      6. Passive Sensing
      7. Self-reflection
      8. Smartphones
      9. Well-being

      Qualifiers

      • Work in progress
      • Research
      • Refereed limited

      Funding Sources

      Conference

      CHI '24

      Acceptance Rates

      Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

      Upcoming Conference

      CHI 2025
      ACM CHI Conference on Human Factors in Computing Systems
      April 26 - May 1, 2025
      Yokohama , Japan

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1,722
      • Downloads (Last 6 weeks)263
      Reflects downloads up to 17 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Mean-Field-Type TransformersMathematics10.3390/math1222350612:22(3506)Online publication date: 9-Nov-2024
      • (2024)Models for exploring the credibility of large language models for mental health support: Protocol for a scoping review (Preprint)JMIR Research Protocols10.2196/62865Online publication date: 3-Jun-2024
      • (2024)MindScape Study: Integrating LLM and Behavioral Sensing for Personalized AI-Driven Journaling ExperiencesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997618:4(1-44)Online publication date: 21-Nov-2024
      • (2024)Beyond Detection: Towards Actionable Sensing Research in Clinical Mental HealthcareProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997558:4(1-33)Online publication date: 21-Nov-2024
      • (2024)Exploring User Willingness towards Mobile Sensing and Intervention: A Case Study on Mental Health of Undergraduate College StudentsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678422(721-728)Online publication date: 5-Oct-2024
      • (2024)AutoJournaling: A Context-Aware Journaling System Leveraging MLLMs on Smartphone ScreenshotsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3698122(2347-2352)Online publication date: 4-Dec-2024

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media