Lillio Mok
Skip Abstract Section
Abstract
As online platforms become ubiquitous, there is growing concern that their use can potentially lead to negative outcomes in users' personal lives, such as disrupted sleep and impacted social relationships. A central question in the literature studying these problematic effects is whether they are associated with the amount of time users spend on online platforms. This is often addressed by either analyzing self-reported measures of time spent online, which are generally inaccurate, or using objective metrics derived from server logs or tracking software. Nonetheless, how the two types of time measures comparatively relate to problematic effects -- whether they complement or are redundant with each other in predicting problematicity -- remains unknown. Additionally, transparent research into this question is hindered by the literature's focus on closed platforms with inaccessible data, as well as selective analytical decisions that may lead to reproducibility issues.
In this work, we investigate how both self-reported and data-derived metrics of time spent relate to potentially problematic effects arising from the use of an open, non-profit online chess platform. These effects include disruptions to sleep, relationships, school and work performance, and self-control. To this end, we distributed a gamified survey to players and linked their responses with publicly-available game logs. We find problematic effects to be associated with both self-reported and data-derived usage measures to similar degrees. However, analytical models incorporating both self-reported and actual time explain problematic effects significantly more effectively than models with either type of measure alone. Furthermore, these results persist across thousands of possible analytical decisions when using a robust and transparent statistical framework. This suggests that the two methods of measuring time spent measure contain distinct, complementary information about problematic usage outcomes and should be used in conjunction with each other.
- 2019. Lichess.org Press Kit. Retrieved September 18, 2019 from https://lichess.cdn.prismic.io/lichess%2F758a8bb6-c1c5-4982-9c6b-6fcebeea424f_2018-03-04-lichess-press-kit.pdfGoogle Scholar
- Sami Abuhamdeh and Mihaly Csikszentmihalyi. 2012. The importance of challenge for the enjoyment of intrinsically motivated, goal-directed activities. Personality and Social Psychology Bulletin, Vol. 38, 3 (2012), 317--330.Google ScholarCross Ref
- Hunt Allcott, Luca Braghieri, Sarah Eichmeyer, and Matthew Gentzkow. 2020. The welfare effects of social media. American Economic Review, Vol. 110, 3 (2020), 629--76.Google ScholarCross Ref
- American Psychiatric Association and others. 2013. Diagnostic and statistical manual of mental disorders. BMC Med, Vol. 17 (2013), 133--137.Google Scholar
- Ashton Anderson and Etan A Green. 2018. Personal bests as reference points. Proceedings of the National Academy of Sciences, Vol. 115, 8 (2018), 1772--1776.Google ScholarCross Ref
- Cecilie Schou Andreassen, Torbjørn Torsheim, Geir Scott Brunborg, and Ståle Pallesen. 2012. Development of a Facebook addiction scale. Psychological reports, Vol. 110, 2 (2012), 501--517.Google Scholar
- Julie H Aranda and Safia Baig. 2018. Toward JOMO: the joy of missing out and the freedom of disconnecting. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, 19.Google ScholarDigital Library
- Adriana Bianchi and James G Phillips. 2005. Psychological predictors of problem mobile phone use. CyberPsychology & Behavior, Vol. 8, 1 (2005), 39--51.Google ScholarCross Ref
- Jeffrey Boase and Rich Ling. 2013. Measuring mobile phone use: Self-report versus log data. Journal of Computer-Mediated Communication, Vol. 18, 4 (2013), 508--519.Google ScholarCross Ref
- Moira Burke, Cameron Marlow, and Thomas Lento. 2010. Social network activity and social well-being. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 1909--1912.Google ScholarDigital Library
- Neralie Cain and Michael Gradisar. 2010. Electronic media use and sleep in school-aged children and adolescents: A review. Sleep medicine, Vol. 11, 8 (2010), 735--742.Google ScholarCross Ref
- Scott Caplan, Dmitri Williams, and Nick Yee. 2009. Problematic Internet use and psychosocial well-being among MMO players. Computers in human behavior, Vol. 25, 6 (2009), 1312--1319.Google Scholar
- Hilarie Cash, Cosette D Rae, Ann H Steel, and Alexander Winkler. 2012. Internet addiction: A brief summary of research and practice. Current psychiatry reviews, Vol. 8, 4 (2012), 292--298.Google Scholar
- Justin Cheng, Moira Burke, and Elena Goetz Davis. 2019. Understanding Perceptions of Problematic Facebook Use: When People Experience Negative Life Impact and a Lack of Control. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 199.Google ScholarDigital Library
- Robert S Davidson and Page B Walley. 1985. Computer fear and addiction: Analysis, prevention and possible modification. Journal of Organizational Behavior Management, Vol. 6, 3--4 (1985), 37--52.Google ScholarCross Ref
- Amandeep Dhir, Puneet Kaur, Sufen Chen, and Kirsti Lonka. 2016. Understanding online regret experience in Facebook use--Effects of brand participation, accessibility & problematic use. Computers in Human Behavior, Vol. 59 (2016), 420--430.Google ScholarDigital Library
- Tony Durkee, Michael Kaess, Vladimir Carli, Peter Parzer, Camilla Wasserman, Birgitta Floderus, Alan Apter, Judit Balazs, Shira Barzilay, Julio Bobes, et almbox. 2012. Prevalence of pathological internet use among adolescents in Europe: demographic and social factors. Addiction, Vol. 107, 12 (2012), 2210--2222.Google ScholarCross Ref
- Sindhu Kiranmai Ernala, Moira Burke, Alex Leavitt, and Nicole B Ellison. 2020. How well do people report time spent on Facebook? An evaluation of established survey questions with recommendations. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1--14.Google ScholarDigital Library
- Isabela Granic, Adam Lobel, and Rutger CME Engels. 2014. The benefits of playing video games. American psychologist, Vol. 69, 1 (2014), 66.Google Scholar
- Colin M Gray, Yubo Kou, Bryan Battles, Joseph Hoggatt, and Austin L Toombs. 2018. The dark (patterns) side of UX design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 534.Google ScholarDigital Library
- Mark D Griffiths. 1991. Amusement machine playing in childhood and adolescence: A comparative analysis of video games and fruit machines. Journal of adolescence, Vol. 14, 1 (1991), 53--73.Google ScholarCross Ref
- Mark D Griffiths. 2000. Does Internet and computer" addiction" exist? Some case study evidence. CyberPsychology and Behavior, Vol. 3, 2 (2000), 211--218.Google ScholarCross Ref
- Melissa G Hunt, Rachel Marx, Courtney Lipson, and Jordyn Young. 2018. No more FOMO: Limiting social media decreases loneliness and depression. Journal of Social and Clinical Psychology, Vol. 37, 10 (2018), 751--768.Google ScholarCross Ref
- Reynol Junco. 2013. Comparing actual and self-reported measures of Facebook use. Computers in Human Behavior, Vol. 29, 3 (2013), 626--631.Google ScholarDigital Library
- Adam S Kahn, Rabindra Ratan, and Dmitri Williams. 2014. Why we distort in self-report: Predictors of self-report errors in video game play. Journal of Computer-Mediated Communication, Vol. 19, 4 (2014), 1010--1023.Google ScholarDigital Library
- Ronald C Kessler, Irving Hwang, Richard LaBrie, Maria Petukhova, Nancy A Sampson, Ken C Winters, and Howard J Shaffer. 2008. DSM-IV pathological gambling in the National Comorbidity Survey Replication. Psychological medicine, Vol. 38, 9 (2008), 1351--1360.Google Scholar
- Dongil Kim, Yunhee Lee, Juyoung Lee, JeeEun Karin Nam, and Yeoju Chung. 2014. Development of Korean smartphone addiction proneness scale for youth. PloS one, Vol. 9, 5 (2014), e97920.Google ScholarCross Ref
- Daniel L King, Maria C Haagsma, Paul H Delfabbro, Michael Gradisar, and Mark D Griffiths. 2013. Toward a consensus definition of pathological video-gaming: A systematic review of psychometric assessment tools. Clinical psychology review, Vol. 33, 3 (2013), 331--342.Google Scholar
- Aniket Kittur, Ed H Chi, and Bongwon Suh. 2008. Crowdsourcing user studies with Mechanical Turk. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 453--456.Google ScholarDigital Library
- Geza Kovacs, Zhengxuan Wu, and Michael S Bernstein. 2018. Rotating Online Behavior Change Interventions Increases Effectiveness But Also Increases Attrition. Proceedings of the ACM on Human-Computer Interaction, Vol. 2, CSCW (2018), 95.Google ScholarDigital Library
- Daria J Kuss and Mark D Griffiths. 2011. Online social networking and addiction -- a review of the psychological literature. International journal of environmental research and public health, Vol. 8, 9 (2011), 3528--3552.Google ScholarCross Ref
- Daria J Kuss and Mark D Griffiths. 2012. Internet gaming addiction: A systematic review of empirical research. International Journal of Mental Health and Addiction, Vol. 10, 2 (2012), 278--296.Google ScholarCross Ref
- Daria J Kuss, Mark D Griffiths, Laurent Karila, and Jöel Billieux. 2014. Internet addiction: A systematic review of epidemiological research for the last decade. Current pharmaceutical design, Vol. 20, 25 (2014), 4026--4052.Google Scholar
- Min Kwon, Dai-Jin Kim, Hyun Cho, and Soo Yang. 2013a. The smartphone addiction scale: development and validation of a short version for adolescents. PloS one, Vol. 8, 12 (2013), e83558.Google ScholarCross Ref
- Min Kwon, Joon-Yeop Lee, Wang-Youn Won, Jae-Woo Park, Jung-Ah Min, Changtae Hahn, Xinyu Gu, Ji-Hye Choi, and Dai-Jin Kim. 2013b. Development and validation of a smartphone addiction scale (SAS). PloS one, Vol. 8, 2 (2013), e56936.Google ScholarCross Ref
- Robert LaRose, Carolyn A Lin, and Matthew S Eastin. 2003. Unregulated Internet usage: Addiction, habit, or deficient self-regulation? Media Psychology, Vol. 5, 3 (2003), 225--253.Google ScholarCross Ref
- Uichin Lee, Joonwon Lee, Minsam Ko, Changhun Lee, Yuhwan Kim, Subin Yang, Koji Yatani, Gahgene Gweon, Kyong-Mee Chung, and Junehwa Song. 2014. Hooked on smartphones: an exploratory study on smartphone overuse among college students. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 2327--2336.Google ScholarDigital Library
- Jeroen S Lemmens, Patti M Valkenburg, and Jochen Peter. 2009. Development and validation of a game addiction scale for adolescents. Media psychology, Vol. 12, 1 (2009), 77--95.Google Scholar
- Shao-Kang Lo, Chih-Chien Wang, and Wenchang Fang. 2005. Physical interpersonal relationships and social anxiety among online game players. Cyberpsychology & behavior, Vol. 8, 1 (2005), 15--20.Google Scholar
- Ulrik Lyngs, Kai Lukoff, Petr Slovak, Reuben Binns, Adam Slack, Michael Inzlicht, Max Van Kleek, and Nigel Shadbolt. 2019. Self-Control in Cyberspace: Applying Dual Systems Theory to a Review of Digital Self-Control Tools. arXiv preprint arXiv:1902.00157 (2019).Google ScholarDigital Library
- Robert McIlwraith, Robin Smith Jacobvitz, Robert Kubey, and Alison Alexander. 1991. Television addiction: Theories and data behind the ubiquitous metaphor. American Behavioral Scientist, Vol. 35, 2 (1991), 104--121.Google ScholarCross Ref
- G-J Meerkerk, Regina JJM Van Den Eijnden, Ad A Vermulst, and Henk FL Garretsen. 2009. The compulsive internet use scale (CIUS): some psychometric properties. Cyberpsychology & behavior, Vol. 12, 1 (2009), 1--6.Google Scholar
- Monty Newborn. 2012. Kasparov versus Deep Blue: Computer chess comes of age. Springer Science & Business Media.Google Scholar
- Amy Orben, Tobias Dienlin, and Andrew K Przybylski. 2019. Social media's enduring effect on adolescent life satisfaction. Proceedings of the National Academy of Sciences, Vol. 116, 21 (2019), 10226--10228.Google ScholarCross Ref
- Amy Orben and Andrew K Przybylski. 2019. The association between adolescent well-being and digital technology use. Nature Human Behaviour, Vol. 3, 2 (2019), 173.Google ScholarCross Ref
- Andrew K Przybylski and Netta Weinstein. 2017. A large-scale test of the Goldilocks Hypothesis: Quantifying the relations between digital-screen use and the mental well-being of adolescents. Psychological Science, Vol. 28, 2 (2017), 204--215.Google ScholarCross Ref
- John Rooksby, Parvin Asadzadeh, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2016. Personal tracking of screen time on digital devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 284--296.Google ScholarDigital Library
- Tracii Ryan, Andrea Chester, John Reece, and Sophia Xenos. 2014. The uses and abuses of Facebook: A review of Facebook addiction.Google Scholar
- Matthew J Salganik. 2017. Bit by bit: social research in the digital age. Princeton University Press.Google Scholar
- Michael Scharkow. 2016. The accuracy of self-reported internet use-A validation study using client log data. Communication Methods and Measures, Vol. 10, 1 (2016), 13--27.Google ScholarCross Ref
- A Fleming Seay and Robert E Kraut. 2007. Project massive: Self-regulation and problematic use of online gaming. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 829--838.Google ScholarDigital Library
- Choonsung Shin and Anind K Dey. 2013. Automatically detecting problematic use of smartphones. In Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing. ACM, 335--344.Google ScholarDigital Library
- Uri Simonsohn, Joseph P Simmons, and Leif D Nelson. 2015. Specification curve: Descriptive and inferential statistics on all reasonable specifications. Available at SSRN 2694998 (2015).Google Scholar
- Ricardo A Tejeiro Salguero and Rosa M Bersabé Morán. 2002. Measuring problem video game playing in adolescents. Addiction, Vol. 97, 12 (2002), 1601--1606.Google ScholarCross Ref
- Naomi J Thomas and Frances Heritage Martin. 2010. Video-arcade game, computer game and Internet activities of Australian students: Participation habits and prevalence of addiction. Australian Journal of Psychology, Vol. 62, 2 (2010), 59--66.Google ScholarCross Ref
- Jean M Twenge, Thomas E Joiner, Megan L Rogers, and Gabrielle N Martin. 2018. Increases in depressive symptoms, suicide-related outcomes, and suicide rates among US adolescents after 2010 and links to increased new media screen time. Clinical Psychological Science, Vol. 6, 1 (2018), 3--17.Google ScholarCross Ref
- Antonius J Van Rooij, Tim M Schoenmakers, Ad A Vermulst, Regina JJM Van Den Eijnden, and Dike Van De Mheen. 2011. Online video game addiction: identification of addicted adolescent gamers. addiction, Vol. 106, 1 (2011), 205--212.Google Scholar
- Steve Whittaker, Vaiva Kalnikaite, Victoria Hollis, and Andrew Guydish. 2016. 'Don't Waste My Time': Use of Time Information Improves Focus. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1729--1738.Google ScholarDigital Library
- Dmitri Williams, Mia Consalvo, Scott Caplan, and Nick Yee. 2009. Looking for gender: Gender roles and behaviors among online gamers. Journal of communication, Vol. 59, 4 (2009), 700--725.Google ScholarCross Ref
- Peter M Yellowlees and Shayna Marks. 2007. Problematic Internet use or Internet addiction? Computers in human behavior, Vol. 23, 3 (2007), 1447--1453.Google Scholar
- Kimberly S Young. 1996. Psychology of computer use: XL. Addictive use of the Internet: a case that breaks the stereotype. Psychological reports, Vol. 79, 3 (1996), 899--902.Google Scholar
- Kimberly S Young. 1998. Internet addiction: The emergence of a new clinical disorder. Cyberpsychology & behavior, Vol. 1, 3 (1998), 237--244.Google Scholar
- Kimberly S Young and Carl J Case. 2004. Internet abuse in the workplace: new trends in risk management. CyberPsychology & Behavior, Vol. 7, 1 (2004), 105--111.Google ScholarCross Ref
- David Zendle and Paul Cairns. 2018. Video game loot boxes are linked to problem gambling: Results of a large-scale survey. PloS one, Vol. 13, 11 (2018), e0206767.Google ScholarCross Ref
Index Terms
- The Complementary Nature of Perceived and Actual Time Spent Online in Measuring Digital Well-being
Recommendations
Time spent online
Studies of youth social media use (SMU) often focus on its frequency, measuring how much time they spend online. While informative, this perspective is only one way of viewing SMU. Consistent with uses and gratification theory, another is to consider ...
Differences between specific and generalized problematic Internet uses according to gender, age, time spent online and psychopathological symptoms
Highlights- Some specific problematic Internet uses present a great impact on generalized problematic Internet use.
AbstractInternet addiction has been the subject of numerous studies, but definitions, classification and terminologies for this phenomenon diverge. Thus, it appears important to distinguish Generalized Problematic Internet Use (GPIU) and ...
Online sexual engagement and psychosocial well-being: The mediating role of sexual victimization experiences
AbstractYoung people use online communication technologies to provide intimate information to each other and exchange sexual content and messages. When such information is misunderstood or misused by others, it may result in harmful ...
Highlights- Nearly one fourth has experienced sexual victimization online at least once.
- ...
Comments