Seoyoung Kim
ABSTRACT
Thanks to advanced sensing and logging technology, automatic personality assessment (APA) with users' behavioral data in the workplace is on the rise. While previous work has focused on building APA systems with high accuracy, little research has attempted to understand users' perception towards APA systems. To fill this gap, we take a mixed-methods approach: we (1) designed a survey (n=89) to understand users'social workplace behavior both online and offline and their privacy concerns; (2) built a research probe that detects personality from online and offline data streams with up to 81.3% accuracy, and deployed it for three weeks in Korea (n=32); and (3) conducted post-interviews (n=9). We identify privacy issues in sharing data and system-induced change in natural behavior as important design factors for APA systems. Our findings suggest that designers should consider the complex relationship between users' perception and system accuracy for a more user-centered APA design.
Supplemental Material
Available for Download
srt
paper123pvc.srt (543 B)
Preview video captions
zip
paper123aux.zip (1.1 MB)
Auxiliary materials contain survey questionnaire, raw data entry formats with samples of the collected data streams, a full list of extracted features along with methods on how they were extracted, and the interview process. The materials are all in PDF format.
- Mark S Allen, Emma E Walter, and Máirtín S McDermott. 2017. Personality and sedentary behavior: A systematic review and meta-analysis. Health Psychology 36, 3 (2017), 255.Google Scholar
Cross Ref
- Lyndsey L Bakewell, Konstantina Vasileiou, Kiel S Long, Mark Atkinson, Helen Rice, Manuela Barreto, Julie Barnett, Michael Wilson, Shaun Lawson, and John Vines. 2018. Everything we do, everything we press: Data-driven remote performance management in a mobile workplace. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 371.Google ScholarDigital Library
- Gene Ball and Jack Breese. 2000. Relating personality and behavior: posture and gestures. In Affective interactions. Springer, 196--203.Google ScholarCross Ref
- Kirstie Ball. 2010. Workplace surveillance: An overview. Labor History 51, 1 (2010), 87--106.Google ScholarCross Ref
- Murray R Barrick and Michael K Mount. 1991. The big five personality dimensions and job performance: a meta-analysis. Personnel psychology 44, 1 (1991), 1--26.Google Scholar
- Ligia Maria Batrinca, Nadia Mana, Bruno Lepri, Fabio Pianesi, and Nicu Sebe. 2011. Please, tell me about yourself: automatic personality assessment using short self-presentations. In Proceedings of the 13th international conference on multimodal interfaces. ACM, 255--262.Google ScholarDigital Library
- Shlomo Berkovsky, Ronnie Taib, Irena Koprinska, Eileen Wang, Yucheng Zeng, Jingjie Li, and Sabina Kleitman. 2019. Detecting Personality Traits Using Eye-Tracking Data. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 221.Google ScholarDigital Library
- Tim Blumer and Nicola Döring. 2012. Are we the same online? The expression of the five factor personality traits on the computer and the Internet. Cyberpsychology: Journal of Psychosocial Research on Cyberspace 6, 3 (2012).Google Scholar
- Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77--101.Google Scholar
- Neil Christiansen and Robert Tett. 2013. Handbook of personality at work. Routledge.Google Scholar
- Philip J Corr and Gerald Matthews. 2009. The Cambridge handbook of personality psychology. Cambridge University Press Cambridge, UK:.Google Scholar
- CPP. 2018. CPP - The MyersBriggs®Company. (2018). https://www.cpp.com/ Last Accessed: 2018-08-09.Google Scholar
- Yves-Alexandre de Montjoye, Jordi Quoidbach, Florent Robic, and Alex Sandy Pentland. 2013. Predicting personality using novel mobile phone-based metrics. In International conference on social computing, behavioral-cultural modeling, and prediction. Springer, 48--55.Google ScholarDigital Library
- Berkeley J Dietvorst, Joseph P Simmons, and Cade Massey. 2015. Algorithm aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General 144, 1 (2015), 114.Google ScholarCross Ref
- Alain Dössegger, Nicole Ruch, Gerda Jimmy, Charlotte Braun-Fahrländer, Urs Mäder, Johanna Hänggi, Heidi Hofmann, Jardena J Puder, Susi Kriemler, and Bettina Bringolf-Isler. 2014. Reactivity to accelerometer measurement of children and adolescents. Medicine and science in sports and exercise 46, 6 (2014), 1140.Google Scholar
- John T Foley, Michael W Beets, and Bradley J Cardinal. 2011. Monitoring children's physical activity with pedometers: Reactivity revisited. Journal of Exercise Science & Fitness 9, 2 (2011), 82--86.Google ScholarCross Ref
- Howard S Friedman, M Robin DiMatteo, and Angelo Taranta. 1980. A study of the relationship between individual differences in nonverbal expressiveness and factors of personality and social interaction. Journal of Research in Personality 14, 3 (1980), 351--364.Google ScholarCross Ref
- Jennifer Golbeck, Cristina Robles, and Karen Turner. 2011. Predicting personality with social media. In CHI'11 extended abstracts on human factors in computing systems. ACM, 253--262.Google ScholarDigital Library
- Lewis R Goldberg. 1992. The development of markers for the Big-Five factor structure. Psychological assessment 4, 1 (1992), 26.Google Scholar
- Liang Gou, Michelle X Zhou, and Huahai Yang. 2014. KnowMe and ShareMe: understanding automatically discovered personality traits from social media and user sharing preferences. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 955--964.Google ScholarDigital Library
- Heather Hausenblas and Ryan E Rhodes. 2016. ExErcisE Psychology. (2016).Google Scholar
- Paul P Heppner, Bruce E Wampold, and Dennis M Kivlighan. 2007. Research design in counseling: Research, statistics, & program evaluation. Cengage Learning (2007).Google Scholar
- Everard Ho and Vichita Vathanophas. 2003. Relating personality traits and prior knowledge to focus group process and outcome: an exploratory research. PACIS 2003 Proceedings (2003), 67.Google Scholar
- Alan E Kazdin. 1974. Reactive self-monitoring: the effects of response desirability, goal setting, and feedback. Journal of consulting and clinical psychology 42, 5 (1974), 704.Google ScholarCross Ref
- Alan E Kazdin. 1979. Unobtrusive measures in behavioral assessment. Journal of Applied Behavior Analysis 12, 4 (1979), 713--724.Google ScholarCross Ref
- Seoyoung Kim, Jiyoun Ha, and Juho Kim. 2018. Detecting Personality Unobtrusively from Users' Online and Offline Workplace Behaviors. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, LBW515.Google ScholarDigital Library
- Sandjar Kozubaev, Fernando Rochaix, Carl DiSalvo, and Christopher A Le Dantec. 2019. Spaces and Traces: Implications of Smart Technology in Public Housing. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 439.Google ScholarDigital Library
- Kibeom Lee, Michael C Ashton, and Kang-Hyun Shin. 2005. Personality correlates of workplace anti-social behavior. Applied Psychology 54, 1 (2005), 81--98.Google ScholarCross Ref
- Weijian Li, Yuxiao Chen, Tianran Hu, and Jiebo Luo. 2018. Mining the Relationship between Emoji Usage Patterns and Personality. arXiv preprint arXiv:1804.05143 (2018).Google Scholar
- Jennifer M Logg, Julia A Minson, and Don A Moore. 2019. Algorithm appreciation: People prefer algorithmic to human judgment. Organizational Behavior and Human Decision Processes 151 (2019), 90--103.Google ScholarCross Ref
- Ioanna Lykourentzou, Angeliki Antoniou, Yannick Naudet, and Steven P Dow. 2016. Personality matters: Balancing for personality types leads to better outcomes for crowd teams. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 260--273.Google ScholarDigital Library
- Jennifer Dodorico McDonald. 2008. Measuring personality constructs: The advantages and disadvantages of self-reports, informant reports and behavioural assessments. Enquire 1, 1 (2008), 1--19.Google Scholar
- Walter Mischel. 2013. Personality and assessment. Psychology Press.Google Scholar
- Isabel Briggs Myers, Mary H McCaulley, and Robert Most. 1985. Manual, a guide to the development and use of the Myers-Briggs type indicator. consulting psychologists press.Google Scholar
- Daniel Olgun Olgun, Peter A Gloor, and Alex Sandy Pentland. 2009. Capturing individual and group behavior with wearable sensors. In Proceedings of the 2009 aaai spring symposium on human behavior modeling, SSS, Vol. 9.Google Scholar
- Chanda Phelan, Cliff Lampe, and Paul Resnick. 2016. It's creepy, but it doesn't bother me. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 5240--5251.Google ScholarDigital Library
- Brent W Roberts. 2009. Back to the future: Personality and assessment and personality development. Journal of research in personality 43, 2 (2009), 137--145.Google ScholarCross Ref
- Ivan Robertson and Militza Callinan. 1998. Personality and work behaviour. European Journal of Work and Organizational Psychology 7, 3 (1998), 321--340.Google ScholarCross Ref
- Christine Satchell and Paul Dourish. 2009. Beyond the user: use and non-use in HCI. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7. ACM, 9--16.Google ScholarDigital Library
- Stefan Schneegass, Romina Poguntke, and Tonja Machulla. 2019. Understanding the Impact of Information Representation on Willingness to Share Information. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 523.Google ScholarDigital Library
- Lee Taber and Steve Whittaker. 2018. Personality depends on the medium: differences in self-perception on Snapchat, Facebook and offline. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 607.Google ScholarDigital Library
- Jeffrey Warshaw, Tara Matthews, Steve Whittaker, Chris Kau, Mateo Bengualid, and Barton A Smith. 2015. Can an Algorithm Know the Real You?: Understanding People's Reactions to Hyper-personal Analytics Systems. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 797--806.Google ScholarDigital Library
- Ziang Xiao, Michelle X Zhou, and Wat-Tat Fu. 2019. Who should be my teammates: Using a conversational agent to understand individuals and help teaming. In Proceedings of the 24th International Conference on Intelligent User Interfaces. ACM, 437--447.Google ScholarDigital Library
- Lingling Xu, Cheng Yi, and Yunjie Xu. 2007. Emotional expression online: The impact of task, relationship and personality perception on emoticon usage in instant messenger. PACIS 2007 Proceedings (2007), 79.Google Scholar
- Penghang Yin, Jiancheng Lyu, Shuai Zhang, Stanley Osher, Yingyong Qi, and Jack Xin. 2019. Understanding straight-through estimator in training activation quantized neural nets. arXiv preprint arXiv:1903.05662 (2019).Google Scholar
Index Terms
- Understanding Users' Perception Towards Automated Personality Detection with Group-specific Behavioral Data
Recommendations
Smart, useful, scary, creepy: perceptions of online behavioral advertising
SOUPS '12: Proceedings of the Eighth Symposium on Usable Privacy and SecurityWe report results of 48 semi-structured interviews about online behavioral advertising (OBA). We investigated non-technical users' attitudes about and understanding of OBA, using participants' expectations and beliefs to explain their attitudes. ...
What matters to users?: factors that affect users' willingness to share information with online advertisers
SOUPS '13: Proceedings of the Ninth Symposium on Usable Privacy and SecurityMuch of the debate surrounding online behavioral advertising (OBA) has centered on how to provide users with notice and choice. An important element left unexplored is how advertising companies' privacy practices affect users' attitudes toward data ...
What do online behavioral advertising privacy disclosures communicate to users?
WPES '12: Proceedings of the 2012 ACM workshop on Privacy in the electronic societyOnline Behavioral Advertising (OBA), the practice of tailoring ads based on an individual's online activities, has led to privacy concerns. In an attempt to mitigate these privacy concerns, the online advertising industry has proposed the use of OBA ...
Comments