skip to main content
research-article

Hide and Seek: Choices of Virtual Backgrounds in Video Chats and Their Effects on Perception

Published:18 October 2021Publication History
Skip Abstract Section

Abstract

In two studies, we investigate how users choose virtual backgrounds and how these backgrounds influence viewers' impressions. In Study 1, we created a web prototype allowing users to apply different virtual backgrounds to their camera views and asked users to select backgrounds that they believed would change viewers' perceptions of their personality traits. In Study 2, we then applied virtual backgrounds picked by participants in Study 1 to a subset of videos drawn from the First Impression Dataset. We then ran a series of three online experiments on Amazon Mechanical Turk (MTurk) to compare participants' personality trait ratings for subjects (1) with the selected virtual backgrounds, (2) with the original video backgrounds, and (3) with a gray screen as a background. The selected virtual backgrounds did not change the personality trait ratings in the intended direction. Instead, virtual background use of any kind results in a consistent "muting effect" that mitigates very high or low ratings (i.e., compressing ratings to the mean level) compared to the ratings of the video with the original background.

References

  1. Linda Albright, David A Kenny, and Thomas E Malloy. 1988. Consensus in personality judgments at zero acquaintance. Journal of personality and social psychology 55, 3 (1988), 387.Google ScholarGoogle ScholarCross RefCross Ref
  2. Nalini Ambady and Heather M Gray. 2002. On being sad and mistaken: Mood effects on the accuracy of thin-slice judgments. Journal of personality and social psychology 83, 4 (2002), 947.Google ScholarGoogle ScholarCross RefCross Ref
  3. Arthur Aron and Barbara Fraley. 1999. Relationship closeness as including other in the self: Cognitive underpinnings and measures. Social Cognition 17, 2 (1999), 140--160.Google ScholarGoogle ScholarCross RefCross Ref
  4. Taro Asada, Yasunari Yoshitomi, Airi Tsuji, Ryota Kato, Masayoshi Tabuse, Noriaki Kuwahara, and Jin Narumoto. 2016. Facial expression analysis while using video phone. Journal of Robotics, Networking and Artificial Life 2, 4 (2016), 258--262.Google ScholarGoogle ScholarCross RefCross Ref
  5. Lisa Feldman Barrett and Elizabeth A Kensinger. 2010. Context is routinely encoded during emotion perception. Psychological Science 21, 4 (2010), 595--599.Google ScholarGoogle ScholarCross RefCross Ref
  6. Lisa Feldman Barrett, Batja Mesquita, and Maria Gendron. 2011. Context in emotion perception. Current Directions in Psychological Science 20, 5 (2011), 286--290.Google ScholarGoogle ScholarCross RefCross Ref
  7. Ernst Bekkering and Jung P Shim. 2006. Trust in videoconferencing. Commun. ACM 49, 7 (2006), 103--107.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Joan-Isaac Biel, Oya Aran, and Daniel Gatica-Perez. 2011. You are known by how you vlog: Personality impressions and nonverbal behavior in youtube. In ICWSM. Citeseer, 446--449.Google ScholarGoogle Scholar
  9. Joan-Isaac Biel and Daniel Gatica-Perez. 2012. The youtube lens: Crowdsourced personality impressions and audiovisual analysis of vlogs. IEEE Transactions on Multimedia 15, 1 (2012), 41--55.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Michael Boyle, Carman Neustaedter, and Saul Greenberg. 2009. Privacy factors in video-based media spaces. In Media Space 20+ Years of Mediated Life. Springer, 97--122.Google ScholarGoogle Scholar
  11. Jed R Brubaker, Gina Venolia, and John C Tang. 2012. Focusing on shared experiences: moving beyond the camera in video communication. In Proceedings of the Designing Interactive Systems Conference. 96--105.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Erik Brynjolfsson, John J Horton, Adam Ozimek, Daniel Rock, Garima Sharma, and Hong-Yi TuYe. 2020. COVID-19 and remote work: an early look at US data. Technical Report. National Bureau of Economic Research.Google ScholarGoogle Scholar
  13. Sean M Cameron and Joel T Nadler. 2013. Gender roles and organizational citizenship behaviors: Effects on managerial evaluations. Gender in Management: An International Journal (2013).Google ScholarGoogle Scholar
  14. Deborah A Cobb-Clark and Stefanie Schurer. 2012. The stability of big-five personality traits. Economics Letters 115, 1 (2012), 11--15.Google ScholarGoogle ScholarCross RefCross Ref
  15. Kevin Eric DePew and Heather Lettner-Rust. 2009. Mediating power: Distance learning interfaces, classroom epistemology, and the gaze. Computers and Composition 26, 3 (2009), 174--189.Google ScholarGoogle ScholarCross RefCross Ref
  16. Jayson L Dibble, Timothy R Levine, and Hee Sun Park. 2012. The Unidimensional Relationship Closeness Scale (URCS): Reliability and validity evidence for a new measure of relationship closeness. Psychological assessment 24, 3 (2012), 565.Google ScholarGoogle Scholar
  17. Karen M Douglas and Craig McGarty. 2001. Identifiability and self-presentation: Computer-mediated communication and intergroup interaction. British journal of social psychology 40, 3 (2001), 399--416.Google ScholarGoogle Scholar
  18. Alice H Eagly, Mona G Makhijani, and Bruce G Klonsky. 1992. Gender and the evaluation of leaders: A meta-analysis. Psychological bulletin 111, 1 (1992), 3.Google ScholarGoogle Scholar
  19. Jerry A Fodor. 1975. The language of thought. Vol. 5. Harvard university press.Google ScholarGoogle Scholar
  20. Jerry A Fodor, Zenon W Pylyshyn, et al. 1988. Connectionism and cognitive architecture: A critical analysis. Cognition 28, 1--2 (1988), 3--71.Google ScholarGoogle ScholarCross RefCross Ref
  21. James J Gibson. 1977. The theory of affordances. R. Shaw and J. Bransford (eds.), Perceiving, Acting and Knowing.Google ScholarGoogle Scholar
  22. J Jarnes Gibson. 1979. The ecological approach to visual. Perception (1979).Google ScholarGoogle Scholar
  23. James J Gibson, Robert Shaw, and John Bransford. 1977. Perceiving, acting, and knowing: Toward an ecological psychology.Google ScholarGoogle Scholar
  24. Barney G Glaser and Anselm L Strauss. 2017. Discovery of grounded theory: Strategies for qualitative research. Routledge.Google ScholarGoogle Scholar
  25. Erving Goffman et al. 1978. The presentation of self in everyday life. Harmondsworth London.Google ScholarGoogle Scholar
  26. Amy L Gonzales and Jeffrey T Hancock. 2008. Identity shift in computer-mediated environments. Media Psychology 11, 2 (2008), 167--185.Google ScholarGoogle ScholarCross RefCross Ref
  27. Samuel D Gosling, Sam Gaddis, and Simine Vazire. 2008. First impressions based on the environments we create and inhabit. First impressions (2008), 334--356.Google ScholarGoogle Scholar
  28. Samuel D Gosling, Sei Jin Ko, Thomas Mannarelli, and Margaret E Morris. 2002. A room with a cue: personality judgments based on offices and bedrooms. Journal of personality and social psychology 82, 3 (2002), 379.Google ScholarGoogle ScholarCross RefCross Ref
  29. Samuel D Gosling, Peter J Rentfrow, and William B Swann Jr. 2003. A very brief measure of the Big-Five personality domains. Journal of Research in personality 37, 6 (2003), 504--528.Google ScholarGoogle ScholarCross RefCross Ref
  30. Dongqi Han, Yasamin Heshmat, and Carman Neustaedter. 2019. Exploring Video Conferencing for Doctor Appointments in the Home: A Scenario-Based Approach from Patients' Perspectives. (2019).Google ScholarGoogle Scholar
  31. Martin D Hassell and John L Cotton. 2017. Some things are better left unseen: Toward more effective communication and team performance in video-mediated interactions. Computers in Human Behavior 73 (2017), 200--208.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Wei Huang. 2005. Social dynamics can be distorted in video-mediated communication. University of Michigan.Google ScholarGoogle Scholar
  33. Adam N Joinson. 2001. Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity. European journal of social psychology 31, 2 (2001), 177--192.Google ScholarGoogle Scholar
  34. Tejinder K Judge and Carman Neustaedter. 2010. Sharing conversation and sharing life: video conferencing in the home. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 655--658.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. David S. Kirk, Abigail Sellen, and Xiang Cao. 2010. Home Video Communication: Mediating 'Closeness'. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (Savannah, Georgia, USA) (CSCW '10). Association for Computing Machinery, New York, NY, USA, 135--144. https://doi.org/10.1145/1718918.1718945Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Mufan Luo, Tiffany W Hsu, Joon Sung Park, and Jeffrey T Hancock. 2020. Emotional Amplification During Live-Streaming: Evidence from Comments During and After News Events. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1 (2020), 1--19.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Colin MacLeod, Elizabeth Rutherford, Lyn Campbell, Greg Ebsworthy, and Lin Holker. 2002. Selective attention and emotional vulnerability: assessing the causal basis of their association through the experimental manipulation of attentional bias. Journal of abnormal psychology 111, 1 (2002), 107.Google ScholarGoogle ScholarCross RefCross Ref
  38. James C McElroy, Paula C Morrow, and Ronald J Ackerman. 1983. Personality and interior office design: Exploring the accuracy of visitor attributions. Journal of Applied Psychology 68, 3 (1983), 541.Google ScholarGoogle ScholarCross RefCross Ref
  39. Ryan C Moore and Jeffrey T Hancock. 2020. Older Adults, Social Technologies, and the Coronavirus Pandemic: Challenges, Strengths, and Strategies for Support. Social Media+ Society 6, 3 (2020), 2056305120948162.Google ScholarGoogle Scholar
  40. Laura P Naumann, Simine Vazire, Peter J Rentfrow, and Samuel D Gosling. 2009. Personality judgments based on physical appearance. Personality and social psychology bulletin 35, 12 (2009), 1661--1671.Google ScholarGoogle Scholar
  41. Carman Neustaedter, Saul Greenberg, and Michael Boyle. 2006. Blur filtration fails to preserve privacy for home-based video conferencing. ACM Transactions on Computer-Human Interaction (TOCHI) 13, 1 (2006), 1--36.Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Carman Neustaedter, Carolyn Pang, Azadeh Forghani, Erick Oduor, Serena Hillman, Tejinder K Judge, Michael Massimi, and Saul Greenberg. 2015. Sharing domestic life through long-term video connections. ACM Transactions on Computer-Human Interaction (TOCHI) 22, 1 (2015), 1--29.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Carman Neustaedter, Jason Procyk, Anezka Chua, Azadeh Forghani, and Carolyn Pang. 2020. Mobile video conferencing for sharing outdoor leisure activities over distance. Human--Computer Interaction 35, 2 (2020), 103--142.Google ScholarGoogle ScholarCross RefCross Ref
  44. Paula M Niedenthal, Jamin B Halberstadt, Jonathan Margolin, and Åse H Innes-Ker. 2000. Emotional state and the detection of change in facial expression of emotion. European journal of social psychology 30, 2 (2000), 211--222.Google ScholarGoogle Scholar
  45. Palupi Palupi. 2019. Selective Self-Presentation on Video-Mediated Communication: A Study of Hyperpersonal Communication. Mediator: Jurnal Komunikasi 12, 1 (2019), 102--112.Google ScholarGoogle Scholar
  46. Sameer Patil, Alfred Kobsa, Ajita John, Lynne S Brotman, and Doree Seligmann. 2009. Interpersonal privacy management in distributed collaboration: Situational characteristics and interpretive influences. In IFIP Conference on Human-Computer Interaction. Springer, 143--156.Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Hayes Raffle, Rafael Ballagas, Glenda Revelle, Hiroshi Horii, Sean Follmer, Janet Go, Emily Reardon, Koichi Mori, Joseph Kaye, and Mirjana Spasojevic. 2010. Family story play: reading with young children (and elmo) over a distance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1583--1592.Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Ruthger Righart and Beatrice De Gelder. 2008. Recognition of facial expressions is influenced by emotional scene gist. Cognitive, Affective, & Behavioral Neuroscience 8, 3 (2008), 264--272.Google ScholarGoogle ScholarCross RefCross Ref
  49. Colleen Rodriguez and Tom McCallum. [n.d.]. Zoom Reports First Quarter Results for Fiscal Year 2021. https://investors.zoom.us/news-releases/news-release-details/zoom-reports-first-quarter-results-fiscal-year-2021Google ScholarGoogle Scholar
  50. Karen L Schmidt and Jeffrey F Cohn. 2001. Human facial expressions as adaptations: Evolutionary questions in facial expression research. American Journal of Physical Anthropology: The Official Publication of the American Association of Physical Anthropologists 116, S33 (2001), 3--24.Google ScholarGoogle ScholarCross RefCross Ref
  51. Constantine Sedikides, W Keith Campbell, Glenn D Reader, and Andrew J Elliot. 1999. The relationship closeness induction task. Representative Research in Social Psychology 23 (1999), 1--4.Google ScholarGoogle Scholar
  52. John Short, Ederyn Williams, and Bruce Christie. 1976. The social psychology of telecommunications. John Wiley & Sons.Google ScholarGoogle Scholar
  53. Stephen Soldz and George E Vaillant. 1999. The Big Five personality traits and the life course: A 45-year longitudinal study. Journal of Research in Personality 33, 2 (1999), 208--232.Google ScholarGoogle ScholarCross RefCross Ref
  54. Lynne Wainfan and Paul K Davis. 2004. Virtual collaboration: Face-to-face versus videoconference, audioconference, and computer-mediated communications. In Enabling Technologies for Simulation Science VIII, Vol. 5423. International Society for Optics and Photonics, 384--398.Google ScholarGoogle ScholarCross RefCross Ref
  55. Joseph B Walther. 2007. Selective self-presentation in computer-mediated communication: Hyperpersonal dimensions of technology, language, and cognition. Computers in Human Behavior 23, 5 (2007), 2538--2557.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Meredith Wells and Luke Thelen. 2002. What does your workspace say about you? The influence of personality, status, and workspace on personalization. Environment and Behavior 34, 3 (2002), 300--321.Google ScholarGoogle ScholarCross RefCross Ref
  57. Meredith M Wells. 2000. Office clutter or meaningful personal displays: The role of office personalization in employee and organizational well-being. Journal of environmental psychology 20, 3 (2000), 239--255.Google ScholarGoogle ScholarCross RefCross Ref
  58. Meredith M Wells, Luke Thelen, and Jennifer Ruark. 2007. Workspace personalization and organizational culture: does your workspace reflect you or your company? Environment and Behavior 39, 5 (2007), 616--634.Google ScholarGoogle ScholarCross RefCross Ref
  59. Brenda K Wiederhold. 2020. Connecting through technology during the coronavirus disease 2019 pandemic: Avoiding "Zoom Fatigue".Google ScholarGoogle Scholar
  60. Huichuan Xia, Yang Wang, Yun Huang, and Anuj Shah. 2017. "Our Privacy Needs to be Protected at All Costs" Crowd Workers' Privacy Experiences on Amazon Mechanical Turk. Proceedings of the ACM on Human-Computer Interaction 1, CSCW (2017), 1--22.Google ScholarGoogle Scholar

Index Terms

  1. Hide and Seek: Choices of Virtual Backgrounds in Video Chats and Their Effects on Perception

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image Proceedings of the ACM on Human-Computer Interaction
            Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW2
            CSCW2
            October 2021
            5376 pages
            EISSN:2573-0142
            DOI:10.1145/3493286
            Issue’s Table of Contents

            Copyright © 2021 ACM

            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 18 October 2021
            Published in pacmhci Volume 5, Issue CSCW2

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader