Abstract
Effective interpersonal communication is important to maintain relationships and build trust, empathy, and confidence. In this digital age, communication has become mediated, which filters out many of the social cues that are essential to facilitate interpersonal communication. This paper investigates the extent to which social cues influence social presence in mediated, bidirectional, multiparty interaction. Literature related to six social cues – paralinguistic cues, linguistic cues, body language, eye movements, facial expressions, and proxemic cues – was reviewed. These cues were ranked based on how relevant they are in creating a sense of social presence in mediated social communication (MSC). The most relevant cue was eye movements, followed by facial expression and linguistic cues, and lastly, body language and proxemic cues. Paralinguistic cues could not be ranked due to sparse literature in the context of MSC. Further research is required to better understand how social cues can be incorporated into MSC systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kjeldskov, J., et al.: Using cultural probes to explore mediated intimacy. Australas. J. Inf. Syst. 11, F2008 (2004)
Knapp, M.L., Hall, J.A.: Nonverbal Communication in Human Interaction, 7th edn. Wadsworth, CENGAGE Learning, Boston (2010)
Toet, A., Mioch, T., Gunkel, S.N.B., Sallaberry, C., van Erp, J.B.F., Niamut, O.: Holistic quality assessment of mediated immersive multisensory social communication. In: Bourdot, P., Interrante, V., Kopper, R., Olivier, A.H., Saito, H., Zachmann, G. (eds.) Virtual Reality and Augmented Reality. EuroVR 2020, LNCS, vol. 12499, pp. 209–215. Springer, Heidelberg (2020)
Short, J., Williams, E., Christie, B.: The social psychology of telecommunications. Wiley, New York (1976)
Biocca, F., Harms, C.: Defining and measuring social presence: contribution to the Networked Minds theory and measure. In: Gouveia, F.R., Biocca, F. (eds.) Fifth Annual International Workshop on Presence, pp. 7–36 (2002)
Oh, C.S., Bailenson, J.N., Welch, G.F.: A systematic review of social presence: definition, antecedents, and implications. Frontiers Rob. AI 5 (2018)
Bailenson, J.N., Blascovich, J., Beall, A.C., Loomis, J.M.: Interpersonal distance in immersive virtual environments. Pers. Soc. Psychol. Bull. 29, 819–833 (2003)
Biocca, F., Harms, C., Burgoon, J.K.: Toward a more robust theory and measure of social presence: Review and suggested criteria. Presence Teleoperators Virtual Environ. 12, 456–480 (2003)
Hartmann, T., Wirth, W., Vorderer, P., Klimmt, C., Schramm, H., Böcking, S.: Spatial presence theory: state of the art and challenges ahead. In: Lombard, M., Biocca, F., Freeman, J., Ijsselsteijn, W., Schaevitz, R.J. (eds.) Immersed in Media: Telepresence Theory, Measurement & Technology, pp. 115–135. Springer International Publishing, Cham (2015)
Mehrabian, A.: Some referents and measures of nonverbal behavior. Behav. Res. Methods Instrum. 1, 203–207 (1968)
Caspi, A., Blau, I.: Social presence in online discussion groups: testing three conceptions and their relations to perceived learning. Soc. Psychol. Educ. 11, 323–346 (2008)
Vareberg, K.R., Westerman, D.: To:-) or to ☺, that is the question: a study of students’ initial impressions of instructors’ paralinguistic cues. Educ. Inf. Technol. 25, 4501–4516 (2020)
Lee, K.M., Nass, C.: Designing social presence of social actors in human computer interaction. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 289–296. Association for Computing Machinery, Ft. Lauderdale (2003)
Yang, J., Sasikumar, P., Bai, H., Barde, A., Sörös, G., Billinghurst, M.: The effects of spatial auditory and visual cues on mixed reality remote collaboration. J. Multimodal User Interfaces 14(4), 337–352 (2020). https://doi.org/10.1007/s12193-020-00331-1
von der Pütten, A.M., Krämer, N.C., Gratch, J., Kang, S.-H.: “It doesn’t matter what you are!” Explaining social effects of agents and avatars. Comput. Hum. Behav. 26, 1641–1650 (2010)
Yassien, A., ElAgroudy, P., Makled, E., Abdennadher, S.: A design space for social presence in VR. In: 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, Article 8. Association for Computing Machinery, Tallinn, Estonia (2020)
Yorzinski, J.L., Miller, J.: Sclera color enhances gaze perception in humans. PLOS ONE 15, e0228275 (2020)
Kobayashi, H., Kohshima, S.: Unique morphology of the human eye and its adaptive meaning: comparative studies on external morphology of the primate eye. J. Hum. Evol. 40, 419–435 (2001)
Bailenson, J.N., Beall, A.C., Loomis, J., Blascovich, J., Turk, M.: Transformed social interaction, augmented gaze, and social influence in immersive virtual environments. Hum. Commun. Res. 31, 511–537 (2005)
Fares, M.: Towards multimodal human-like characteristics and expressive visual prosody in virtual agents. In: Proceedings of the 2020 International Conference on Multimodal Interaction, pp. 743–747. ACM, Virtual Event (2020)
Pan, X., Gillies, M., Slater, M.: The impact of avatar blushing on the duration of interaction between a real and virtual person. In: Presence 2008: The 11th Annual International Workshop on Presence, pp. 100–106 (2008)
Fiore, S., Wiltshire, T., Lobato, E., Jentsch, F., Huang, W., Axelrod, B.: Toward understanding social cues and signals in human–robot interaction: effects of robot gaze and proxemic behavior. Frontiers Psychol. 4 (2013)
Bente, G., Rüggenberg, S., Krämer, N.C., Eschenburg, F.: Avatar-mediated networking: increasing social presence and interpersonal trust in net-based collaborations. Hum. Commun. Res. 34, 287–318 (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sharan, N.N., Toet, A., Mioch, T., Niamut, O., van Erp, J.B.F. (2022). The Relative Importance of Social Cues in Immersive Mediated Communication. In: Ahram, T., Taiar, R. (eds) Human Interaction, Emerging Technologies and Future Systems V. IHIET 2021. Lecture Notes in Networks and Systems, vol 319. Springer, Cham. https://doi.org/10.1007/978-3-030-85540-6_62
Download citation
DOI: https://doi.org/10.1007/978-3-030-85540-6_62
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-85539-0
Online ISBN: 978-3-030-85540-6
eBook Packages: EngineeringEngineering (R0)