Skip to main content
SpringerLink
Log in

Nonverbal interaction contextualized in collaborative virtual environments

  • Survey
  • Published:
Journal on Multimodal User Interfaces Aims and scope Submit manuscript

Abstract

Like other communication media, a Collaborative Virtual Environment (CVE) enables interaction under certain characteristics. Here, the main display of nonverbal cues is through a graphical representation of the user in a computer-created environment; in such a way that nonverbal behavior in CVEs varies, not only because of the people and the scenario involved as in a face-to-face situation, but also because of technical and design issues. In order to present an overview of the nonverbal interaction conditions in this technology, the study of nonverbal interaction in face-to-face situations is here contextualized in CVEs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Breazeal C, Kidd CD, Thomaz AL, Hoffman G, Berlin M (2005) Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 383–388

  2. Gobron S, Ahn J, Garcia D, Silvestre Q, Thalmann D, Boulic R (2012) An event-based architecture to manage virtual human non-verbal communication in 3D chatting environment. Lect Notes Comput Sci 7378:58–68

    Article  Google Scholar 

  3. Ellis S (1995) Origins and elements of virtual environments. Oxford University Press, New York

    Google Scholar 

  4. Schroeder R (2011) Being there together and the future of connected presence. Presence 15(4):438–454

    Article  MathSciNet  Google Scholar 

  5. Wolff R, Roberts D, Murgia A, Murray N, Rae J, Steptoe W, Steed A, Sharkey P (2008) Communicating eye gaze across a distance withoutrooting participants to the spot. In: Distributed simulation andreal-time applications, DS-RT 2008. 12th IEEE internationalsymposium. Vancouver, British Columbia, Canada

  6. Spante M, Heldal I, Steed A, Axelsson A, Schroeder R (2003) Strangers and friends in networked immersive environments: virtual spaces for future living. In: Home oriented informatics and telematics (HOIT), Irvine, California, USA

  7. Patterson ML (1982) A sequential functional model of nonverbal exchange. Psychol Rev 89:231–249

    Article  Google Scholar 

  8. Patterson ML (1983) Nonverbal behavior. A functional perspective. Springer, New York

    Book  Google Scholar 

  9. Knapp M, Hall J (2010) Nonverbal communication in human interaction, 7th edn. Thomson Wadsworth, Belmont

    Google Scholar 

  10. Steptoe W, Wolff R, Murgia A, Guimaraes E, Rae J, Sharkey P, et al. (2008) Eye-tracking for avatar eye-gaze and interactional analysis in immersive collaborative virtual environments. CSCW 2008 (ACM 2008 conference on computer supported cooperative work), San Diego, CA

  11. Bailenson JN, Blascovich J, Beall AC, Loomis J (2003) Interpersonal distance in immersive virtual environments. Personal Soc Psychol 29:819–833

    Article  Google Scholar 

  12. Schroeder R (2011) Being there together: social interaction in shared virtual environments. Oxford University Press, New York

    Google Scholar 

  13. Hall E (1968) Proxemics. Curr Anthropol 9:83–108

    Article  Google Scholar 

  14. Greenwald HS, Knill DC, Saunders JA (2005) Integrating visual cues for motor control: a matter of time. Vis Res 45:1975–1898

    Article  Google Scholar 

  15. Slater M (2009) Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos Trans R Soc B: Biol Sci 364:3549–3557

    Article  Google Scholar 

  16. Sanchez-Vives MV, Slater M (2005) From presence to consciousness through virtual reality. Nat Rev Neurosci 6:332–339

    Article  Google Scholar 

  17. Robles-De-La-Torre G (2008) Principles of haptic perception in virtual environments. In: Grunwald M (ed) Human haptic perception. Birkhäuser, Boston, pp 363–379

    Chapter  Google Scholar 

  18. Morris D, Tan H, Barbagli F, Chang T, Salisbury K (2007) Haptic feedback enhances force skill learning. In: Second joint eurohaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems, pp 21–26

  19. Mine M, Brook FP, Sequin CH (1997) Moving objects in space: exploiting proprioception in virtual-environment interaction. Computer graphics proceedings, ACM SIGGRAPH 1997, pp 19–26

  20. Hrimech H, Alem L, Merienne F (2011) How 3D interaction metaphors affect user experience in collaborative virtual environment. Adv Hum-Comput Interact. doi:10.1155/2011/172318

    Google Scholar 

  21. Gabbard J (1997) A taxonomy of usability characteristics in virtual environments. Dissertation, Virginia Polytechnic Institute and State University

  22. Ahn SJ, Fox J, Bailenson JN (2012) Avatars. In: Bainbridge WS (ed) Leadership in science and technology: a reference handbook. SAGE, Thousand Oaks

    Google Scholar 

  23. Guye-Vuillème A, Capin TK, Pandzic IS, Thalmann NM, Thalmann D (1998) Nonverbal communication interface for collaborative virtual environments. In: Collaborative virtual environments. University of Manchester, Manchester, pp 105–112

  24. Benford S, Greenhalgh C, Rodden T, Pycock J (2001) Collaborative virtual environments. Commun ACM 44:79–85

    Article  Google Scholar 

  25. Capin TK, Pandzic IS, Thalmann NM, Thalmann D (1997) Realistic avatars and autonomous virtual humans in VLNET networked virtual environments. In: From desktop to webtop: virtual environments on the internet, WWW and networks, international conference, Bradford, UK

  26. Lange B, Rizzo A, Chang CY, Suma EA, Bolas M (2011) Markerless full body tracking: depth-sensing technology within virtual environments. In: Interservice/industry training, simulation, and education conference (I/ITSEC), Las Vegas, NV, pp 1–8

  27. Jovanov E, Hanish N, Courson V, Stidham J, Stinson H, Webb C, Denny K (2009) Avatar–a multi-sensory system for real time body position monitoring. In: Engineering in medicine and biology society, EMBC 2009. Annual international conference of the IEEE, pp 2462–2465

  28. Mehrabian A (1976) Public places and private spaces: the psychology of work, play, and living environments. Basic Books, New York

    Google Scholar 

  29. Becker B, Mark G (2002) Social conventions in computermediated communication: a comparison of three online shared virtual environments. In: Schroeder R (ed) The social life of avatars: presence and interaction in shared virtual environments. Springer, London, pp 19–39

    Chapter  Google Scholar 

  30. Salem B, Earle N (2000) Designing a non-verbal language for expressive avatars. In: Collaborative virtual environments, San Francisco, CA, pp 93–101

  31. Clark HH, Brennan SE (1991) Grounding in communication. In: Resnick LB, Levine JM, Teasley SD (eds) Perspectives on socially shared cognitionHyattsville. American Psychological Association, MD, pp 127–149

  32. Vinayagamoorthy V, Gillies M, Steed A, Tanguy E, Pan X, Loscos C, Slater M (2006) Building expression into virtual characters. In: Eurographics conference state of the art reports, Vienna, Austria

  33. Fabri M (2006) Emotionally expressive avatars for collaborative virtual environments. Dissertation, Leeds Metropolitan University

  34. Ekman P (1973) Darwin and facial expression; a century of research in review. Academic Press, New York

    Google Scholar 

  35. Ekman P (1978) Facial expression. Erlbaum, Hillsdale

  36. Wolff R, Roberts D, Murgia A, Murray N, Rae J, Steptoe W, Steed A, Sharkey P (2008) Communicating eye gaze across a distance withoutrooting participants to the spot. In: Distributed simulation andreal-time applications, DS-RT 2008. 12th IEEE internationalsymposium. Vancouver, British Columbia, Canada

  37. Peña A (2009) A model for 3D virtual environment for learning based on the detection of collaboration through an autonomous virtual tutor. Dessertation, Universidad Politécnica de Madrid

  38. Peña A, de Antonio A, (2007) A model to detect collaborative interaction in 3D CVEs for learning through non verbal communication. In: IX SIIE’07, Instituto Politécnico do Porto, Porto

  39. Juslin PN, Scherer KR, Harrigan J, Rosenthal R (2005) Vocal expression of affect. In: Harrigan J, Rosenthal R, Scherer KR (eds) The new handbook of methods in nonverbal behavior research oxford. Oxford University Press, UK, pp 65–135

    Google Scholar 

  40. Choueiri EY (2010) Optimal crosstalk cancellation for binaural audio with two loudspeakers. http://www.princeton.edu/3D3A/Publications/BACCHPaperV4d.pdf. Accessed January 2013

  41. Walther JB, D’Addario KP (2001) The impacts of emoticons on message interpretation in computer-mediated communication. Soc Sci Comput Rev 19:324–347

    Article  Google Scholar 

  42. Walther JB (2006) Nonverbal dynamics in computer-mediated communication, or : (and the net : (‘s with you, :) and you :) alone. In: Manusov V, Patterson ML (eds) Handbook of nonverbal Communication. Sage, Thousand Oaks, pp 461–479

    Chapter  Google Scholar 

  43. Steed A, Roberts D, Schroeder R, Heldal I (2005) Interaction between users of immersion projection technology systems. In: 11th international conference on human computer interaction, Las Vegas, NV

  44. Peña A, de Antonio A (2010) Inferring interaction to support collaborative learning in 3D virtual environments through the user’s avatar nonverbal communication. IJTEL 2:75–90

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, CUCEI, Universidad de Guadalajara, Av. Revolución 1500, Col. Olimpica, C.P. 44430, Guadalajara, Jalisco, Mexico

    Adriana Peña Pérez Negrón & Graciela Lara López

  2. Centro de Estudios e Investigaciones en Comportamiento, Universidad de Guadalajara, Guadalajara, Mexico

    Nora Edith Rangel Bernal

Authors
  1. Adriana Peña Pérez Negrón
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nora Edith Rangel Bernal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Graciela Lara López
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adriana Peña Pérez Negrón.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peña Pérez Negrón, A., Rangel Bernal, N.E. & Lara López, G. Nonverbal interaction contextualized in collaborative virtual environments. J Multimodal User Interfaces 9, 253–260 (2015). https://doi.org/10.1007/s12193-015-0193-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12193-015-0193-4

Keywords

Search

Navigation