Skip to main content
SpringerLink
Log in

Next generation session management for 3D teleimmersive interactive environments

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In the recent past we have seen a boom of distributed interactive multimedia environments which use multiple correlated media sensors, multi-view displays, and advanced haptic-audio-visual user interfaces for teleimmersive gaming, business meetings and other collaborative activities. However, when we investigate the emerging teleimmersive environments closer, we realize that their overall session management, including end-to-end session setup, establishment and run-time management are not appropriate for the new demands that these environments present. These environments are cyber-physical rooms that demand (a) large scale of multi-sensory devices across geographically-distributed locations and (b) interaction with each other in synchronous and real-time manner. To deal with the new teleimmersive demands, we present a new session management design with (a) session initiation protocol(s) that understand media correlations, (b) view-based multi-stream topology establishment among multiple parties, (c) efficient, light-weight and distributed session monitoring with querying and debugging capabilities, (d) flexible view-based session adaptation with efficient topology adjustments, and (e) light-weighted and consistent session tear-down protocols. The presented design of the next generation session management protocols, services, algorithms and data structures is based on our extensive experiences with building 3D teleimmersive interactive systems, experimenting with high impact teleimmersive applications and deploying such environments at various venues.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Agrawal M, Davis L (2002) Trinocular stereo using shortest path and the ordering constraint. Int J Comput Vision 47:43–50

    Article  MATH  Google Scholar 

  2. Arefin A, Sarwar Y, Gupta I, Nahrstedt K (2009) “Q-Tree: a multi-attribute based range query solution for teleimmersive framework,” IEEE International Conference on Distributed Computing Systems

  3. Bajcsy P, McHenry K, Na H-J, Malik R, Spencer A, Lee S-K, Kooper R, Frogley M (2009) “Immersive environments for rehabilitation activities”, In the Proceedings of ACM International Conference on Multimedia, Beijing, China, October 19–24

  4. Baker H, Bhatti N, Tanguay D, Sobel I, Gelb D, Goss M, Culbertson W, Malzbender T (2005) “Understanding performance in coliseum, an immersive videoconferencing system,” ACM Transactions on Multimedia Computing, Communications, and Applications

  5. Cisco Telepresence, http://www.cisco.com/telepresence

  6. Corradi A, Leonardi L, Zambonelli F (1999) “Diffusive load-balancing policies for dynamic applications,” In the Proceedings of IEEE Concurrency, vol. 7, no. 1

  7. Dabek F, Cox R, Kaashoek F, Morris R (2004) “Vivaldi: a decentralized network coordinate system”, In the Proceedings of the ACM SIGCOMM ‘04 Conference

  8. Daniilidis F, Mulligan J, Mckendall R, Majumder A, Kamberova G, Schid D, Bajcsy R, Fuchs H (1999) “Towards the Holodeck: an initial testbed for real-time 3D teleimmersion”, ACM SIGGRAPH

  9. Gizmo5, http://www.gizmo5.com

  10. Goemans M (2003) “Minimum bounded degree spanning trees” In the Proceedings of IEEE Symposium on Foundations of Computer Science, pp. 273–282

  11. Gross M, Würmlin S, Naef M, Lamboray E, Spagno C, Kunz A, Koller-Meier E, Svoboda T, Gool LV, Lang S, Strehlke K, Moere AV, Staadt O (2003)“Blue-c: a spatially immersive display and 3d video portal for telepresence,” ACM Trans Graph

  12. Illinois Teleimmersion, http://cairo.cs.uiuc.edu/teleimmersion

  13. International Telecommunication Union (2003) “Packet based multimedia communication systems,” Recommendation H.323

  14. Jain M, Dovrolis C (2002) “End-to-end available bandwidth: Measurement methodology, dynamics, and relation with tcp throughput,” In the Proceedings of ACM SIGCOMM, pages 295–308

  15. Kurillo G, Vasudevan R, Lobaton E, Bajcsy R (2008) “A framework for collaborative real-time 3D teleimmersion in a geographically distributed environment,” In the Proceedings of the 10th IEEE International Symposium on Multimedia

  16. Magor Telecollaboration, http://www.magorcorp.com

  17. Microsoft NetMeeting Protocol Specification, Microsoft Corp., June 2010

  18. Microsoft NetMeeting, http://www.microsoft.com

  19. Mitel Telecollaboration, http://www.mitel.com

  20. Ott DE, Mayer-Patel K (2004) “Coordinated multi-streaming for 3d teleimmersion”, In the Proceedings of the 12th annual ACM International Conference on Multimedia

  21. QQ Messenger. http://www.qq.com

  22. Rosenberg J, Schulzrinne H, Camarillo G, Johnston A, Peterson J, Sparks R, Handley M Schooler E (2002) “SIP: Session Initiation Protocol (RFC 3261)”

  23. Sat B, Huang Z, Wah BW (2007) “The design of a multi-party VoIP conferencing system over the internet,” In the Proceedings of IEEE International Symposium on Multimedia

  24. Schulzrinne H, Casner S, Frederick R, Jacobson V (2003) “RTP: A transport protocol for real-time applications (RFC 3550)”

  25. Schulzrinne H, Rao A, Lanphier R (1998) “Real time streaming protocol (RFC 2326)”

  26. Sheppard R, Kamali M, Rivas R, Tamai M, Yang Z, Wu W, Nahrstedt K (2008) “Distributed virtual collaboration through Teleimmersive Dance (TED): A symbiotic creativity and design environment for art and computer science,” In the Proceedings of ACM International Conference on Multimedia, Vancouver, BC, Canada

  27. Shi S, Nahrstedt K, Campbell RH (2008) “View-dependent real-time 3D video compression for mobile devices” In the Proceedings of ACM International Conference on Multimedia

  28. Skype, http://www.skype.com

  29. Svoboda T, Martinec D, Pajdla T (2005) “A convenient multi-camera self-calibration for virtual environments,” In PRESENCE: Teleoperators and Virtual Environments 14:407–422

  30. Tandberg Telepresence, http://www.tandberg.com

  31. Teliris Telepresence, http://www.teliris.com

  32. Vidyo Telepresence, http://www.vidyo.com

  33. Wang Z, Crowcroft J (1996) Qos routing for supporting resource reservation. IEEE J Sel Areas Commun 14:1228–1234

    Article  Google Scholar 

  34. Windows Live Messenger, http://messenger.live.com.

  35. Wu W, Yang Z, Gupta I, Nahrstedt K (2008) “Towards multi-site collaboration in 3D teleimmersive environments” IEEE International Conference on Distributed Computing Systems

  36. Wu W, Yang Z, Nahrstedt K (2008) “Implementing a distributed 3D Teleimmersive System,” In the Proceedings of the 10th IEEE International Symposium on Multimedia, Berkeley, CA, USA, December 15–17

  37. Wu W, Yang Z, Nahrstedt K (2008) “A study of visual context representation and control for remote sport learning tasks”, AACE World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA), Vienna, Austria

  38. Yahoo Instant Messenger, http://messenger.yahoo.com

  39. Yang Z, Cui Y, Yu B, Liang J, Nahrstedt K, Jung S-H, Bajcsy R (2005) “TEEVE: the next generation architecture for teleimmersive environments,” In the Proceedings of the 7th IEEE International Symposium on Multimedia, Irvine, CA, USA

  40. Yang Z, Wu W, Nahrstedt K, Kurillo G, Bajcsy R (2007) “Viewcast: view dissemination and management for multi-party 3d teleimmersive environments,” In the Proceedings of the 15th ACM International Conference on Multimedia

  41. Yang Z, Wu W, Nahrstedt K, Kurillo G, Bajcsy R (2010) “Enabling multi-party 3D teleimmersive environments with ViewCast,” ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 6, no. 2

  42. Z. Yang, B. Yu, K. Nahrstedt and R. Bajcsy, “A multi-stream adaptation framework for bandwidth management in 3D teleimmersion,” In the Proceedings of the 16th International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV), 2006

  43. Yang Z, Yu B, Wu W, Danikov R, Nahrstedt K, Bajcsy R (2006) “Study of collaborative dancing in tele-immersive environment”, IEEE International Symposium on Multimedia (ISM) 2006, San Diego, USA

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, University of Illinois at Urbana-Champaign, 201 N. Goodwin Avenue, Urban, IL, 61801–2302, USA

    Klara Nahrstedt, Wanmin Wu, Ahsan Arefin & Raoul Rivas

  2. School of Computing and Information Sciences, Florida International University, 11200 SW 8th Street, Miami, FL, 33199, USA

    Zhenyu Yang

Authors
  1. Klara Nahrstedt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zhenyu Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wanmin Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ahsan Arefin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Raoul Rivas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenyu Yang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nahrstedt, K., Yang, Z., Wu, W. et al. Next generation session management for 3D teleimmersive interactive environments. Multimed Tools Appl 51, 593–623 (2011). https://doi.org/10.1007/s11042-010-0629-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-010-0629-5

Keywords

Search

Navigation