Skip to main content
SpringerLink
Log in

Time-scaled interactive object-driven multi-party VR

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Object-driven interactions have various applications, especially in team activities and sports like volleyball, football, tennis, etc. We define a multi-party virtual world as an environment which includes multiple avatars and computer agents. Latency is one of the primary issues while building a multi-party setup. Delays due to latency cause inconsistencies and unnecessary halts resulting in unrealistic experience in VR. For interactions using objects, it becomes vital to handle the latencies. We present a time scaling algorithm for latency management and synchronization between multiple avatars, while they interact using objects in the VR environment. We propose two time scaling schemes—source and target based. Both these methodologies are dependent on which user’s virtual view (source or target) needs to be uniform. Incorporating the presented time scaling schemes, we develop a comprehensive multi-party virtual reality platform to simulate applications which involves interactions between agents and avatars using objects. We adopt a client–server architecture for building our multiuser VR platform which induces flexibility of adding multiple avatars and/or agents to the application. The modular nature of our proposed system enables extension to different VR applications that encompass communication using objects. We exemplify our framework by developing a multi-player VR volleyball game which employs the features of our proposed scheme. We demonstrate the significance of time scaling in the object-driven interactive multi-party VR framework through a comparative user study. We also evaluate the immersion experience in our multi-player volleyball game by a user survey.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Amir, M.H., Quek, A., Sulaiman, N.R.B., See, J.: Duke: enhancing virtual reality based fps game with full-body interactions. In: Proceedings of the 13th International Conference on Advances in Computer Entertainment Technology, p. 35. ACM (2016)

  2. Bernier, Y.W.: Latency compensating methods in client/server in-game protocol design and optimization. In: Game Developers Conference, vol. 98033 (2001)

  3. Bouzid, A., Vásárhelyi, J.: Implementation of Dead reckoning solution on Zynq target. In: 2017 18th International Carpathian Control Conference (ICCC), pp. 134–139. IEEE (2017)

  4. Chagué, S., Charbonnier, C.: Real virtuality: a multi-user immersive platform connecting real and virtual worlds. In: Proceedings of the 2016 Virtual Reality International Conference, p. 4. ACM (2016)

  5. Eidenberger, H., Mossel, A.: Indoor skydiving in immersive virtual reality with embedded storytelling. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 9–12. ACM (2015)

  6. Evangelakos, D., Mara, M.: Extended timewarp latency compensation for virtual reality. In: Proceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, pp. 193–194. ACM (2016)

  7. He, Z., Zhu, F., Perlin, K.: Physhare: sharing physical interaction in virtual reality. arXiv preprint arXiv:1708.04139 (2017)

  8. Herumurti, D., Riskahadi, D., Kuswardayan, I.: 3D multiplayer virtual pets game using google card board. In: AIP Conference Proceedings, vol. 1867, p. 020018. AIP Publishing (2017)

  9. Jaya, I., Liu, E.S., Chen, Y.: Combining interest management and dead reckoning: a hybrid approach for efficient data distribution in multiplayer online games. In: 2016 IEEE/ACM 20th International Symposium on Distributed Simulation and Real Time Applications (DS-RT), pp. 92–99. IEEE (2016)

  10. Jennett, C., Cox, A.L., Cairns, P., Dhoparee, S., Epps, A., Tijs, T., Walton, A.: Measuring and defining the experience of immersion in games. Int. J. Hum. Comput. Stud. 66(9), 641–661 (2008)

    Article  Google Scholar 

  11. Lee, D., Baek, K., Lee, J., Lim, H.: A development of virtual reality game utilizing Kinect, oculus rift and smartphone. Int. J. Appl. Eng. Res. 11(2), 829–833 (2016)

    Google Scholar 

  12. Lugrin, J.L., Charles, F., Cavazza, M., Le Renard, M., Freeman, J., Lessiter, J.: Caveudk: a VR game engine middleware. In: Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, pp. 137–144. ACM (2012)

  13. McAnlis, C., Lubbers, P., Jones, B., Tebbs, D., Manzur, A., Bennett, S., dErfurth, F., Garcia, B., Lin, S., Popelyshev, I., et al.: Real-time multiplayer network programming. In: HTML5 Game Development Insights, pp. 195–29. Springer, Berlin (2014)

  14. Ryge, A., Thomsen, L., Berthelsen, T., Hvass, J.S., Koreska, L., Vollmers, C., Nilsson, N.C., Nordahl, R., Serafin, S.: Effect on high versus low fidelity haptic feedback in a virtual reality baseball simulation. In: 2017 IEEE Virtual Reality (VR), pp. 365–366. IEEE (2017)

  15. Shongwe, B.: Peer-to-peer network architecture for massive online gaming. Ph.D. thesis (2014)

  16. Smed, J., Kaukoranta, T., Hakonen, H.: Aspects of networking in multiplayer computer games. Electron. Libr. 20(2), 87–97 (2002)

    Article  Google Scholar 

  17. Tedjokusumo, J., Zhou, S.Z., Winkler, S.: Immersive multiplayer games with tangible and physical interaction. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 40(1), 147–157 (2010)

    Article  Google Scholar 

  18. Witmer, B.G., Singer, M.J.: Measuring presence in virtual environments: a presence questionnaire. Presence Teleoperators Virtual Environ. 7(3), 225–240 (1998)

    Article  Google Scholar 

Download references

Funding

This research is supported by the program titled Realistic Immersion with Virtual Humans, a collaboration between Nanyang Technological University (NTU) Singapore and Institute of Software, Chinese Academy of Sciences (ISCAS) in Beijing, China. The program is supported by the National Research Foundation, Prime Minister’s Office, Singapore, under its NRF-NSFC Joint Research Grant Call (Data Science).

Author information

Authors and Affiliations

  1. Institute for Media Innovation, Nanyang Technological University, Singapore, Singapore

    Nisha Jain, Andrzej Wydra, Wen Hai & Nadia Magnenat Thalmann

  2. Ecole Polytechnique Federale de Lausanne, Lausanne, Switzerland

    Daniel Thalmann

Authors
  1. Nisha Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrzej Wydra
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wen Hai
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nadia Magnenat Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Daniel Thalmann
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nisha Jain.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jain, N., Wydra, A., Hai, W. et al. Time-scaled interactive object-driven multi-party VR. Vis Comput 34, 887–897 (2018). https://doi.org/10.1007/s00371-018-1539-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-018-1539-1

Keywords

Search

Navigation