Skip to main content
Log in

Slingshot 3D: A synchronous haptic-audio-video game

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Recent advances in multimedia and human computer interaction technologies have paved the way for rich contents across multiple media such as haptics, audio, and video. This paper introduces a multimodal game named the Slingshot 3D Game: an interactive and synchronous haptic-audio-video shooter game over the Internet network. The game incorporates two types of haptic feedback: tactile feedback using a haptic jacket and kinesthetic feedback using the Novint Falcon haptic interface. Furthermore, the game utilizes a depth camera to track the player's (upper) body movements and detect collisions between the player's body and the shot projectile. To promote availability and cost, the game uses the Internet network as the communication medium between the players, by utilizing the Admux communication framework [10]. The game design and implementation are detailed in this paper. Both the player performance analysis and the user satisfaction analysis have shown that the incorporation of synchronous haptic-video multimedia has enhanced the perception of player presence and the overall quality of performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Andrews S, Mora J, Lang J, Lee WS (2006) “HaptiCast: a Physically-based 3D Game with Haptic Feedback”, Proc. of Future Play, London, ON, Canada

  2. AR Toolkit website, http://www.hitl.washington.edu/artoolkit, [Online; accessed 09-April-2012]

  3. Bailenson JN, Yee N (2008) Virtual interpersonal touch: haptic interaction and copresence in collaborative virtual environments. Multimedia Tools Appl 37(1)

  4. Caporusso N, Mkrtchyan L, Badia L (2010) A multimodal interface device for online board games designed for sight-impaired people. IEEE Trans Inf Technol Biomed 14(2):248–254

    Article  Google Scholar 

  5. Cha J, Eid M, Barghout A, Rahman AM, El Saddik A (2009) “HugMe: Synchronous Haptic Teleconferencing,” ACM International Conference on Multimedia, the Multimedia Grand Challenge, Beijing, China

  6. Cha J, Eid M, El Saddik A (2008) “DIBHR: Depth Image-Based Haptic Rendering” In proceedings of the EuroHaptics conference, pp. 640–650, Madrid, Spain

  7. CuteCircuit website: http://www.cutecircuit.com, [Online; accessed 09-April-2012]

  8. De Paolis LT, Pulimeno M, Aloisio G (2007) “The Simulation of a Billiard Game Using a Haptic Interface,” 11th IEEE International Symposium on Distributed Simulation and Real-Time Applications, pp.64–67

  9. Eid M, Cha J, El Saddik A (2008) “HugMe: A Haptic Videoconferencing System for Interpersonal Communication,” IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement Systems (VECIMS), pp. 5–9, Istanbul, Turkey

  10. Eid M, Cha J, El-Saddik A (2011) Admux: an adaptive multiplexer for haptic-audio-visual data communication. IEEE Trans Instrum Meas 60(1):21–31

    Article  Google Scholar 

  11. “Factbox: A look at the $65 billion video games industry”. Reuters. 6 June 2011. Retrieved 17 July 2011

  12. Faust M, Yoo YH (2006) ‘Haptic Feedback in Pervasive Games’, Third International Workshop on Pervasive Gaming Applications, Dublin, Ireland

  13. Frati V, Prattichizzo D (2011) “Using Kinect for hand tracking and rendering in wearable haptics”, 2011 IEEE World Haptics Conference (WHC), pp.317–321

  14. Giles J (2010) Inside the race to hack the Kinect. New Sci 208(2789):22–23

    Article  Google Scholar 

  15. Gvili R, Kaplan A, Ofek E, Yahav G (2003) Depth keying. SPIE, California

    Google Scholar 

  16. Hamam A, Eid M, El Saddik A, Georganas ND (2008) “A Quality of Experience Model for Haptic User Interfaces” In Proc. of Haptic in Ambient Systems (HAS 2008) Workshop, Quebec City, Canada

  17. Heo H, Lee EC, Park KR, Kim CJ, Whang M (2010) “A realistic game system using multi-modal user interfaces,”. Consum Electron IEEE Trans 56(3):1364–1372

    Article  Google Scholar 

  18. Höysniemi J (2006) Design and Evaluation of Physically Interactive Games, University of Tampere, Dissertation

  19. iRoboticist: http://iroboticist.com/2010/03/26/tgv/, Tactile Gaming Vest (TGV), demoed at Haptics Symposium 2010

  20. Jovanovic M, Starcevic D, Minovic M, Stavljanin V (2011) “Motivation and multimodal interaction in model-driven educational game design,”. IEEE Trans Syst Man Cybern A Syst Hum 41(4):817–824

    Article  Google Scholar 

  21. Khoshelham K, Elberink SO (2012) “Accuracy and resolution of kinect depth data for indoor mapping applications”. Sensors Basel 12(2):1437–1454

    Article  Google Scholar 

  22. MacLaverty R, Defee I (1994) “Multimodal interaction in multimedia applications”, In proceedings of the IEEE First Workshop on Multimedia Signal Processing, pp. 25–30, Princeton, USA

  23. Neviarouskaya A, Tsetserukou D, Prendinger H, Kawakami N, Tachi S, Ishizuka M (2009) “Emerging system for affectively charged interpersonal communication,” ICCAS-SICE, 2009, vol., no., pp.3376–3381

  24. Nilsen T, Linton S, Looser J (2004) “Motivations for augmented reality gaming”, In Proc. of the New Zealand Game Developers Conference, pp. 86–93

  25. Novint Technologies, Inc., http://home.novint.com/, [Online; accessed 09-April-2012]

  26. Park W, Kim L; Cho H, Park S (2009) “Design of haptic interface for brickout game,” IEEE International Workshop on Haptic Audio visual Environments and Games, pp.64–68

  27. Ryden F (2012) “Tech to the Future: Making a “Kinection” with Haptic Interaction,”. IEEE Potentials 31(3):34–36

    Article  Google Scholar 

  28. Rydén F, Chizeck HJ, Kosari SN, King H, and Hannaford B (2011) “Using Kinect and a Haptic Interface for Implementation of Real-time Virtual Fixtures”, Robotics, Science and Systems (RSS) Workshop on RGB-D Cameras, Los Angeles, CA

  29. Teh KS, Lee SP, Cheok AD (2006) “Poultry Internet: A Remote Human-Pet Interaction System”, Proc. ACM CHI, pp. 251–254

  30. Wikipedia. Kinect — Wikipedia, the free encyclopedia. http://en.wikipedia.org/wiki/Kinect, 2012. [Online; accessed 09-April-2012]

  31. Yuanqiang D, Conrad D, DeSouza GN (2011) ““Wii Using Only ‘We’”: Using background subtraction and human pose recognition to eliminate game controllers”, 2011 IEEE International Conference on Robotics and Automation (ICRA), pp.3887–3892

  32. 3DV Systems, http://www.3dvsystems.com, [Online; accessed 09-April-2010]

Download references

Acknowledgment

We acknowledge the members of the Sunstrike team for helping in the implementation of the game: Alexandre Bradley, Kevin Mottashed, Philippe Doré, Daniel Grisé, and Benoit Renaud. Also, we thank all the subjects who took part in the evaluation and gave valuable feedback about the current state of the game as well as for future perspectives.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohamad Eid.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Eid, M., El Issawi, A. & El Saddik, A. Slingshot 3D: A synchronous haptic-audio-video game. Multimed Tools Appl 71, 1635–1649 (2014). https://doi.org/10.1007/s11042-012-1297-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1297-4

Keywords

Navigation