Abstract
Recent advances in multimedia and human computer interaction technologies have paved the way for rich contents across multiple media such as haptics, audio, and video. This paper introduces a multimodal game named the Slingshot 3D Game: an interactive and synchronous haptic-audio-video shooter game over the Internet network. The game incorporates two types of haptic feedback: tactile feedback using a haptic jacket and kinesthetic feedback using the Novint Falcon haptic interface. Furthermore, the game utilizes a depth camera to track the player's (upper) body movements and detect collisions between the player's body and the shot projectile. To promote availability and cost, the game uses the Internet network as the communication medium between the players, by utilizing the Admux communication framework [10]. The game design and implementation are detailed in this paper. Both the player performance analysis and the user satisfaction analysis have shown that the incorporation of synchronous haptic-video multimedia has enhanced the perception of player presence and the overall quality of performance.
Similar content being viewed by others
References
Andrews S, Mora J, Lang J, Lee WS (2006) “HaptiCast: a Physically-based 3D Game with Haptic Feedback”, Proc. of Future Play, London, ON, Canada
AR Toolkit website, http://www.hitl.washington.edu/artoolkit, [Online; accessed 09-April-2012]
Bailenson JN, Yee N (2008) Virtual interpersonal touch: haptic interaction and copresence in collaborative virtual environments. Multimedia Tools Appl 37(1)
Caporusso N, Mkrtchyan L, Badia L (2010) A multimodal interface device for online board games designed for sight-impaired people. IEEE Trans Inf Technol Biomed 14(2):248–254
Cha J, Eid M, Barghout A, Rahman AM, El Saddik A (2009) “HugMe: Synchronous Haptic Teleconferencing,” ACM International Conference on Multimedia, the Multimedia Grand Challenge, Beijing, China
Cha J, Eid M, El Saddik A (2008) “DIBHR: Depth Image-Based Haptic Rendering” In proceedings of the EuroHaptics conference, pp. 640–650, Madrid, Spain
CuteCircuit website: http://www.cutecircuit.com, [Online; accessed 09-April-2012]
De Paolis LT, Pulimeno M, Aloisio G (2007) “The Simulation of a Billiard Game Using a Haptic Interface,” 11th IEEE International Symposium on Distributed Simulation and Real-Time Applications, pp.64–67
Eid M, Cha J, El Saddik A (2008) “HugMe: A Haptic Videoconferencing System for Interpersonal Communication,” IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement Systems (VECIMS), pp. 5–9, Istanbul, Turkey
Eid M, Cha J, El-Saddik A (2011) Admux: an adaptive multiplexer for haptic-audio-visual data communication. IEEE Trans Instrum Meas 60(1):21–31
“Factbox: A look at the $65 billion video games industry”. Reuters. 6 June 2011. Retrieved 17 July 2011
Faust M, Yoo YH (2006) ‘Haptic Feedback in Pervasive Games’, Third International Workshop on Pervasive Gaming Applications, Dublin, Ireland
Frati V, Prattichizzo D (2011) “Using Kinect for hand tracking and rendering in wearable haptics”, 2011 IEEE World Haptics Conference (WHC), pp.317–321
Giles J (2010) Inside the race to hack the Kinect. New Sci 208(2789):22–23
Gvili R, Kaplan A, Ofek E, Yahav G (2003) Depth keying. SPIE, California
Hamam A, Eid M, El Saddik A, Georganas ND (2008) “A Quality of Experience Model for Haptic User Interfaces” In Proc. of Haptic in Ambient Systems (HAS 2008) Workshop, Quebec City, Canada
Heo H, Lee EC, Park KR, Kim CJ, Whang M (2010) “A realistic game system using multi-modal user interfaces,”. Consum Electron IEEE Trans 56(3):1364–1372
Höysniemi J (2006) Design and Evaluation of Physically Interactive Games, University of Tampere, Dissertation
iRoboticist: http://iroboticist.com/2010/03/26/tgv/, Tactile Gaming Vest (TGV), demoed at Haptics Symposium 2010
Jovanovic M, Starcevic D, Minovic M, Stavljanin V (2011) “Motivation and multimodal interaction in model-driven educational game design,”. IEEE Trans Syst Man Cybern A Syst Hum 41(4):817–824
Khoshelham K, Elberink SO (2012) “Accuracy and resolution of kinect depth data for indoor mapping applications”. Sensors Basel 12(2):1437–1454
MacLaverty R, Defee I (1994) “Multimodal interaction in multimedia applications”, In proceedings of the IEEE First Workshop on Multimedia Signal Processing, pp. 25–30, Princeton, USA
Neviarouskaya A, Tsetserukou D, Prendinger H, Kawakami N, Tachi S, Ishizuka M (2009) “Emerging system for affectively charged interpersonal communication,” ICCAS-SICE, 2009, vol., no., pp.3376–3381
Nilsen T, Linton S, Looser J (2004) “Motivations for augmented reality gaming”, In Proc. of the New Zealand Game Developers Conference, pp. 86–93
Novint Technologies, Inc., http://home.novint.com/, [Online; accessed 09-April-2012]
Park W, Kim L; Cho H, Park S (2009) “Design of haptic interface for brickout game,” IEEE International Workshop on Haptic Audio visual Environments and Games, pp.64–68
Ryden F (2012) “Tech to the Future: Making a “Kinection” with Haptic Interaction,”. IEEE Potentials 31(3):34–36
Rydén F, Chizeck HJ, Kosari SN, King H, and Hannaford B (2011) “Using Kinect and a Haptic Interface for Implementation of Real-time Virtual Fixtures”, Robotics, Science and Systems (RSS) Workshop on RGB-D Cameras, Los Angeles, CA
Teh KS, Lee SP, Cheok AD (2006) “Poultry Internet: A Remote Human-Pet Interaction System”, Proc. ACM CHI, pp. 251–254
Wikipedia. Kinect — Wikipedia, the free encyclopedia. http://en.wikipedia.org/wiki/Kinect, 2012. [Online; accessed 09-April-2012]
Yuanqiang D, Conrad D, DeSouza GN (2011) ““Wii Using Only ‘We’”: Using background subtraction and human pose recognition to eliminate game controllers”, 2011 IEEE International Conference on Robotics and Automation (ICRA), pp.3887–3892
3DV Systems, http://www.3dvsystems.com, [Online; accessed 09-April-2010]
Acknowledgment
We acknowledge the members of the Sunstrike team for helping in the implementation of the game: Alexandre Bradley, Kevin Mottashed, Philippe Doré, Daniel Grisé, and Benoit Renaud. Also, we thank all the subjects who took part in the evaluation and gave valuable feedback about the current state of the game as well as for future perspectives.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Eid, M., El Issawi, A. & El Saddik, A. Slingshot 3D: A synchronous haptic-audio-video game. Multimed Tools Appl 71, 1635–1649 (2014). https://doi.org/10.1007/s11042-012-1297-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-012-1297-4