Alan K S Alves
ABSTRACT
This work present the TeamBridge, a middleware able to perform the communication between digital games and hardware devices, like joysticks, mice and motion capture cameras. That communication does not require any modification to the game source code, allowing an old game to be adapted to work with a new hardware device. To prove this, tests were carried out with several games, including one of them being a commercial game. This middleware also allows the use of more than one device at the same time, so we can obtain more accurate information, one device can supply the deficiencies of the other. Finally, we performed tests to make sure that the middleware would not interfere with the user experience. Tests have shown that TeamBridge can receive, interpret and send information quickly, the time varies according to the device used, getting 33ms when used with Kinect, 40ms with Leap Motion and 255ms with the NED Glove.
- Francisco Bianor, A. Cavalcanti, and R. R. Dantas. 2017. Evaluate Leap Motion Control for Multiple Hand Posture Recognition.19th Symposium on Virtual and Augmented Reality (2017).Google Scholar
- Francisco Bianor, A. Cavalcanti, and R. R. Dantas. 2017. PhysioHappy: A low cost device for virtual rehabilitation. 19th Symposium on Virtual and Augmented Reality (2017).Google Scholar
- Edgar F Borja, Daniel A Lara, Washington X Quevedo, and Víctor H Andaluz. 2018. Haptic stimulation glove for fine motor rehabilitation in virtual reality environments. In International conference on augmented reality, Virtual Reality and Computer Graphics. Springer, 211–229.Google ScholarCross Ref
- Desiderio Cano Porras, Hadar Sharon, Rivka Inzelberg, Yitzhak Ziv-Ner, Gabriel Zeilig, and Meir Plotnik. 2019. Advanced virtual reality-based rehabilitation of balance and gait in clinical practice. Therapeutic advances in chronic disease 10 (2019), 2040622319868379.Google Scholar
- Davide Corbetta, Federico Imeri, and Roberto Gatti. 2015. Rehabilitation that incorporates virtual reality is more effective than standard rehabilitation for improving walking speed, balance and mobility after stroke: a systematic review. Journal of physiotherapy 61, 3 (2015), 117–124.Google ScholarCross Ref
- NCSR Demokritos. 2017. Unobstrusive Smart Environments For Independent Living (USEFIL). (2017). https://usefil.eu/ Último acesso em 16/11/2017.Google Scholar
- Bernie Garrett, Tarnia Taverner, Diane Gromala, Gordon Tao, Elliott Cordingley, Crystal Sun, 2018. Virtual reality clinical research: promises and challenges. JMIR serious games 6, 4 (2018), e10839.Google Scholar
- Ming-Chun Huang, Wenyao Xu, Yi Su, Belinda Lange, Chien-Yen Chang, and Majid Sarrafzadeh. 2012. Smartglove for upper extremities rehabilitative gaming assessment. In Proceedings of the 5th International Conference on Pervasive Technologies Related to Assistive Environments. ACM, 20.Google ScholarDigital Library
- IBM. 2016. Conceitos comuns na análise estatística. (2016). https://www.ibm.com/support/knowledgecenter/pt-br/SSEP7J_10.1.1/com.ibm.swg.ba.cognos.ug_cr_rptstd.10.1.1.doc/c_id_rs_stats.html Último acesso em 24/02/2018.Google Scholar
- Jamshed Iqbal, Nikos G Tsagarakis, Angelo E Fiorilla, and Darwin G Caldwell. 2010. A portable rehabilitation device for the hand. In Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE. IEEE, 3694–3697.Google ScholarCross Ref
- Elias Kalapanidas, Hikari Watanabe, Costas Davarakis, Hannes Kaufmann, Fernando Fernandez Aranda, Tony Lam, Todor Ganchev, and Dimitri Konstantas. 2008. PlayMancer: a Serious Gaming 3D Environment. (2008). https://www.researchgate.net/publication/224353421_PlayMancer_a_Serious_Gaming_3D_Environment Último acesso em 17/12/2016.Google Scholar
- Eun-Seok Lee and Byeong-Seok Shin. 2021. A Flexible Input Mapping System for Next-Generation Virtual Reality Controllers. Electronics 10, 17 (2021), 2149.Google ScholarCross Ref
- Roanna Lun and Wenbing Zhao. 2015. A survey of applications and human motion recognition with microsoft kinect. International Journal of Pattern Recognition and Artificial Intelligence 29, 05 (2015), 1555008.Google ScholarCross Ref
- Dave Marshall. 1999. Further Threads Programming:Synchronization. (1999). http://users.cs.cf.ac.uk/Dave.Marshall/C/node31.html Último acesso em 23/12/2017.Google Scholar
- Marta Matamala-Gomez, Mel Slater, and Maria V Sanchez-Vives. 2022. Impact of virtual embodiment and exercises on functional ability and range of motion in orthopedic rehabilitation. Scientific reports 12, 1 (2022), 1–10.Google Scholar
- Virgil Mathiowetz, Gloria Volland, Nancy Kashman, and Karen Weber. 1985. Adult norms for the Box and Block Test of manual dexterity. American Journal of Occupational Therapy 39, 6 (1985), 386–391.Google ScholarCross Ref
- J. Meier, Carlos Farre, Prashant Bansode, Scott Barber, and Dennis Rea. 2007. Performance Testing Guidance for Web Applications: Patterns & Practices. Microsoft Press, Redmond, WA, USA.Google Scholar
- Albert Michotte. 2017. The perception of causality. Vol. 21. Routledge.Google Scholar
- Fabrizio Milazzo, Vito Gentile, Antonio Gentile, and Salvatore Sorce. 2018. KIND-DAMA: A modular middleware for Kinect-like device data management. Software: Practice and Experience 48, 1 (2018), 141–160.Google ScholarCross Ref
- Annette Mossel, Christian Schönauer, Georg Gerstweiler, and Hannes Kaufmann. 2013. Artifice-augmented reality framework for distributed collaboration. International Journal of Virtual Reality (2013).Google Scholar
- Iranzu Mugueta-Aguinaga and Begonya Garcia-Zapirain. 2017. FRED: Exergame to prevent dependence and functional deterioration associated with ageing. A pilot three-week randomized controlled clinical trial. International journal of environmental research and public health 14, 12 (2017), 1439.Google Scholar
- Yoonsin Oh and Stephen Yang. 2010. Defining exergames & exergaming. Proceedings of Meaningful Play (2010), 1–17.Google Scholar
- Thaiana Barbosa Ferreira Pacheco. 2020. Desenvolvimento e usabilidade de um jogo digital para reabilitação do equilíbrio postural de idosos. (2020).Google Scholar
- Dae-Sung Park, Do-Gyun Lee, Kyeongbong Lee, and GyuChang Lee. 2017. Effects of virtual reality training using Xbox Kinect on motor function in stroke survivors: a preliminary study. Journal of Stroke and Cerebrovascular Diseases 26, 10 (2017), 2313–2319.Google ScholarCross Ref
- Michele Pirovano, Pier Luca Lanzi, Renato Mainetti, and N Alberto Borghese. 2013. The design of a comprehensive game engine for rehabilitation. In Games Innovation Conference (IGIC), 2013 IEEE International. IEEE, 209–215.Google ScholarCross Ref
- Tyler Rose, Chang S Nam, and Karen B Chen. 2018. Immersion of virtual reality for rehabilitation-Review. Applied ergonomics 69 (2018), 153–161.Google Scholar
- Luciano Henrique de Oliveira Santos. 2016. Arcabouço para construção de jogos ubíquos com foco em reabilitação. (2016).Google Scholar
- Fabio Sartori. 2020. An API for wearable environments development and its application to mHealth field. Sensors 20, 21 (2020), 5970.Google ScholarCross Ref
- SBGames. 2013. Kayak Supremo. (2013). http://www.sbgames.org/sbgames2013/festival/post.php?tag=game114 Último acesso em 04/02/2018.Google Scholar
- Jie Shen and Maja Pantic. 2009. A software framework for multimodal humancomputer interaction systems. In Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on. IEEE, 2038–2045.Google ScholarCross Ref
- Lucas Silva, Rummenigge Dantas, Paula Diniz, Victor Jeronimo, Luque Bueno, and Thiago Dutra. 2016. PHYS. IO: Wearable hand tracking device. In Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), 2016 IEEE International Conference on. IEEE, 1–6.Google Scholar
- Lucas Silva, Rummenigge Dantas, André Pantoja, and Antônio Pereira. 2013. Development of a low cost dataglove based on arduino for virtual reality applications. In Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), 2013 IEEE International Conference on. IEEE, 55–59.Google ScholarCross Ref
- Evan A Suma, Belinda Lange, Albert Skip Rizzo, David M Krum, and Mark Bolas. 2011. Faast: The flexible action and articulated skeleton toolkit. In Virtual Reality Conference (VR), 2011 IEEE. IEEE, 247–248.Google ScholarDigital Library
- Masahiro Takaiwa, Toshiro Noritsugu, Norimichi Ito, and Daisuke Sasaki. 2011. Wrist rehabilitation device using pneumatic parallel manipulator based on EMG signal. International Journal of Automation Technology 5, 4 (2011), 472–477.Google ScholarCross Ref
- Russell M Taylor II, Thomas C Hudson, Adam Seeger, Hans Weber, Jeffrey Juliano, and Aron T Helser. 2001. VRPN: a device-independent, network-transparent VR peripheral system. In Proceedings of the ACM symposium on Virtual reality software and technology. ACM, 55–61.Google Scholar
- Luís Filipe Teófilo, Pedro Alves Nogueira, and Pedro Brandão Silva. 2013. Gemini: A generic multi-modal natural interface framework for videogames. In Advances in Information Systems and Technologies. Springer, 873–884.Google Scholar
- Gaetano Tieri, Giovanni Morone, Stefano Paolucci, and Marco Iosa. 2018. Virtual reality in cognitive and motor rehabilitation: facts, fiction and fallacies. Expert review of medical devices 15, 2 (2018), 107–117.Google Scholar
- Jacques Wainer 2007. Métodos de pesquisa quantitativa e qualitativa para a Ciência da Computação. Atualização em informática 1 (2007), 221–262.Google Scholar
- Yifan Wang, Kiran Ijaz, Dong Yuan, and Rafael A Calvo. 2020. VR-Rides: An object-oriented application framework for immersive virtual reality exergames. Software: Practice and Experience 50, 7 (2020), 1305–1324.Google ScholarCross Ref
- Frank Weichert, Daniel Bachmann, Bartholomäus Rudak, and Denis Fisseler. 2013. Analysis of the accuracy and robustness of the leap motion controller. Sensors 13, 5 (2013), 6380–6393.Google ScholarCross Ref
- Patrice L Weiss, Emily A Keshner, and Mindy F Levin. 2014. Virtual reality for physical and motor rehabilitation. Springer.Google Scholar
Index Terms
- A non-invasive middleware for games adaptation and motor rehabilitation controls
Recommendations
Serious games for rehabilitation: Gestural interaction in personalized gamified exercises through a recommender system
Graphical abstractDisplay Omitted
Highlights- We designed a recommender system of exergames for rehabilitation.
- We created a ...
AbstractOne of the principal problems of rehabilitation is that therapy sessions can be boring due the repetition of exercises. Serious games, and in particular exergames in rehabilitation, can motivate, engage and increase patients’ adherence ...
Applying Serious Games to Motor Learning in Sport
Considering the wide use of Serious Games in application fields like cognitive learning, health education and rehabilitation and the recent developments of sensor and interface technology it is surprising that applications to motor learning in sport are ...
Adapting Data from Physical Activity Sensors for Visualising Exertion in Virtual Reality Games
UbiComp '18: Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable ComputersHead mounted display (HMD) virtual reality (VR) games have shown promise beyond entertainment. Work has shown that playing VR games even for 10 minutes can provide players with valuable levels of physical exertion that is much higher then their ...
Comments