Skip to main content
Springer Nature Link
Log in

EasyAffecta: A framework to develop serious games for virtual rehabilitation with affective adaptation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Serious games have been applied in many contexts, aiming to turn learning and training activities more attractive for users. The motor rehabilitation process is a scenario in which serious games present benefits such as keeping the user’s motivation. Nevertheless, the development of these games is a complex task, especially when user’s motivation is a key goal. Some strategies have been investigated to automatically adapt these games to keep one’s engagement. However, fast implementation with little effort is an open issue. To support a game with automatic adaptation considering the emotional state of the user, we propose an Affective Computing framework, called EasyAffecta. EasyAffecta provides benefits for physiotherapists, developers, and patients alike. The impact of our proposal was analyzed by conducting two experimental evaluations involving different actors. The first one was carried with patients of motor rehabilitation process. Additionally, we conducted an experimental evaluation with developers. The results showed that EasyAffecta was considered useful by developers and efficient to maintain the patient’s engagement.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Affectiva (2017) Accuracy. http://developer.affectiva.com/accuracy/

  2. Affectiva (2017) Affectiva developer portal. http://developer.affectiva.com/metrics/

  3. Affectiva (2017) Emotion recognition software and analysis. http://www.affectiva.com

  4. Affectiva (2017) How do we map facial expressions to emotions? http://developer.affectiva.com/emotion_mapping/

  5. Aranha R V, Corrêa C G, Nunes F L S (2019) Adapting software with affective computing: a systematic review. IEEE Trans Affect Comput 1–1. https://doi.org/10.1109/TAFFC.2019.2902379

  6. Aranha R V, Silva L S, Chaim M L, Nunes F L S (2017) Using affective computing to automatically adapt serious games for rehabilitation. In: 2017 IEEE 30th international symposium on computer-based medical systems (CBMS), pp 55–60

  7. Bandura A (2006) Guide for constructing self-efficacy scales. Self-efficacy Belief Adolescent 5:307–337

    Google Scholar 

  8. Corporation O (2019) Mysql. https://www.mysql.com/

  9. Csikszentmihalyi M (1991) Flow: The psychology of optimal experience. Harper Perennial, New York

    Google Scholar 

  10. Dörner R, Göbel S, Effelsberg W, Wiemeyer J (2016) Introduction. In: Serious Games: Foundations, Concepts and Practice. https://doi.org/10.1007/978-3-319-40612-1_1. Springer International Publishing, Cham, pp 1–34

  11. El Hussein M, Hirst S, Salyers V, Osuji J (2014) Using grounded theory as a method of inquiry: Advantages and disadvantages. Qual Res 19(27):1–15

    Google Scholar 

  12. Freina L, Ott M (2015) A literature review on immersive virtual reality in education: state of the art and perspectives. In: The international scientific conference eLearning and software for education, vol 1. “Carol I” National Defence University, p 133

  13. Gebara C M, Barros-Neto TPd, Gertsenchtein L, Lotufo-Neto F (2016) Virtual reality exposure using three-dimensional images for the treatment of social phobia. Rev Bras Psiquiatr 38(1):24–29

    Article  Google Scholar 

  14. Group TP (2019) Php: Hypertext processor. http://php.net/

  15. Heins S, Dehem S, Montedoro V, Dehez B, Edwards M, Stoquart G, Rocca F, De Deken P H, Mancas M, Lejeune T (2017) Robotic-assisted serious game for motor and cognitive post-stroke rehabilitation. In: 2017 IEEE 5th international conference on serious games and applications for health (SeGAH), pp 1–8

  16. Hendrix M, Bellamy-Wood T, McKay S, Bloom V, Dunwell I (2019) Implementing adaptive game difficulty balancing in serious games. IEEE Trans Games 11(4):320–327. https://doi.org/10.1109/TG.2018.2791019

    Article  Google Scholar 

  17. Henrik S-F (2011) The player engagement process - an exploration of continuation desire in digital games. In: DiGRA - Proceedings of the 2011 DiGRA international conference: Think design play. http://www.digra.org/wp-content/uploads/digital-library/11307.06025.pdf. DiGRA/Utrecht school of the arts

  18. Jennett C, Cox A L, Cairns P, Dhoparee S, Epps A, Tijs T, Walton A (2008) Measuring and defining the experience of immersion in games. Int J Hum-Comput Stud 66(9):641–661. https://doi.org/10.1016/j.ijhcs.2008.04.004

    Article  Google Scholar 

  19. Legris P, Ingham J, Collerette P (2003) Why do people use information technology? a critical review of the technology acceptance model. Inf Manag 40(3):191–204

    Article  Google Scholar 

  20. Levin M F, Weiss P L, Keshner E A (2015) Emergence of virtual reality as a tool for upper limb rehabilitation: incorporation of motor control and motor learning principles. Phys Therapy 95(3):415–425

    Article  Google Scholar 

  21. Michael D R, Chen S L (2005) Serious games: Games that educate, train, and inform. Muska & Lipman/Premier-Trade

  22. Microsoft (2019) Kinect - desenvolvimento de aplicativos do windows. https://developer.microsoft.com/pt-br/windows/kinect

  23. Mostefai B, Balla A, Trigano P (2019) A generic and efficient emotion-driven approach toward personalized assessment and adaptation in serious games. Cogn Syst Res 56:82–106. https://doi.org/10.1016/j.cogsys.2019.03.006

    Article  Google Scholar 

  24. Novak D, Nagle A, Keller U, Riener R (2014) Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay. J Neuroeng Rehabil 11(1):64

    Article  Google Scholar 

  25. Papadimitriou S, Chrysafiadi K, Virvou M (July 2019) FuzzEG: Fuzzy logic for adaptive scenarios in an educational adventure game. Multimed Tools Appl 78(22):32023–32053. https://doi.org/10.1007/s11042-019-07955-w

  26. Picard RW (1997) Affective computing. MIT Press. https://books.google.com.br/books?id=GaVncRTcb1gC

  27. Pinto J F, Carvalho H R, Chambel G R R, Ramiro J, Goncalves A (2018) Adaptive gameplay and difficulty adjustment in a gamified upper-limb rehabilitation. In: 2018 IEEE 6th international conference on serious games and applications for health (SeGAH), pp 1–8

  28. Pluralsight (2019) Javascript.com. https://www.javascript.com/

  29. Robinson R, Wiley K, Rezaeivahdati A, Klarkowski M, Mandryk Rl (2020) “Let's Get Physiological, Physiological!”: A Systematic Review of Affective Gaming. In: Proceedings of the Annual Symposium on Computer-Human Interaction in Play. ACM

  30. Sekhavat Y A, Sisi M J, Roohi S (October 2020) Affective interaction: Using emotions as a user interface in games. Multimed Tools Appl. https://doi.org/10.1007/s11042-020-10006-4

  31. Strauss A, Corbin J (1998) Basics of qualitative research: Techniques and procedures for developing grounded theory. Sage Publications, Inc.

  32. Tadayon R, Amresh A, McDaniel T, Panchanathan S (2018) Real-time stealth intervention for motor learning using player flow-state. In: 2018 IEEE 6th international conference on serious games and applications for health (SeGAH), pp 1–8

  33. Tarozzi M (2008) Che cos’ è la grounded theory. Carocci Roma

  34. Unity-3D (2016) Unity - manual: Scripting. https://docs.unity3d.com/Manual/ScriptingSection.html

  35. Unity-3D (2017) Get unity. https://unity3d.com/pt/get-unity

Download references

Acknowledgements

Authors thank the Brazilian National Council of Scientific and Technological Development (CNPq, Process 800585/2016-0), the National Institute of Science and Technology Medicine Assisted by Scientific Computing (INCT-MACC), and Brazilian Federal Agency for Support and Evaluation of Graduate Education (CAPES) by the financial support. Authors are also grateful for Freepik and Flaticon by the images used in this article.

Author information

Authors and Affiliations

  1. Escola Politécnica, Universidade de São Paulo, São Paulo, Brazil

    Renan V. Aranha

  2. Escola de Artes, Ciências e Humanidades, Universidade de São Paulo, São Paulo, Brazil

    Marcos L. Chaim, Carlos B. M. Monteiro, Talita D. Silva, Francisca A. A. C. Guerreiro, Willian S. Silva & Fátima L. S. Nunes

Authors
  1. Renan V. Aranha
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Marcos L. Chaim
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Carlos B. M. Monteiro
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Talita D. Silva
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Francisca A. A. C. Guerreiro
    View author publications

    You can also search for this author inPubMed Google Scholar

  6. Willian S. Silva
    View author publications

    You can also search for this author inPubMed Google Scholar

  7. Fátima L. S. Nunes
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Renan V. Aranha.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Aranha, R.V., Chaim, M.L., Monteiro, C.B.M. et al. EasyAffecta: A framework to develop serious games for virtual rehabilitation with affective adaptation. Multimed Tools Appl 82, 2303–2328 (2023). https://doi.org/10.1007/s11042-022-12600-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12600-0

Keywords