Skip to main content

Advertisement

SpringerLink
Log in

KiNEEt: application for learning and rehabilitation in special educational needs

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In the 21st century, the landscape of education has changed dramatically due to the application of technology in teaching and learning. This is especially true for teaching children with special needs. Technology has made it possible for the special needs children to be actively involved in their learning. The use of interactive whiteboards in the Special Education Center Princesa Sofia presented a few challenges for both the teachers and the students, hence KiNEEt was developed to overcome these problems. KiNEEt is a system which has been developed with the major aim of improving physical and cognitive skills in students with special needs. The different activities in KiNEEt are configurable and the tutor can modify the settings according to the needs of the student. The activities are game-oriented to attract the students attention and motivate them to learn. KiNEEt is highly interactive and it will encourage the students to be active learners. Results showed that Microsoft Kinect is the most suitable platform for this device as the students will be able to use the computer while simultaneously improving their digital competence, cognitive and physical skills.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Antón D, Goñi A, Illarramendi A et al (2015) Exercise recognition for kinect-based telerehabilitation. Methods Inf Med 54(2):145–155

    Article  Google Scholar 

  2. Attal F, Mohammed S, Dedabrishvili M, Chamroukhi F, Oukhellou L, Amirat Y (2015) Physical human activity recognition using wearable sensors. Sensors 15(12):31,314–31,338

    Article  Google Scholar 

  3. Bartoli L, Corradi C, Garzotto F, Valoriani M (2013) Exploring motion-based touchless games for autistic children’s learning. In: Proceedings of the 12th international conference on interaction design and children. ACM, pp 102–111

  4. Bossavit B, Pina A (2014) Designing educational tools, based on body interaction, for children with special needs who present different motor skills. In: 2014 international conference on interactive technologies and games (iTAG). IEEE, pp 63–70

  5. Boutsika E (2014) Kinect in education: a proposal for children with autism. Procedia Computer Science 27:123–129

    Article  Google Scholar 

  6. Buisine S, Courgeon M, Charles A, Clavel C, Martin JC, Tan N, Grynszpan O (2014) The role of body postures in the recognition of emotions in contextually rich scenarios. Int J Hum Comput Interact 30(1):52–62

    Article  Google Scholar 

  7. Cantón P., González Á, Mariscal G, Ruiz C (2012) Applying new interaction paradigms to the education of children with special educational needs. Computers Helping People with Special Needs 7382:65–72

  8. Chang YJ, Chen SF, Huang JD (2011) A kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. Res Dev Disabil 32(6):2566–2570

    Article  Google Scholar 

  9. Chen L, Hoey J, Nugent CD, Cook DJ, Yu Z (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):790–808

    Article  Google Scholar 

  10. Chen L, Wei H, Ferryman J (2013) A survey of human motion analysis using depth imagery. Pattern Recogn Lett 34(15):1995–2006

    Article  Google Scholar 

  11. Cho S, Ku J, Cho YK, Kim IY, Kang YJ, Jang DP, Kim SI (2014) Development of virtual reality proprioceptive rehabilitation system for stroke patients. Comput Methods Programs Biomed 113(1):258–265

    Article  Google Scholar 

  12. Choppin S, Wheat J (2012) Marker-less tracking of human movement using microsoft kinect. In: ISBS-conference proceedings archive, vol 1

  13. Cottone P, Gaglio S, Re GL, Ortolani M (2015) User activity recognition for energy saving in smart homes. Pervasive and Mobile Computing 16:156–170

    Article  Google Scholar 

  14. Cui J, Liu Y, Xu Y, Zhao H, Zha H (2013) Tracking generic human motion via fusion of low-and high-dimensional approaches. IEEE Trans Syst Man Cybern Syst 43(4):996–1002

    Article  Google Scholar 

  15. Dorman SM (1998) Assistive technology benefits for students with disabilities. J Sch Health 68(3):120

    Article  MathSciNet  Google Scholar 

  16. Echeverría MAM, Santana-Mancilla PC, Carrillo HFQ, Enciso EAF (2013) Natural user interfaces to teach math on higher education. Procedia Soc Behav Sci 106:1883–1889

    Article  Google Scholar 

  17. FernáNdez-LóPez Á, RodríGuez-FóRtiz MJ, RodríGuez-Almendros ML, MartíNez-Segura MJ (2013) Mobile learning technology based on ios devices to support students with special education needs. Comput Educ 61:77–90

    Article  Google Scholar 

  18. Fern’ndez-Baena A, Susín A, Lligadas X (2012) Biomechanical validation of upper-body and lower-body joint movements of kinect motion capture data for rehabilitation treatments. In: 2012 4th international conference on intelligent networking and collaborative systems (INCos). IEEE, pp 656–661

  19. Francese R, Passero I, Tortora G (2012) Wiimote and kinect: gestural user interfaces add a natural third dimension to hci. In: Proceedings of the international working conference on advanced visual interfaces. ACM, pp 116–123

  20. de Greef K, Van der Spek ED, Bekker T (2013) Designing kinect games to train motor skills for mixed ability players. In: Games for health. Springer, pp 197–205

  21. Hachaj T, Ogiela MR (2014) Rule-based approach to recognizing human body poses and gestures in real time. Multimedia Systems 20(1):81–99

    Article  Google Scholar 

  22. Homer BD, Kinzer CK, Plass JL, Letourneau SM, Hoffman D, Bromley M, Hayward EO, Turkay S, Kornak Y (2014) Moved to learn: the effects of interactivity in a kinect-based literacy game for beginning readers. Comput Educ 74:37–49

    Article  Google Scholar 

  23. Hsu HmJ (2011) The potential of kinect in education. International Journal of Information and Education Technology 1(5):365

    Article  Google Scholar 

  24. Hung CY, Kuo FO, Sun JCY, Yu PT (2014) An interactive game approach for improving students’ learning performance in multi-touch game-based learning. IEEE Trans Learn Technol 7(1):31–37

    Article  Google Scholar 

  25. Jordan MI, Mitchell TM (2015) Machine learning: trends, perspectives, and prospects. Science 349(6245):255–260

    Article  MathSciNet  MATH  Google Scholar 

  26. Joselli M, da Silva JR, Zamith M, Clua E, Pelegrino M, Mendonça E., Soluri E (2012) An architecture for game interaction using mobile. In: 2012 IEEE international games innovation conference (IGIC). IEEE, pp 1–5

  27. Karray F, Alemzadeh M, Saleh JA, Arab MN (2008) Human-computer interaction: overview on state of the art. International Journal on Smart Sensing and Intelligent 1(1):137–159

    Article  Google Scholar 

  28. Kayama H, Nishiguchi S, Yamada M, Aoyama T, Okamoto K, Kuroda T (2013) Effect of a kinect-based exercise game on improving executive cognitive performance in community-dwelling elderly. In: Proceedings of the 7th international conference on pervasive computing technologies for healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 362–365

  29. Lara OD, Labrador MA (2013) A survey on human activity recognition using wearable sensors. IEEE Communications Surveys and Tutorials 15(3):1192–1209

    Article  Google Scholar 

  30. Liang Y, Zhou X, Yu Z, Guo B (2014) Energy-efficient motion related activity recognition on mobile devices for pervasive healthcare. Mobile Networks and Applications 19(3):303–317

    Article  Google Scholar 

  31. Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. In: AAAI, vol 30, pp 1266–1272

  32. Liu Y, Cui J, Zhao H, Zha H (2012) Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking. In: 2012 21st international conference on pattern recognition (ICPR). IEEE, pp 898–901

  33. Liu Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2activity: recognizing complex activities from sensor data. In: IJCAI, pp 1617–1623

  34. Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115

    Article  Google Scholar 

  35. Liu Y, Zhang X, Cui J, Wu C, Aghajan H, Zha H (2010) Visual analysis of child-adult interactive behaviors in video sequences. In: 2010 16th international conference on virtual systems and multimedia (VSMM). IEEE, pp 26–33

  36. Lorenzo G, Pomares J, Lledó A (2013) Inclusion of immersive virtual learning environments and visual control systems to support the learning of students with asperger syndrome. Comput Educ 62:88–101

    Article  Google Scholar 

  37. Lu Y, Wei Y, Liu L, Zhong J, Sun L, Liu Y (2017) Towards unsupervised physical activity recognition using smartphone accelerometers. Multimedia Tools and Applications 76(8):10,701–10,719

    Article  Google Scholar 

  38. Mateu J, Lasala MJ, Alamán X (2014) Virtualtouch: a tool for developing mixed reality educational applications and an example of use for inclusive education. Int J Hum Comput Interact 30(10):815–828

    Article  Google Scholar 

  39. Metcalf CD, Robinson R, Malpass AJ, Bogle TP, Dell TA, Harris C, Demain SH (2013) Markerless motion capture and measurement of hand kinematics: validation and application to home-based upper limb rehabilitation. IEEE Trans Biomed Eng 60(8):2184–2192

    Article  Google Scholar 

  40. Neil A, Ens S, Pelletier R, Jarus T, Rand D (2013) Sony playstation eyetoy elicits higher levels of movement than the nintendo wii: implications for stroke rehabilitation. Eur J Phys Rehabil Med 49(1):13–21

    Google Scholar 

  41. Neuroathome.net (2013) Neuroathome. Virtual rehabilitation platform @ONLINE. http://www.neuroathome.net/. Accessed 25 November 2017

  42. Nijs L, Leman M (2014) Interactive technologies in the instrumental music classroom: a longitudinal study with the music paint machine. Comput Educ 73:40–59

    Article  Google Scholar 

  43. Parette HP, Stoner JB (2008) Benefits of assistive technology user groups for early childhood education professionals. Early Childhood Educ J 35(4):313–319

    Article  Google Scholar 

  44. Parry I, Carbullido C, Kawada J, Bagley A, Sen S, Greenhalgh D, Palmieri T (2014) Keeping up with video game technology: Objective analysis of xbox kinect and playstation 3 move for use in burn rehabilitation. Burns 40(5):852–859

    Article  Google Scholar 

  45. Qu J, Song Y, Wei Y (2013) Applying design patterns in game programming. In: Proceedings of the international conference on software engineering research and practice (SERP). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), p 1

  46. Rahman MA (2015) Multimedia environment toward analyzing and visualizing live kinematic data for children with hemiplegia. Multimedia Tools and Applications 74 (15):5463–5487

    Article  Google Scholar 

  47. Ranchal R, Taber-Doughty T, Guo Y, Bain K, Martin H, Robinson JP, Duerstock BS (2013) Using speech recognition for real-time captioning and lecture transcription in the classroom. IEEE Trans Learn Technol 6(4):299–311

    Article  Google Scholar 

  48. Ringstaff C, Kelley L (2002) The learning return on our educational technology investment: a review of findings from research. ERIC Clearinghouse, Washington, D.C., p 34. http://www.eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED462924

    Google Scholar 

  49. Seivert Entwistle M (2003) The performance of automated speech recognition systems under adverse conditions of human exertion. Int J Hum Comput Interact 16 (2):127–140

    Article  Google Scholar 

  50. Sheu FR, Chen NS (2014) Taking a signal: a review of gesture-based computing research in education. Comput Educ 78:268–277

    Article  Google Scholar 

  51. Soltani F, Eskandari F, Golestan S (2012) Developing a gesture-based game for deaf/mute people using microsoft kinect. In: 2012 sixth international conference on complex, intelligent and software intensive systems (CISIS). IEEE, pp 491–495

  52. Song Y, Demirdjian D, Davis R (2012) Continuous body and hand gesture recognition for natural human-computer interaction. ACM Transactions on Interactive Intelligent Systems (TiiS) 2(1):5

    Google Scholar 

  53. Staiano AE, Calvert SL (2011) Exergames for physical education courses: physical, social, and cognitive benefits. Child Dev Perspect 5(2):93–98

    Article  Google Scholar 

  54. Su CH (2016) Developing and evaluating effectiveness of 3d game-based rehabilitation system for total knee replacement rehabilitation patients. Multimedia Tools and Applications 75(16):10,037–10,057

    Article  Google Scholar 

  55. Sung HY, Hwang GJ, Yen YF (2015) Development of a contextual decision-making game for improving students’ learning performance in a health education course. Comput Educ 82:179–190

    Article  Google Scholar 

  56. Torrente J, Freire M, Moreno-Ger P, Fernández-Manjón B (2015) Evaluation of semi-automatically generated accessible interfaces for educational games. Comput Educ 83:103–117

    Article  Google Scholar 

  57. Sáenz-de Urturi Z, García Zapirain B, Méndez Zorrilla A (2015) Elderly user experience to improve a kinect-based game playability. Behav Inform Technol 34 (11):1040–1051

    Article  Google Scholar 

  58. Sáenz-de Urturi Z, Zapirain BG, Zorrilla AM (2014) Kinect-based virtual game for motor and cognitive rehabilitation: a pilot study for older adults. In: Proceedings of the 8th international conference on pervasive computing technologies for healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 262–265

  59. de Urturi ZS, Zorilla AM, Zapirain BG (2012) Jewheels: kinect based serious game aimed at wheelchair users. In: International workshop on ambient assisted living. Springer, pp 391–398

  60. Velloso E, Bulling A, Gellersen H, Ugulino W, Fuks H (2013) Qualitative activity recognition of weight lifting exercises. In: Proceedings of the 4th augmented human international conference. ACM, pp 116–123

  61. Virtualrehab.info (2014) Virtualrehab. Virtual rehabilitation system @ONLINE. http://www.virtualrehab.info/ http://www.virtualrehab.info/. Accessed 25 November 2017

  62. Vishwakarma S, Agrawal A (2013) A survey on activity recognition and behavior understanding in video surveillance. Vis Comput 29(10):983–1009

    Article  Google Scholar 

  63. Yang MT, Liao WC (2014) Computer-assisted culture learning in an online augmented reality environment based on free-hand gesture interaction. IEEE Trans Learn Technol 7(2):107–117

    Article  Google Scholar 

  64. Yin Y, Davis R (2014) Real-time continuous gesture recognition for natural human-computer interaction. In: 2014 IEEE symposium on visual languages and human-centric computing (VL/HCC). IEEE, pp 113–120

  65. Zhang Z (2012) Microsoft kinect sensor and its effect. IEEE Multimedia 19 (2):4–10

    Article  Google Scholar 

Download references

Acknowledgements

This work was funded by the EU ERDF and the Spanish Ministry of Economy and Competitiveness (MINECO) under Project TIN2013-41576-R. We also want to thank teachers and students of Special Education Center Princesa Sofia for their collaboration in this project.

Author information

Authors and Affiliations

  1. Applied Computing Group (ACG), Department of Informatics, University of Almeria, CITE 3 Building, Floor 2, Office 110, Ctra. Sacramento, s/n, 04120 La Canada, Almeria, Spain

    Juan Jesus Ojeda-Castelo, Jose Antonio Piedra-Fernandez & Luis Iribarne

  2. Department of Education, University of Almeria, Almeria, Spain

    Cesar Bernal-Bravo

Authors
  1. Juan Jesus Ojeda-Castelo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jose Antonio Piedra-Fernandez
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luis Iribarne
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cesar Bernal-Bravo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jose Antonio Piedra-Fernandez.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ojeda-Castelo, J.J., Piedra-Fernandez, J.A., Iribarne, L. et al. KiNEEt: application for learning and rehabilitation in special educational needs. Multimed Tools Appl 77, 24013–24039 (2018). https://doi.org/10.1007/s11042-018-5678-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5678-1

Keywords

Search

Navigation