Abstract
In the 21st century, the landscape of education has changed dramatically due to the application of technology in teaching and learning. This is especially true for teaching children with special needs. Technology has made it possible for the special needs children to be actively involved in their learning. The use of interactive whiteboards in the Special Education Center Princesa Sofia presented a few challenges for both the teachers and the students, hence KiNEEt was developed to overcome these problems. KiNEEt is a system which has been developed with the major aim of improving physical and cognitive skills in students with special needs. The different activities in KiNEEt are configurable and the tutor can modify the settings according to the needs of the student. The activities are game-oriented to attract the students attention and motivate them to learn. KiNEEt is highly interactive and it will encourage the students to be active learners. Results showed that Microsoft Kinect is the most suitable platform for this device as the students will be able to use the computer while simultaneously improving their digital competence, cognitive and physical skills.
Similar content being viewed by others
References
Antón D, Goñi A, Illarramendi A et al (2015) Exercise recognition for kinect-based telerehabilitation. Methods Inf Med 54(2):145–155
Attal F, Mohammed S, Dedabrishvili M, Chamroukhi F, Oukhellou L, Amirat Y (2015) Physical human activity recognition using wearable sensors. Sensors 15(12):31,314–31,338
Bartoli L, Corradi C, Garzotto F, Valoriani M (2013) Exploring motion-based touchless games for autistic children’s learning. In: Proceedings of the 12th international conference on interaction design and children. ACM, pp 102–111
Bossavit B, Pina A (2014) Designing educational tools, based on body interaction, for children with special needs who present different motor skills. In: 2014 international conference on interactive technologies and games (iTAG). IEEE, pp 63–70
Boutsika E (2014) Kinect in education: a proposal for children with autism. Procedia Computer Science 27:123–129
Buisine S, Courgeon M, Charles A, Clavel C, Martin JC, Tan N, Grynszpan O (2014) The role of body postures in the recognition of emotions in contextually rich scenarios. Int J Hum Comput Interact 30(1):52–62
Cantón P., González Á, Mariscal G, Ruiz C (2012) Applying new interaction paradigms to the education of children with special educational needs. Computers Helping People with Special Needs 7382:65–72
Chang YJ, Chen SF, Huang JD (2011) A kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities. Res Dev Disabil 32(6):2566–2570
Chen L, Hoey J, Nugent CD, Cook DJ, Yu Z (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):790–808
Chen L, Wei H, Ferryman J (2013) A survey of human motion analysis using depth imagery. Pattern Recogn Lett 34(15):1995–2006
Cho S, Ku J, Cho YK, Kim IY, Kang YJ, Jang DP, Kim SI (2014) Development of virtual reality proprioceptive rehabilitation system for stroke patients. Comput Methods Programs Biomed 113(1):258–265
Choppin S, Wheat J (2012) Marker-less tracking of human movement using microsoft kinect. In: ISBS-conference proceedings archive, vol 1
Cottone P, Gaglio S, Re GL, Ortolani M (2015) User activity recognition for energy saving in smart homes. Pervasive and Mobile Computing 16:156–170
Cui J, Liu Y, Xu Y, Zhao H, Zha H (2013) Tracking generic human motion via fusion of low-and high-dimensional approaches. IEEE Trans Syst Man Cybern Syst 43(4):996–1002
Dorman SM (1998) Assistive technology benefits for students with disabilities. J Sch Health 68(3):120
Echeverría MAM, Santana-Mancilla PC, Carrillo HFQ, Enciso EAF (2013) Natural user interfaces to teach math on higher education. Procedia Soc Behav Sci 106:1883–1889
FernáNdez-LóPez Á, RodríGuez-FóRtiz MJ, RodríGuez-Almendros ML, MartíNez-Segura MJ (2013) Mobile learning technology based on ios devices to support students with special education needs. Comput Educ 61:77–90
Fern’ndez-Baena A, Susín A, Lligadas X (2012) Biomechanical validation of upper-body and lower-body joint movements of kinect motion capture data for rehabilitation treatments. In: 2012 4th international conference on intelligent networking and collaborative systems (INCos). IEEE, pp 656–661
Francese R, Passero I, Tortora G (2012) Wiimote and kinect: gestural user interfaces add a natural third dimension to hci. In: Proceedings of the international working conference on advanced visual interfaces. ACM, pp 116–123
de Greef K, Van der Spek ED, Bekker T (2013) Designing kinect games to train motor skills for mixed ability players. In: Games for health. Springer, pp 197–205
Hachaj T, Ogiela MR (2014) Rule-based approach to recognizing human body poses and gestures in real time. Multimedia Systems 20(1):81–99
Homer BD, Kinzer CK, Plass JL, Letourneau SM, Hoffman D, Bromley M, Hayward EO, Turkay S, Kornak Y (2014) Moved to learn: the effects of interactivity in a kinect-based literacy game for beginning readers. Comput Educ 74:37–49
Hsu HmJ (2011) The potential of kinect in education. International Journal of Information and Education Technology 1(5):365
Hung CY, Kuo FO, Sun JCY, Yu PT (2014) An interactive game approach for improving students’ learning performance in multi-touch game-based learning. IEEE Trans Learn Technol 7(1):31–37
Jordan MI, Mitchell TM (2015) Machine learning: trends, perspectives, and prospects. Science 349(6245):255–260
Joselli M, da Silva JR, Zamith M, Clua E, Pelegrino M, Mendonça E., Soluri E (2012) An architecture for game interaction using mobile. In: 2012 IEEE international games innovation conference (IGIC). IEEE, pp 1–5
Karray F, Alemzadeh M, Saleh JA, Arab MN (2008) Human-computer interaction: overview on state of the art. International Journal on Smart Sensing and Intelligent 1(1):137–159
Kayama H, Nishiguchi S, Yamada M, Aoyama T, Okamoto K, Kuroda T (2013) Effect of a kinect-based exercise game on improving executive cognitive performance in community-dwelling elderly. In: Proceedings of the 7th international conference on pervasive computing technologies for healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 362–365
Lara OD, Labrador MA (2013) A survey on human activity recognition using wearable sensors. IEEE Communications Surveys and Tutorials 15(3):1192–1209
Liang Y, Zhou X, Yu Z, Guo B (2014) Energy-efficient motion related activity recognition on mobile devices for pervasive healthcare. Mobile Networks and Applications 19(3):303–317
Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model. In: AAAI, vol 30, pp 1266–1272
Liu Y, Cui J, Zhao H, Zha H (2012) Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking. In: 2012 21st international conference on pattern recognition (ICPR). IEEE, pp 898–901
Liu Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2activity: recognizing complex activities from sensor data. In: IJCAI, pp 1617–1623
Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 181:108–115
Liu Y, Zhang X, Cui J, Wu C, Aghajan H, Zha H (2010) Visual analysis of child-adult interactive behaviors in video sequences. In: 2010 16th international conference on virtual systems and multimedia (VSMM). IEEE, pp 26–33
Lorenzo G, Pomares J, Lledó A (2013) Inclusion of immersive virtual learning environments and visual control systems to support the learning of students with asperger syndrome. Comput Educ 62:88–101
Lu Y, Wei Y, Liu L, Zhong J, Sun L, Liu Y (2017) Towards unsupervised physical activity recognition using smartphone accelerometers. Multimedia Tools and Applications 76(8):10,701–10,719
Mateu J, Lasala MJ, Alamán X (2014) Virtualtouch: a tool for developing mixed reality educational applications and an example of use for inclusive education. Int J Hum Comput Interact 30(10):815–828
Metcalf CD, Robinson R, Malpass AJ, Bogle TP, Dell TA, Harris C, Demain SH (2013) Markerless motion capture and measurement of hand kinematics: validation and application to home-based upper limb rehabilitation. IEEE Trans Biomed Eng 60(8):2184–2192
Neil A, Ens S, Pelletier R, Jarus T, Rand D (2013) Sony playstation eyetoy elicits higher levels of movement than the nintendo wii: implications for stroke rehabilitation. Eur J Phys Rehabil Med 49(1):13–21
Neuroathome.net (2013) Neuroathome. Virtual rehabilitation platform @ONLINE. http://www.neuroathome.net/. Accessed 25 November 2017
Nijs L, Leman M (2014) Interactive technologies in the instrumental music classroom: a longitudinal study with the music paint machine. Comput Educ 73:40–59
Parette HP, Stoner JB (2008) Benefits of assistive technology user groups for early childhood education professionals. Early Childhood Educ J 35(4):313–319
Parry I, Carbullido C, Kawada J, Bagley A, Sen S, Greenhalgh D, Palmieri T (2014) Keeping up with video game technology: Objective analysis of xbox kinect and playstation 3 move for use in burn rehabilitation. Burns 40(5):852–859
Qu J, Song Y, Wei Y (2013) Applying design patterns in game programming. In: Proceedings of the international conference on software engineering research and practice (SERP). The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), p 1
Rahman MA (2015) Multimedia environment toward analyzing and visualizing live kinematic data for children with hemiplegia. Multimedia Tools and Applications 74 (15):5463–5487
Ranchal R, Taber-Doughty T, Guo Y, Bain K, Martin H, Robinson JP, Duerstock BS (2013) Using speech recognition for real-time captioning and lecture transcription in the classroom. IEEE Trans Learn Technol 6(4):299–311
Ringstaff C, Kelley L (2002) The learning return on our educational technology investment: a review of findings from research. ERIC Clearinghouse, Washington, D.C., p 34. http://www.eric.ed.gov/contentdelivery/servlet/ERICServlet?accno=ED462924
Seivert Entwistle M (2003) The performance of automated speech recognition systems under adverse conditions of human exertion. Int J Hum Comput Interact 16 (2):127–140
Sheu FR, Chen NS (2014) Taking a signal: a review of gesture-based computing research in education. Comput Educ 78:268–277
Soltani F, Eskandari F, Golestan S (2012) Developing a gesture-based game for deaf/mute people using microsoft kinect. In: 2012 sixth international conference on complex, intelligent and software intensive systems (CISIS). IEEE, pp 491–495
Song Y, Demirdjian D, Davis R (2012) Continuous body and hand gesture recognition for natural human-computer interaction. ACM Transactions on Interactive Intelligent Systems (TiiS) 2(1):5
Staiano AE, Calvert SL (2011) Exergames for physical education courses: physical, social, and cognitive benefits. Child Dev Perspect 5(2):93–98
Su CH (2016) Developing and evaluating effectiveness of 3d game-based rehabilitation system for total knee replacement rehabilitation patients. Multimedia Tools and Applications 75(16):10,037–10,057
Sung HY, Hwang GJ, Yen YF (2015) Development of a contextual decision-making game for improving students’ learning performance in a health education course. Comput Educ 82:179–190
Torrente J, Freire M, Moreno-Ger P, Fernández-Manjón B (2015) Evaluation of semi-automatically generated accessible interfaces for educational games. Comput Educ 83:103–117
Sáenz-de Urturi Z, García Zapirain B, Méndez Zorrilla A (2015) Elderly user experience to improve a kinect-based game playability. Behav Inform Technol 34 (11):1040–1051
Sáenz-de Urturi Z, Zapirain BG, Zorrilla AM (2014) Kinect-based virtual game for motor and cognitive rehabilitation: a pilot study for older adults. In: Proceedings of the 8th international conference on pervasive computing technologies for healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 262–265
de Urturi ZS, Zorilla AM, Zapirain BG (2012) Jewheels: kinect based serious game aimed at wheelchair users. In: International workshop on ambient assisted living. Springer, pp 391–398
Velloso E, Bulling A, Gellersen H, Ugulino W, Fuks H (2013) Qualitative activity recognition of weight lifting exercises. In: Proceedings of the 4th augmented human international conference. ACM, pp 116–123
Virtualrehab.info (2014) Virtualrehab. Virtual rehabilitation system @ONLINE. http://www.virtualrehab.info/ http://www.virtualrehab.info/. Accessed 25 November 2017
Vishwakarma S, Agrawal A (2013) A survey on activity recognition and behavior understanding in video surveillance. Vis Comput 29(10):983–1009
Yang MT, Liao WC (2014) Computer-assisted culture learning in an online augmented reality environment based on free-hand gesture interaction. IEEE Trans Learn Technol 7(2):107–117
Yin Y, Davis R (2014) Real-time continuous gesture recognition for natural human-computer interaction. In: 2014 IEEE symposium on visual languages and human-centric computing (VL/HCC). IEEE, pp 113–120
Zhang Z (2012) Microsoft kinect sensor and its effect. IEEE Multimedia 19 (2):4–10
Acknowledgements
This work was funded by the EU ERDF and the Spanish Ministry of Economy and Competitiveness (MINECO) under Project TIN2013-41576-R. We also want to thank teachers and students of Special Education Center Princesa Sofia for their collaboration in this project.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ojeda-Castelo, J.J., Piedra-Fernandez, J.A., Iribarne, L. et al. KiNEEt: application for learning and rehabilitation in special educational needs. Multimed Tools Appl 77, 24013–24039 (2018). https://doi.org/10.1007/s11042-018-5678-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-5678-1