Abstract
Identifying emotions experienced by students in a learning environment contributes to measuring the impact when technologies such as augmented reality (AR) are implemented in the educational field. The most frequent methods for collecting emotional metrics are questionnaires, surveys, and observations, but each of these processes lacks objectivity and veracity. For this reason, this study proposes, develops and tests a learning analytics scheme, based on the density-based spatial clustering of applications with noise algorithm, as a clustering technique with time series analysis, using the brain- computer interface device, Emotiv EPOC, as a way to collect emotional metrics. The above, in order to perform emotional behavior characterization by using AR in a learning environment through AR-Sandbox. The proposed method shows a clear inclination in the tendency of each emotion in each cluster, allowing classification of children during their interaction with the immersive environment, as well as the ability to distinguish each group of students.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alonso-Virgos L, Pascual Espada J, Rodríguez Baena L, Crespo RG (2018) Design specific user interfaces for people with down syndrome using suitable WCAG 2.0 guidelines. J Ambient Intell Humaniz Comput 9:1359–1374. https://doi.org/10.1007/s12652-017-0539-8
Ati M, Kabir K, Abdullahi H, Ahmed M (2018) Augmented reality enhanced computer aided learning for young children. In: ISCAIE 2018—2018 IEEE symposium on computer applications and industrial electronics, pp 129–133. https://doi.org/10.1109/ISCAIE.2018.8405457
Balducci F, Grana C, Cucchiara R (2017) Affective level design for a role-playing videogame evaluated by a brain–computer interface and machine learning methods. Vis Comput 33:413–427. https://doi.org/10.1007/s00371-016-1320-2
Becerra MA, Londoño-Delgado E, Pelaez-Becerra SM, et al (2018) Electroencephalographic signals and emotional states for tactile pleasantness classification, vol 1, pp. 201–209. https://doi.org/10.1007/978-3-030-01132-1
Cabañero L, Hervás R, Bravo J et al (2019) Eeglib: computational analysis of cognitive performance during the use of video games. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-019-01592-9
Cascales A, Laguna I, Pérez-López D et al (2013) An experience on natural sciences augmented reality contents for preschoolers. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinform) 8022:103–112. https://doi.org/10.1007/978-3-642-39420-1-12
Chen CH, Huang CY, Chou YY (2019) Effects of augmented reality-based multidimensional concept maps on students’ learning achievement, motivation and acceptance. Univers Access Inf Soc 18:257–268. https://doi.org/10.1007/s10209-017-0595-z
de Ravé EG, Jiménez-Hornero FJ, Ariza-Villaverde AB, Taguas-Ruiz J (2016) DiedricAR: a mobile augmented reality system designed for the ubiquitous descriptive geometry learning. Multimed Tools Appl 75:9641–9663. https://doi.org/10.1007/s11042-016-3384-4
Duval E, Sharples M, Sutherland R (2017) Technology enhanced learning: research themes. Technol Enhanc Learn Res Themes. https://doi.org/10.1007/978-3-319-02600-8
EMOTIV (2019) EMOTIV. In: How do you meas. Emot. First place so you can comp. outputs come up with a number? https://www.emotiv.com/knowledge-base/how-do-you-measure-emotions-in-the-first-place-so-you-can-compare-the-outputs-and-come-up-with-a-number/. Accessed 29 May 2019
Feidakis M (2016) A review of emotion-aware systems for e-learning in virtual environments. In: Formative assessment, learning data analytics and gamification: In ICT Education. Elsevier Inc., pp 217–242
Fernández-Gallego B, Lama M, Vidal JC, Mucientes M (2013) Learning analytics framework for educational virtual worlds. Proc Comput Sci 25:443–447. https://doi.org/10.1016/j.procs.2013.11.056
Gaeta M, Orciuoli F, Rarità L, Tomasiello S (2017) Fitted Q-iteration and functional networks for ubiquitous recommender systems. Soft Comput 21:7067–7075. https://doi.org/10.1007/s00500-016-2248-1
Gallego CEV, Gómez VF, Nieto FJS, Martínez MG (2018) Discussion on density-based clustering methods applied for automated identification of airspace flows. In: AIAA/IEEE digit avion syst conf—proc 2018-Septe. https://doi.org/10.1109/DASC.2018.8569219
Gaona-García PA, Martín-Moncunill D, Sánchez-Alonso S, García AF (2014) A usability study of taxonomy visualisation user interfaces in digital repositories. Online Inf Rev 38:284–304. https://doi.org/10.1108/OIR-03-2013-0051
Gaona-García PA, Stoitsis G, Sánchez-Alonso S, Biniari K (2016) An exploratory study of user perception in visual search interfaces based on SKOS. Knowl Organ 43:217–238. https://doi.org/10.5771/0943-7444-2016-4-217
Gaona-García PA, Montenegro-Marin CE, Herrera-Cubides JF (2018a) Métodos de inmersión virtual Basados en ontologías para Acceso a recursos educativos. Bogotá DC, Colombia
Gaona-García PA, Montenegro-Marin CE, Martín-Moncunill D (2018b) Entornos de búsquedas navegacionales a partir de esquemas de representación de conocimiento. Universidad Distrital Francisco José de Caldas, Bogotá, Colombia
Giorgis S, Mahlen N, Anne K (2017) Instructor-led approach to integrating an augmented reality sandbox into a large-enrollment introductory geoscience course for nonmajors produces no gains. J Geosci Educ 65:283–291. https://doi.org/10.5408/17-255.1
Hashim NC, Majid NAA, Arshad H, Obeidy WK (2018) User satisfaction for an augmented reality application to support productive vocabulary using speech recognition. Adv Multimed. https://doi.org/10.1155/2018/9753979
Hussain M, Zhu W, Zhang W et al (2019) Using machine learning to predict student difficulties from learning session data. Artif Intell Rev 52:381–407. https://doi.org/10.1007/s10462-018-9620-8
Ifenthaler D (2017) Are higher education institutions prepared for learning analytics? TechTrends 61:366–371. https://doi.org/10.1007/s11528-016-0154-0
Kew SN, Petsangsri S, Ratanaolarn T, Tasir Z (2018) Examining the motivation level of students in e-learning in higher education institution in Thailand: a case study. Educ Inf Technol 23:2947–2967. https://doi.org/10.1007/s10639-018-9753-z
Lange P, Neumann AT, Nicolaescu P, Klamma R (2018) An integrated learning analytics approach for virtual vocational training centers. Int J Interact Multimed Artif Intell 5:32. https://doi.org/10.9781/ijimai.2018.02.006
Martinez F, Barraza C, González N, González J (2016) KAPEAN: understanding affective states of children with ADHD. J Educ Technol Soc 19:18–28
Padilla-Zea N, Aceto S, Burgos D (2019) Social seducement: empowering social economy entrepreneurship. The training approach. Int J Interact Multimed Artif Intell 5:135. https://doi.org/10.9781/ijimai.2019.09.001
Papamitsiou Z, Economides A (2014) Learning analytics and educational data mining in practice: a systematic literature review of empirical evidence. Educ Technol Soc 17:49–64
Perakakis M, Potamianos A (2012) Affective evaluation of a mobile multimodal dialogue system using brain signals. In: 2012 IEEE spoken language technology workshop (SLT), pp 43–48
Ponticorvo M, Di Fuccio R, Di Ferdinando A, Miglino O (2017) An agent-based modelling approach to build up educational digital games for kindergarten and primary schools. Expert Syst 34:1–9. https://doi.org/10.1111/exsy.12196
Posada Trobo I, García Díaz V, Pascual Espada J et al (2019) Rapid modeling of human-defined AI behavior patterns in games. J Ambient Intell Humaniz Comput 10:2683–2692. https://doi.org/10.1007/s12652-018-0969-y
Ramirez R, Vamvakousis Z (2012) Detecting emotion from EEG signals using the Emotive Epoc device. Lect Notes Comput Sci 7670:175–184. https://doi.org/10.1007/978-3-642-35139-6_17
Restrepo Rodríguez AO, Casas Mateus DE, Gaona-García PA et al (2018) Hyperparameter optimization for image recognition over an AR-Sandbox based on convolutional neural networks applying a previous phase of segmentation by color-space. Symmetry (Basel). https://doi.org/10.3390/sym10120743
Rodríguez AOR, Riaño MA, Gaona-García PA et al (2019) Image classification methods applied in immersive environments for fine motor skills training in early education. Int J Interact Multimed Artif Intell 5:151. https://doi.org/10.9781/ijimai.2019.10.004
Saqr M, Fors U, Tedre M (2018) How the study of online collaborative learning can guide teachers and predict students’ performance in a medical course. BMC Med Educ 18:1–14. https://doi.org/10.1186/s12909-018-1126-1
scikit-learn developers (2017) scikit-learn. https://scikit-learn.org/stable/modules/clustering.html#dbscan
Sena P, D’Amore M, Brandimonte MA et al (2016) Experimental framework for simulators to study driver cognitive distraction: brake reaction time in different levels of arousal. Transp Res Proc 14:4410–4419. https://doi.org/10.1016/j.trpro.2016.05.363
Strmiska M, Koudelkova Z (2018) Analysis of performance metrics using emotiv EPOC +. MATEC Web Conf 210:4–7. https://doi.org/10.1051/matecconf/201821004046
Tarng W, Ou KL, Yu CS et al (2015) Development of a virtual butterfly ecological system based on augmented reality and mobile learning technologies. Virtual Real 19:253–266. https://doi.org/10.1007/s10055-015-0265-5
Vachiratamporn V, Moriyama K, Fukui K, Numao M (2014) An implementation of affective adaptation in survival horror games. In: 2014 IEEE conference on computational intelligence and games, pp 1–8
Virtanen P, Gommers R, Oliphant TE et al (2020) SciPy 1.0: fundamental algorithms for scientific computing in Python. Nat Methods. https://doi.org/10.1038/s41592-019-0686-2
Wang M, Callaghan V, Bernhardt J et al (2018) Augmented reality in education and training: pedagogical approaches and illustrative case studies. J Ambient Intell Humaniz Comput 9:1391–1402. https://doi.org/10.1007/s12652-017-0547-8
Woods TL, Reed S, Hsi S et al (2016) Pilot study using the augmented reality sandbox to teach topographic maps and surficial processes in introductory geology labs. J Geosci Educ 64:199–214. https://doi.org/10.5408/15-135.1
Zhu Y, Yang X, Jia Wang S (2017) Augmented reality meets tangibility: a new approach for early childhood education. EAI Endorsed Trans Creat Technol 4:153059. https://doi.org/10.4108/eai.5-9-2017.153059
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Rodríguez, A.O.R., Riaño, M.A., García, P.A.G. et al. Emotional characterization of children through a learning environment using learning analytics and AR-Sandbox. J Ambient Intell Human Comput 11, 5353–5367 (2020). https://doi.org/10.1007/s12652-020-01887-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-020-01887-2