Abstract
This paper investigates the problem of predicting student flight performance in a training simulation from multimodal features, including flight controls, visual attention, and knowledge acquisition tests. This is a key component of developing next generation training simulations that can optimize the usage of student training time. Two types of supervised machine learning classifiers (random forest and support vector machines) were trained to predict the performance of twenty-three students performing simple flight tasks in virtual reality. Our experiments reveal the following: 1) features derived from gaze tracking and knowledge acquisition tests can serve as an adequate substitute for flight control features; 2) data from the initial portion of the flight task is sufficient to predict the final outcome; 3) our classifiers perform slightly better at predicting student failure than success. These results indicate the feasibility of using machine learning for early prediction of student failures during flight training.
Research supported by Lockheed Martin Co.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chawla, N.V., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16(1), 321–357 (2002)
Conijn, R., Snijders, C., Kleingeld, A., Matzat, U.: Predicting student performance from LMS data: a comparison of 17 blended courses using Moodle LMS. IEEE Trans. Learn. Technol. 10(1), 17–29 (2017)
Dehais, F., Behrend, J., Peysakhovich, V., Causse, M., Wickens, C.D.: Pilot flying and pilot monitoring’s aircraft state awareness during go-around execution in aviation: a behavioral and eye tracking study. Int. J. Aerosp. Psychol. 27(1–2), 15–28 (2017)
Krejtz, K., et al.: Gaze transition entropy. ACM Trans. Appl. Percept. 13(1), 1–20 (2015)
Millsa, C., Bixlera, R., Wang, X., D’Mello, S.K.: Automatic gaze-based detection of mind wandering during narrative film comprehension. In: International Conference on Multimodal Interaction (2015)
Peysakhovich, V., Lefrançois, O., Dehais, F., Causse, M.: The neuroergonomics of aircraft cockpits: the four stages of eye-tracking integration to enhance flight safety. Safety 4, 8 (2018)
Susac, A., Bubic, A., Kaponja, J., Planinic, M., Palmovic, M.: Eye movements reveal students’ strategies in simple equation solving. Int. J. Sci. Math. Educ. 12(3), 555–577 (2014)
Thai-Nghe, N., Drumond, L., Krohn-Grimberghe, A., Schmidt-Thieme, L.: Recommender system for predicting student performance. Procedia Comput. Sci. 1(2), 2811–2819 (2010). Proceedings of the Workshop on Recommender Systems for Technology Enhanced Learning (RecSysTEL 2010)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Xi, Z., Newton, O., McGowin, G., Sukthankar, G., Fiore, S., Oden, K. (2020). Predicting Student Flight Performance with Multimodal Features. In: Thomson, R., Bisgin, H., Dancy, C., Hyder, A., Hussain, M. (eds) Social, Cultural, and Behavioral Modeling. SBP-BRiMS 2020. Lecture Notes in Computer Science(), vol 12268. Springer, Cham. https://doi.org/10.1007/978-3-030-61255-9_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-61255-9_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-61254-2
Online ISBN: 978-3-030-61255-9
eBook Packages: Computer ScienceComputer Science (R0)