Abstract
Advances in AI and Visual Recognition have paved the pathway for cutting edge research in Gesture Recognition. While automated feedback is able to open doors for newer opportunities in gesture based learning and practice, the effectiveness of these feedback as compared to manual feedback remains as a question in the minds of the users. For learners of American Sign Language (ASL), automated feedback generated by an application often causes a sense of apprehension because: a) learners are unaware of the automated feedback generation process, and b) learners fear that they can not trust the automated feedback as it may not be as good as the manual feedback. We use an ASL learning application that provides fine grained explainable feedback and follow a two step process to present a comparison between the automated feedback and the manual feedback provided by experts.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alwardat, M., et al.: Effectiveness of robot-assisted gait training on motor impairments in people with Parkinson’s disease: a systematic review and meta-analysis. Int. J. Rehabil. Res. 41, 1 (2018). https://doi.org/10.1097/MRR.0000000000000312
Banerjee, A., Lamrani, I., Hossain, S., Paudyal, P., Gupta, S.K.S.: AI enabled tutor for accessible training. In: Bittencourt, I.I., Cukurova, M., Muldner, K., Luckin, R., Millán, E. (eds.) AIED 2020. LNCS (LNAI), vol. 12163, pp. 29–42. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-52237-7_3
Banerjee, A., Lamrani, I., Paudyal, P., Gupta, S.: Generation of movement explanations for testing gesture based co-operative learning applications. In: 2019 IEEE International Conference On Artificial Intelligence Testing (AITest), pp. 9–16. IEEE (2019)
Davis, F.D., Bagozzi, R.P., Warshaw, P.R.: User acceptance of computer technology: a comparison of two theoretical models. Manage. Sci. 35(8), 982–1003 (1989)
Ellis, K., Fisher, J., Willoughby, L., Barca, J.: A design science exploration of a visual-spatial learning system with feedback (2016)
Hossain, S., Banerjee, A., Gupta, S.K.S.: Personalized technical learning assistance for deaf and hard of hearing students. In: Workshop on Artificial Intelligence for Education, AAAI 2020. New York, USA (2020)
Huenerfauth, M., Gale, E., Penly, B., Pillutla, S., Willard, M., Hariharan, D.: Evaluation of language feedback methods for student videos of American sign language. ACM Trans. Access. Comput. 10(1) (2017). https://doi.org/10.1145/3046788
Irons, A.: Enhancing Learning Through Formative Assessment and Feedback. Routledge (2007)
Jiang, Q., Liu, M., Wang, X., Ge, M., Lin, L.: Human motion segmentation and recognition using machine vision for mechanical assembly operation. Springerplus 5(1), 1–18 (2016). https://doi.org/10.1186/s40064-016-3279-x
Kamzin, A., Amperyani, A., Sukhapalli, P., Banerjee, A., Gupta, S.: Concept embedding through canonical forms: a case study on zero-shot asl recognition. In: ICPR 2020, p. 8 (2021)
Kamzin, A., Paudyal, P., Banerjee, A., Gupta, S.K.: Evaluating the gap between hype and performance of AI systems (2020)
Matsumura, S., Hann, G.: Computer anxiety and students’ preferred feedback methods in EFL writing. Mod. Lang. J. 88(3), 403–415 (2004)
McFarland, T.: Military robots: mapping the moral landscape [book reviews]. IEEE Technol. Soc. Mag. 35(2), 23–25 (2016)
Min, H., Morales, D., Orgill, D., Smink, D., Yule, S.: Systematic review of coaching to enhance surgeons’ operative performance. Surgery 158 (2015). https://doi.org/10.1016/j.surg.2015.03.007
MotionSavvy (2016). http://www.motionsavvy.com/. Accessed 15 Nov 2016
Papandreou, G., et al.: Towards accurate multi-person pose estimation in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4903–4911 (2017)
Paudyal, P., Banerjee, A., Gupta, S.: On evaluating the effects of feedback for sign language learning using explainable AI. In: Proceedings of the 25th International Conference on Intelligent User Interfaces Companion, pp. 83–84. IUI 2020, Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3379336.3381469
Paudyal, P., Lee, J., Kamzin, A., Soudki, M., Banerjee, A., Gupta, S.: Learn2sign: explainable AI for sign language learning. In: CEUR Workshop Proceedings, vol. 2327. CEUR-WS (2019)
Perretta, J., Weimer, W., DeOrio, A.: Human vs. automated coding style grading in computing education. In: 2019 ASEE Annual Conference and Exposition (2019)
Phan, H.D., Ellis, K., Dorin, A., Olivier, P.: Feedback strategies for embodied agents to enhance sign language vocabulary learning. In: IVA 2020. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3383652.3423871
Riley, M., Ude, A., Atkeson, C., Cheng, G.: Coaching: an approach to efficiently and intuitively create humanoid robot behaviors. In: 2006 6th IEEE-RAS International Conference on Humanoid Robots, pp. 567–574 (2006)
Salichs, M.A., Encinar, I.P., Salichs, E., Castro-González, Á., Malfaz, M.: Study of scenarios and technical requirements of a social assistive robot for Alzheimer’s disease patients and their caregivers. Int. J. Soc. Robot. 8(1), 85–102 (2015). https://doi.org/10.1007/s12369-015-0319-6
Santamaría Lancho, M., Hernández, M., Sánchez-Elvira Paniagua, Á., Luzón Encabo, J.M., de Jorge-Botana, G.: Using semantic technologies for formative assessment and scoring in large courses and MOOCs. J. Interactive Media Educ. 2018(1) (2018)
Sharkey, N.E.: The evitability of autonomous robot warfare. Int. Rev. Red Cross 94(886), 787–799 (2012). https://doi.org/10.1017/S1816383112000732
Stokoe Jr., W.C.: Sign language structure: an outline of the visual communication systems of the American deaf. J. Deaf Stud. Deaf Educ. 10(1), 3–37 (2005)
Zhang, Z.V., Hyland, K.: Student engagement with teacher and automated feedback on l2 writing. Assess. Writ. 36, 90–102 (2018)
Zhu, M., Liu, O.L., Lee, H.S.: The effect of automated feedback on revision behavior and learning gains in formative assessment of scientific argument writing. Comput. Educ. 143, 103668 (2020)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Hossain, S., Kamzin, A., Amperayani, V.N.S.A., Paudyal, P., Banerjee, A., Gupta, S.K.S. (2021). Engendering Trust in Automated Feedback: A Two Step Comparison of Feedbacks in Gesture Based Learning. In: Roll, I., McNamara, D., Sosnovsky, S., Luckin, R., Dimitrova, V. (eds) Artificial Intelligence in Education. AIED 2021. Lecture Notes in Computer Science(), vol 12748. Springer, Cham. https://doi.org/10.1007/978-3-030-78292-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-78292-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78291-7
Online ISBN: 978-3-030-78292-4
eBook Packages: Computer ScienceComputer Science (R0)