Yuyuan Shi
Marie-Luce Bourguet
ABSTRACT
This paper describes our ongoing work to develop a visual sensing platform that can inform a robot teacher about the behaviour and affective state of its student audience. We have developed a multi-student behaviour recognition system, which can detect behaviours such as "listening" to the lecturer, "raising hand", or "sleeping". We have also developed a multi-student affect recognition system which, starting from eight basic emotions detected from facial expressions, can infer higher emotional states relevant to a learning context, such as "interested", "distracted" and "confused". Both systems are being tested with the Softbank robot Pepper that can respond to various students' behaviours and emotional states with adapted movements, postures and speech.
- M.I. Ahmad, O. Mubin, J. Orlando, Understanding behaviours and roles for social and adaptive robots in education: teacher's perspective. Proc. of the 4th international conference on human agent interaction, Singapore, October, pp 297--304, 2016.Google Scholar
- T. Belpaeme, J. Kennedy, A. Ramachandran, B. Scassellati, F. Tanaka, Social robots for education: A review. Science Robotics, 15 Aug 2018: Vol. 3, Issue 21 (2018).Google ScholarCross Ref
- E.G. Blanchard, B. Volfson, Y.J. Hong, S.P. Lajoie, Affective artificial intelligence in education: From detection to adaptation. Artificial Intelligence in Education. V. Dimitrova et al. (Eds.) IOS Press (2009).Google Scholar
- Z. Cao, G. Hidalgo, T. Simon, S. Wei, Y, Sheikh, OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. https://arxiv.org/abs/1812.08008 Retrieved June 11, 2019.Google Scholar
- P. Ekman, K.G. Heider, (1988). The universality of a contempt expression: A replication. Motivation and Emotion, 2, 303--308.Google ScholarCross Ref
- E.S. Lane, S.E. Harris, (2015). A New Tool for Measuring Student Behavioral Engagement in Large University Classes (Vol. 44).Google Scholar
- Microsoft Face API - https://azure.microsoft.com/en-us/services/cognitive-services/face/ Retrieved June 11, 2019.Google Scholar
- O. Mubin, C. J. Stevens, S. Shahid, A. Al Mahmud, J.-J. Dong, A review of the applicability of robots in education. J. Technol. Educ. Learning 1, 1--7 (2013).Google Scholar
- T. Pachidis, E. Vrochidou, V. G. Kaburlasos, S. Kostova, M. Bonkovic, V. Papic, Social Robotics in Education: State-of-the-Art and Directions. In Proc. of the 27th International Conference on Robotics in Alpe-Adria Danube Region (2018).Google Scholar
- J. Redmon, A.Farhadi, (2018). YOLOv3: An Incremental Improvement. https://arxiv.org/abs/1804.02767. Retrieved June 11, 2019.Google Scholar
- A. J. C. Sharkey, Should we welcome robot teachers? Ethics Inf Technol (2016) 18:283--297.Google Scholar
- SoftBank Robotics. https://www.softbankrobotics.com/emea/en Retrieved June 11, 2019.Google Scholar
Index Terms
- A Visual Sensing Platform for Robot Teachers
Recommendations
A fast identity-independent expression recognition system for robust cartoonification using smart devices
ICVGIP '16: Proceedings of the Tenth Indian Conference on Computer Vision, Graphics and Image ProcessingFacial expressions convey rich information about emotions, intentions and other internal states of a person. Automatic facial expression and cartoonification systems are aiming towards the application of computer vision systems in human computer ...
Drone in Love: Emotional Perception of Facial Expressions on Flying Robots
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsDrones are rapidly populating human spaces, yet little is known about how these flying robots are perceived and understood by humans. Recent works suggested that their acceptance is predicated upon their sociability. This paper explores the use of ...
The effects of a robot instructor's positive vs. negative feedbacks on attraction and acceptance towards the robot in classroom
ICSR'11: Proceedings of the Third international conference on Social RoboticsAs robots are now being widely used as educational aids and assistants, it is crucial to understand the effects of robotic teaching assistants in classroom and how attraction and acceptance towards the robot are shaped. A 2 (type of instructor: human ...
Comments