Contactless Interaction System Based on Facial Expression Recognition for Humanoid Piano Robot | IEEE Conference Publication | IEEE Xplore

Contactless Interaction System Based on Facial Expression Recognition for Humanoid Piano Robot


Abstract:

With the wide application of service robots in people's daily life, people are not only satisfied with robots accomplishing tasks independently but also hope that robots ...Show More

Abstract:

With the wide application of service robots in people's daily life, people are not only satisfied with robots accomplishing tasks independently but also hope that robots can maintain sustainable interaction with human beings. Especially in the field of music, robots need to be equipped with intelligent cognitive skills in decision-making, so that the audience can enjoy immersive appreciation and emotional resonance in the robots performance. Visual perception and natural language understanding are essential for robots to establish human-robot friendly relationships. To enrich the interactive ability of music robots, we design a contactless interaction system based on facial expression recognition, which consists of four modules: voice wake-up, face detection, facial expression recognition, and music mapping. When people wake up the music robot with specific words, the robot will customize appropriate music to perform according to the recognition results of the FER module. As a final step, the interaction system has been successfully applied to the piano humanoid robot independently developed by our team.
Date of Conference: 05-09 December 2022
Date Added to IEEE Xplore: 18 January 2023
ISBN Information:
Conference Location: Jinghong, China

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.