Abstract
Previously, a number of research is going on in Artificial Intelligence and robotics to make the humans life easier and efficient. Taking motivation form the research works, this paper presents an Artificial intelligence (AI) based smart robot for physically challenged peoples. The model consists of a 4 wheeler car containing a camera and a robotic claw attached to and is operated by Bengali voice commands from the user. At first, the robot will detect the user and parse the voice command to understand its meaning. After that, it will search for the object and then, it will go towards the object to pick it up and finally it will bring the object back to the user. For instance, if for any reason, the object falls from the robotic claw while carrying it towards its destination, this robot has the intelligence to pick it up again and continue its journey to its designated location. For detecting the object, we have used TensorFlow object detection API, and for parsing the voice commands, natural language processing has been used. Additionally, for face detection, we have used Facenet which is a real-time face recognition model based on deep learning consisting of convolutional neural layers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Disability in Bangladesh: Centre for Disability in Development. Accessed 20 Apr 2016
Singh, S.: Only 40 per cent of India’s disabled have access to disability certificates, 07 April 2016. http://www.thehindu.com
Bhattacharjee, A., et al.: Bangla voice-controlled robot for rescue operation in noisy environment. In: 2016 IEEE Region 10 Conference (TENCON), Singapore, pp. 3284–3288 (2016)
Mital, D.P.: A voice activated robot with artificial intelligence. Robot. Auton. Syst. 4(4), 339–344 (1989)
Borse, H.: Mobile robot for object detection using image processing. Glob. J. Comput. Sci. Technol. Neural Artif. Intell. 12(11) (2012)
Mazo, M., RodrÃguez, F.J., Lázaro, J.L. et al.: Auton Robot, vol. 2, no. 203 (1995)
Shabana Tadvi, E.R., Adarkar, P., Yadav, A., Saboo Siddik, M.H.: Automated wheelchair using Android technology. Imperial J. Interdisc. Res. 2(4), 654–657 (2016)
Raspberrypi.org (2019). https://www.raspberrypi.org/products/raspberry-pi-3-model-b/
Kaymu.com.np. Arduino Uno R3 (2015). http://www.kaymu.com.np/arduino-uno-r3-53519.html
Circuitdigest.com. Servo Motor Basics, Working Principle & Theory (2019). https://circuitdigest.com/article/servo-motor-basics
Daware, K.: How a DC motor works?. Electricaleasy.com (2019). https://www.electricaleasy.com/2014/01/basic-working-of-dc-motor.html
TensorFlow (2019). https://www.tensorflow.org/Instructables. 5 October 2017. How to Use the L298 Motor Driver Module-Arduino Tutorial. Accessed 1 Dec 2019. https://www.instructables.com/id/How-to-use-the-L298-Motor-Driver-Module-Arduino-Tu/
McGinn, C., Torre, I.: Can you tell the robot by the voice? An exploratory study on the role of voice in the perception of robots. In: 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Daegu, Korea (South), pp. 211–221 (2019)
Mureșan, H., Mihai, O.: Fruit recognition from images using deep learning. Acta Universitatis Sapientiae, Informatica. 10, 26–42 (2018)
Shafiqul Islam, Md., Mahmud, A., Akter Papeya, A., Sultana Onny, I., Uddin, J.: A combined feature extraction method for automated face recognition in classroom environment. In: Thampi, S.M., Krishnan, S., Corchado Rodriguez, J.M., Das, S., Wozniak, M., Al-Jumeily, D. (eds.) SIRS 2017. AISC, vol. 678, pp. 417–426. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-67934-1_38
Zarin, A., Uddin, J.: A hybrid fake banknote detection model using OCR, face recognition and hough features. In: 2019 Cybersecurity and Cyberforensics Conference (CCC), Melbourne, Australia, pp. 91–95 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Bhuiyan, A.B., Ahmed, A., Tulon, S.R., Khan, M.R.H., Uddin, J. (2021). A Bengali Voice-Controlled AI Robot for the Physically Challenged. In: Singh, M., Kang, DK., Lee, JH., Tiwary, U.S., Singh, D., Chung, WY. (eds) Intelligent Human Computer Interaction. IHCI 2020. Lecture Notes in Computer Science(), vol 12615. Springer, Cham. https://doi.org/10.1007/978-3-030-68449-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-030-68449-5_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68448-8
Online ISBN: 978-3-030-68449-5
eBook Packages: Computer ScienceComputer Science (R0)