Deep Learning based Smart American Sign Language Detection in Alphabets | IEEE Conference Publication | IEEE Xplore

Deep Learning based Smart American Sign Language Detection in Alphabets


Abstract:

Disabled people are of different kinds like physically challenged people, mentally challenged etc. To help the people who cannot convey their thoughts and who cannot hear...Show More

Abstract:

Disabled people are of different kinds like physically challenged people, mentally challenged etc. To help the people who cannot convey their thoughts and who cannot hear others thoughts, sign language is being used to communicate with them. Sign language is something that is used to communicate through body movements mainly through hands and arms.American Sign Language(ASL) is an authorized sign language that is taught and used widely. ASL is difficult to teach and learn for them because it is completely new and they have no knowledge about it. In this research paper the ASL is recognized and converted into text through data mining techniques. The study uses a dataset of ASL alphabet images and applies various data mining techniques, including feature selection, classification, and clustering. The features extracted from the images include shape, size, color, and texture. The use of neural networks, decision trees, and support vector machines speeds up the data categorization process. Techniques such as k-means clustering and hierarchical grouping are used to facilitate entity grouping. The results show that the best performance is achieved using a combination of feature selection and classification techniques. The decision tree algorithm with the selected features achieves an accuracy of 96.5% on the test dataset. The system can accurately recognize all the ASL alphabets and convert them into text or speech. The system developed can be used to improve communication between deaf and hearing individuals and can be extended to recognize other ASL gestures and phrases. Future research can focus on real-time detection and recognition of ASL gestures using data mining techniques. CNN algorithm is used to recognize the image based on the images collected. The accuracy rate gets low and the detection is inaccurate. Therefore, VGG16 algorithm is used to recognize the images and it is unique in convolutional models.
Date of Conference: 14-16 September 2023
Date Added to IEEE Xplore: 26 January 2024
ISBN Information:
Conference Location: Gautam Buddha Nagar, India

References

References is not available for this document.