skip to main content
10.1145/3313950.3313970acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicigpConference Proceedingsconference-collections
research-article

Speech recognition and Filipino sign language E-tutor system: an assistive multimodal learning approach

Published:23 February 2019Publication History

ABSTRACT

Speech recognition technology facilitates student learning. It has potential benefits for students with physical disabilities and the technology has been implemented in the classroom over the years in order to learn in a more efficient way. This study provides deaf students with various methods of studying, learning, and remembering new information. Aside from speech-to-text, the developed system is also provided with speech-to-visual approach, which represents information associated with objects. Also, Filipino Sign Language was used utilize as an alternative way of presenting Statistics lessons included in K-12 curriculum. Practical real world approach in presenting Statistics lessons are used to enhance delivery in face to face class se-up or in self-phasing learning. These multiple learning strategies were combined together to have a balance approach for a greater practice and recall will be more successful, especially for the target users. From the initial results, this research showed a significant advantage of using speech recognition and Filipino Sign Language in learning basic Statistics lessons compared from the traditional method.

References

  1. Waris, A. and Aggarwal, R.K. 2018. Acoustic modeling in Automatic Speech Recognition-A Survey. In 2018 IEEE Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), pp. 1408--1412.Google ScholarGoogle Scholar
  2. Reis, A., Paulino, D., Paredes, H., Barroso, I., Monteiro, M.J., Rodrigues, V. and Barroso, J. 2018. Using intelligent personal assistants to assist the elderlies: An evaluation of Amazon Alexa, Google Assistant, Microsoft Cortana, and Apple Siri. In 2018 IEEE 2nd International Conference on Technology and Innovation in Sports, Health and Wellbeing (TISHW), pp. 1--5.Google ScholarGoogle Scholar
  3. Nittrouer, S., Krieg, L.M. and Lowenstein, J.H. 2018. Speech Recognition in Noise by Children with and without Dyslexia: How is it Related to Reading? Research in developmental disabilities, 77, pp.98--113.Google ScholarGoogle Scholar
  4. Sze, G., Bluth, E.I., Bender, C.E. and Parikh, J.R. 2017. Work-related injuries of radiologists and possible ergonomic solutions: recommendations from the ACR Commission on Human Resources, Journal of the American College of Radiology, 14(10), pp.1353--1358.Google ScholarGoogle ScholarCross RefCross Ref
  5. León, M.A., Romero, P.A., Quevedo, W.X., Arteaga, O.B., Terán, C., Benalcázar, M.E. and Andaluz, V.H. 2018. Virtual Rehabilitation System for Fine Motor Skills Using a Functional Hand Orthosis. In International Conference on Augmented Reality, Virtual Reality and Computer Graphics, pp. 78--94, Springer, Cham.Google ScholarGoogle Scholar
  6. Johnstone, P.M., Mills, K.E., Humphrey, E., Yeager, K.R., Jones, E., McElligott, K., Pierce, A., Agrawal, S., Froeling, C. and Little, J.P. 2018. Using Microphone Technology to Improve Speech Perception in Noise in Children with Cochlear Implants. Journal of the American Academy of Audiology.Google ScholarGoogle ScholarCross RefCross Ref
  7. Guarnaccia, M.C., D'Adamo, C., Artioli, F.L. and Genovese, E. 2018. Effects of speech recognition in noise in children with cochlear implantation or hearing aids, that use FM or wireless system. Journal of Hearing Science, 8(2).Google ScholarGoogle Scholar
  8. Henner, J., Novogrodsky, R., Caldwell-Harris, C. and Hoffmeister, R. 2018. The Development of American Sign Language-Based Analogical Reasoning in Signing Deaf Children. Journal of Speech, Language, and Hearing Research, pp.1--13., p.60.Google ScholarGoogle Scholar
  9. Scott, J.A. and Hoffmeister, R.J. 2016. American Sign Language and academic English: Factors influencing the reading of bilingual secondary school deaf and hard of hearing students. The Journal of Deaf Studies and Deaf Education, pp.1--13.Google ScholarGoogle Scholar
  10. Ong, C., Lim, I., Lu, J., Ng, C. and Ong, T. 2018. Sign-Language Recognition Through Gesture & Movement Analysis (SIGMA). In Mechatronics and Machine Vision in Practice 3 (pp. 235--245). Springer, Cham.Google ScholarGoogle Scholar
  11. Mellon, N.K., Niparko, J.K., Rathmann, C., Mathur, G., Humphries, T., Napoli, D.J., Handley, T., Scambler, S. and Lantos, J.D. 2015. Should all deaf children learn sign language? Pediatrics, pp.peds-2014.Google ScholarGoogle Scholar
  12. Agrawal, S.C., Jalal, A.S. and Tripathi, R.K. 2016. A survey on manual and non-manual sign language recognition for isolated and continuous sign. International Journal of Applied Pattern Recognition, 3(2), pp.99--134.Google ScholarGoogle ScholarCross RefCross Ref
  13. Holsapple, C., Lee-Post, A. and Pakath, R. 2014. A unified foundation for business analytics. Decision Support Systems, 64, pp.130--141. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Appelbaum, D., Kogan, A., Vasarhelyi, M. and Yan, Z. 2017. Impact of business analytics and enterprise systems on managerial accounting. International Journal of Accounting Information Systems, 25, pp.29--44.Google ScholarGoogle ScholarCross RefCross Ref
  15. Peterson, D.J. 2016. The flipped classroom improves student achievement and course satisfaction in a statistics course: A quasi-experimental study. Teaching of Psychology, 43(1), pp.10--15.Google ScholarGoogle ScholarCross RefCross Ref
  16. Calonico, S., Cattaneo, M.D., Farrell, M.H. and Titiunik, R., 2017. rdrobust: Software for regression discontinuity designs. Stata Journal, 17(2), pp.372--404.Google ScholarGoogle ScholarCross RefCross Ref
  17. Lipka, O. and Hess, I. 2016. Attitudes Toward Statistics Studies Among Students with Learning Disabilities. Numeracy, 9(2), p.7.Google ScholarGoogle ScholarCross RefCross Ref
  18. González, A., Rodríguez, Y., Faílde, J.M. and Carrera, M.V., 2016. Anxiety in the statistics class: Structural relations with self-concept, intrinsic value, and engagement in two samples of undergraduates. Learning and Individual Differences, 45, pp.214--221.Google ScholarGoogle ScholarCross RefCross Ref
  19. Abrami, P.C., Bernard, R.M., Borokhovski, E., Waddington, D.I., Wade, C.A. and Persson, T. 2015. Strategies for teaching students to think critically: A meta-analysis. Review of Educational Research, 85(2), pp.275--314.Google ScholarGoogle ScholarCross RefCross Ref
  20. Chew, K.H.P. and Dillon, D.B. 2014. Statistics anxiety and the Big Five personality factors. Procedia-Social and Behavioral Sciences, 112, pp.1177--1186.Google ScholarGoogle ScholarCross RefCross Ref
  21. Abad, P.J.B., Tan, M.L., Baluyot, M.M.P., Villa, A.Q., Talapian, G.L., Reyes, M.E., Suarez, R.C., Sur, A.L.D., Aldemita, V.D.R., Padilla, C.D. and Laurino, M.Y. 2014. Cultural beliefs on disease causation in the Philippines: challenge and implications in genetic counseling. Journal of community genetics, 5(4), pp.399--407.Google ScholarGoogle ScholarCross RefCross Ref
  22. Cruz, F.W.S.D. and Calimpusan, E.C. 2018. Status and Challenges of the Deaf in One City in the Philippines: Towards the Development of Support Systems and Socio-Economic Opportunities. Asia Pacific Journal of Multidisciplinary Research, 6(2).Google ScholarGoogle Scholar

Index Terms

  1. Speech recognition and Filipino sign language E-tutor system: an assistive multimodal learning approach

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      ICIGP '19: Proceedings of the 2nd International Conference on Image and Graphics Processing
      February 2019
      151 pages
      ISBN:9781450360920
      DOI:10.1145/3313950

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 23 February 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
    • Article Metrics

      • Downloads (Last 12 months)24
      • Downloads (Last 6 weeks)5

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader