Abstract
The article describes the use of a fuzzy classifier as a mechanism for combining the values calculated from three metrics to obtain a quantitative assessment of the intelligibility of the syllable pronunciation. The resulting assessment is used to assess speech in speech rehabilitation after the treatment of the oral cavity and oropharynx oncology. The evaluation is based on the calculation of the distance as the similarity degree between the syllable pronunciation in the estimated recording (the patient’s speech in the process of rehabilitation) and the syllable pronunciation in the reference recording (the patient’s speech before surgery). It is proposed to use a fuzzy classifier with the genetic optimization algorithm NSGA II. The training datasets are quantitative and expert estimates of a set of syllable pronunciation recordings provided by the Cancer Research Institute Tomsk NRMC. Three datasets were used: 1020 recordings for each of the problematic phonemes [k], [s], [t]. Separate fuzzy classifiers were trained for each of the datasets. Classification accuracies are shown on the initial datasets and rebalanced datasets. The NeighborhoodCleaningRule and SMOTEENN algorithms were used for rebalancing the data. It was concluded that it is possible to use a fuzzy classifier as a combination mechanism to obtain the intelligibility assessment of the syllable pronunciation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Kaprin, A.D., Starinskiy, V.V., Shahzadova, A.O.: Malignancies in Russia in 2020 (morbidity and mortality), 252 p. MNIOI name of P.A. Herzen, Moscow (2021)
Kaprin, A.D., Starinskiy, V.V., Shahzadova, A.O.: The state of oncological care for the population of Russia in 2020, 239 p. MNIOI name of P.A. Herzen, Moscow (2021)
Standard GOST R 50840-95 voice over paths of communication. Methods for assessing the quality, legibility and recognition, 234 p. Publishing Standards, Moscow (1995)
Salvador, S.: FastDTW: toward accurate dynamic time warping in linear time and space. In: Salvador, S., Chan, P. (eds.) Workshop on Mining Temporal and Sequential Data, Seattle, pp. 70–80 (2004)
Kostyuchenko, E., Meshcheryakov, R., Ignatieva, D., Pyatkov, A., Choynzonov, E., Balatskaya, L.: Correlation criterion in assessment of speech quality in process of oncological patients rehabilitation after surgical treatment of the speech-producing tract. In: Bhatia, S.K., Tiwari, S., Mishra, K.K., Trivedi, M.C. (eds.) Advances in Computer Communication and Computational Sciences. AISC, vol. 759, pp. 209–216. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-0341-8_19
Kostyuchenko, E., Roman, M., Ignatieva, D., Pyatkov, A., Choynzonov, E., Balatskaya, L.: Evaluation of the speech quality during rehabilitation after surgical treatment of the cancer of oral cavity and oropharynx based on a comparison of the Fourier spectra. In: Ronzhin, A., Potapova, R., Németh, G. (eds.) SPECOM 2016. LNCS (LNAI), vol. 9811, pp. 287–295. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-43958-7_34
Novokhrestova, D., Kostuchenko, E., Hodashinsky, I., Balatskaya, L.: Experimental analysis of expert and quantitative estimates of syllable recordings in the process of speech rehabilitation. In: Karpov, A., Potapova, R. (eds.) SPECOM 2021. LNCS (LNAI), vol. 12997, pp. 483–491. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-87802-3_44
Sarin, K.S., Hodashinsky, I.A.: Bagged ensemble of fuzzy classifiers and feature selection for handwritten signature verification. Comput. Opt. 43(5), 833–845 (2019)
Lavygina, A., Hodashinsky, I.: Hybrid algorithm for fuzzy model parameter estimation based on genetic algorithm and derivative based methods. In: ECTA 2011 and FCTA 2011 - Proceedings of the International Conference on Evolutionary Computation Theory and Applications and International Conference on Fuzzy Computation Theory and Applications, pp. 513–515 (2011)
Georgieva, P.: Genetic fuzzy system for financial management. Cybern. Inf. Technol. 18(2), 20–35 (2018)
Omozaki, Y., Masuyama, N., Nojima, Y., Ishibuchi, H.: Multiobjective fuzzy genetics-based machine learning for multi-label classification. In: 2020 IEEE International Conference on Fuzzy Systems, pp. 1–8 (2020)
Nishihara, A., Masuyama, N., Nojima, Y., Ishibuchi, H.: Michigan-style fuzzy genetics-based machine learning for class imbalance data. J. Jpn. Soc. Fuzzy Theory Intell. Inform. 33(1), 525–530 (2021)
Deb, K., Agrawal, S., Pratap, A., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput. 6(2), 182–197 (2002)
Lemnaru, C., Potolea, R.: Imbalanced classification problems: systematic study, issues and best practices. In: Zhang, R., Zhang, J., Zhang, Z., Filipe, J., Cordeiro, J. (eds.) ICEIS 2011. LNBIP, vol. 102, pp. 35–50. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-29958-2_3
Imbalanced-learn documentation, 10 April 2022. https://imbalanced-learn.org/stable/introduction.html
Irkutsk Supercomputer Center SB RAS. http://hpc.icc.ru/en/. Accessed 16 Jan 2021
Acknowledgments
This research was funded by the Ministry of Science and Higher Education of the Russian Federation within the framework of scientific projects carried out by teams of research laboratories of educational institutions of higher education subordinate to the Ministry of Science and Higher Education of the Russian Federation, project number FEWM-2020-0042.
The authors would like to thank the Irkutsk Supercomputer Center of SB RAS for providing access to the HPC-cluster «Akademik V.M. Matrosov» [16].
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Novokhrestova, D., Hodashinsky, I., Kostyuchenko, E., Sarin, K., Bardamova, M. (2022). Fuzzy Classifier for Speech Assessment in Speech Rehabilitation. In: Prasanna, S.R.M., Karpov, A., Samudravijaya, K., Agrawal, S.S. (eds) Speech and Computer. SPECOM 2022. Lecture Notes in Computer Science(), vol 13721. Springer, Cham. https://doi.org/10.1007/978-3-031-20980-2_44
Download citation
DOI: https://doi.org/10.1007/978-3-031-20980-2_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-20979-6
Online ISBN: 978-3-031-20980-2
eBook Packages: Computer ScienceComputer Science (R0)