Abstract
Over time, the interaction between humans and machines has become increasingly important for both personal and commercial use. As technology continues to permeate various aspects of our lives, it is essential to seek healthy progress and not only improve, but also maintain the benefits that technology brings. While this relationship can be approached from many angles, this discussion focuses on emotions. Emotions remain a complex and enigmatic concept that remains a mystery to scientists. As such, it is crucial to pave the right way for the development of technology that can help understand emotions. Some indicators, such as word use, facial expressions and voice, provide important information about mental states. This work focuses on voice and proposes a comprehensive process for automatic emotion recognition by speech. The pipeline includes sound capture and signal processing software, algorithms for learning and classification within the Semi-Supervised Learning paradigm and visualisation techniques to interpret the results. For classifying the samples, a semi-supervised approach using Neural Networks is adopted to reduce the reliance on human emotion labelling, which is often subjective, difficult and costly. Empirical results carry more weight than theoretical concepts, given the complexity and uncertainty inherent in human emotions, but prior knowledge in this domain is not ignored.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andrade, G., Rodrigues, M., Novais, P.: A survey on the semi supervised learning paradigm in the context of speech emotion recognition. In: Arai, K. (ed.) IntelliSys 2021. Lecture Notes in Networks and Systems, vol. 295, pp. 771–792. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-82196-8_57
Alom, M.Z., et al.: A state-of-the-art survey on deep learning theory and architectures. Electronics 8, 292 (2019)
Gonçalves, S., Rodrigues, M., Carneiro, D., Fdez-Riverola, F., Novais, P.: Boosting learning: non-intrusive monitoring of student’s efficiency. In: Mascio, T.D., Gennari, R., Vittorini, P., De la Prieta, F. (eds.) Methodologies and Intelligent Systems for Technology Enhanced Learning. AISC, vol. 374, pp. 73–80. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19632-9_10
Goodfellow, I.J., Shlens, J., Szegedy, C.: Explaining and harnessing adversarial examples (2015)
IEMOCAP. https://sail.usc.edu/iemocap/
Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift (2015)
Izmailov, P., Podoprikhin, D., Garipov, T., Vetrov, D., Wilson, A.G.: Averaging weights leads to wider optima and better generalization (2019)
Jalal, A., Milner, R., Hain, T.: Empirical interpretation of speech emotion perception with attention based model for speech emotion recognition (2020)
Khorrami, P., Le Paine, T., Brady, K., Dagli, C., Huang, T.S.: How deep neural networks can improve emotion recognition on video data. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 619–623 (2016)
Li, Y., Kaiser, L., Bengio, S., Si, S.: Area attention (2020)
Lin, M., Chen, Q., Yan, S.: Network in network (2014)
Lin, W.-C., Busso, C.: Chunk-level speech emotion recognition: A general framework of sequence-to-one dynamic temporal modelling. IEEE Trans. Affect. Comput. 1 (2021)
Lucic, M., Kurach, K., Michalski, M., Gelly, S., Bousquet, O.: Are gans created equal? a large-scale study (2018)
Miyato, T., Maeda, S., Koyama, M., Ishii, S.: Virtual adversarial training: a regularization method for supervised and semi-supervised learning (2018)
Parthasarathy, S., Busso, C.: Semi-supervised speech emotion recognition with ladder networks (2019)
Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks (2016)
Rodrigues, M., Fdez-Riverola, F., Novais, P.: An approach to assessing stress in e-learning students (2012)
Rodrigues, M., Monteiro, V., Fernandes, B., Silva, F., Analide, C., Santos, R.: A gamification framework for getting residents closer to public institutions. J. Ambient Intell. Human. Comput. 11 (2020)
Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., Chen, X.: Improved techniques for training GANs (2016)
Salimans, T., Kingma, D. P.: Weight normalization: a simple reparameterization to accelerate training of deep neural networks (2016)
Tompson, J., Goroshin, R., Jain, A., LeCun, Y., Bregler, C.: Efficient object localization using convolutional networks (2015)
Xu, M., Zhang, F., Zhang, W.: Head fusion: Improving the accuracy and robustness of speech emotion recognition on the IEMOCAP and RAVDESS dataset. IEEE Access 9, 74539–74549 (2021)
Xu, B., Wang, N., Chen, T., Li, M.: Empirical evaluation of rectified activations in convolutional network (2015)
Zhao, H., Yufeng, X., Zhang, Z.: Robust semisupervised generative adversarial networks for speech emotion recognition via distribution smoothness. IEEE Access 8, 106889–106900 (2020)
Acknowledgement
This work has been supported by FCT – Fundação para a Ciência e Tecnologia within the R&D Units Project Scope: UIDB/00319/2020;
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rodrigues, M., Andrade, G. (2023). Recognizing Emotions from Voice: A Prototype. In: Ossowski, S., Sitek, P., Analide, C., Marreiros, G., Chamoso, P., Rodríguez, S. (eds) Distributed Computing and Artificial Intelligence, 20th International Conference. DCAI 2023. Lecture Notes in Networks and Systems, vol 740. Springer, Cham. https://doi.org/10.1007/978-3-031-38333-5_36
Download citation
DOI: https://doi.org/10.1007/978-3-031-38333-5_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-38332-8
Online ISBN: 978-3-031-38333-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)