Gerhard Johann Hagerer
ABSTRACT
In this work we propose a prototype to improve interpersonal communication of emotions. Therefore music is generated with the same affect as when humans talk on the fly. Emotions in speech are detected and conveyed to music according to music psychological rules. Existing evaluated modules from affective generative music and speech emotion detection, use cases, emotional models and projected evaluations are discussed.
- Icons by SimpleIcon.com & Flaticon.com, CC BY 3.0.Google Scholar
- Anagnostopoulos, C. N., Iliou, T., Giannoukos, I. Features and classifiers for emotion recognition from speech: a survey from 2000-2011. Springer, 2012.Google Scholar
- Anderson, D. J., Adolphs, R. A framework for studying emotions across species. Cell 157, 1 (2014), 187.Google ScholarCross Ref
- Baghel, J. K. Audio-based characterization of conversations. Master's thesis, Technische Universitat Munchen, Institut fur Informatik.Google Scholar
- Bartels, A., Rolfes, M., Burkhardt, F., Technical University Berlin. Berlin database of emotional speech, requested on 20/11/2014 11:30am.Google Scholar
- Batliner, A., Steidl, S., Noth, E. Releasing a thoroughly annotated and processed spontaneous emotional database: the fau aibo emotion corpus. In Proc. of a satellite workshop of LREC (2008), 28--31.Google Scholar
- Eyben, F., Weninger, F., Gros, F., Schuller, B. Recent developments in opensmile, the munich open-source multimedia feature extractor. 835--838. Google ScholarDigital Library
- Gabrielsson, A., Lindström, E. The influence of musical structure on emotional expression.Google Scholar
- Galizio, M., Hendrick, C. Effect of musical accompaniment on attitude: The guitar as a prop for persuasion. Journal of Applied Social Psychology 2, 4 (1972), 350--359.Google ScholarCross Ref
- Ghaziuddin, M. Defining the behavioral phenotype of asperger syndrome. Journal of Autism and Developmental Disorders 38, 1 (2008), 138--142.Google ScholarCross Ref
- Gomez, P., Danuser, B. Relationships between musical structure and psychophysiological measures of emotion. Emotion 7, 2 (2007), 377.Google ScholarCross Ref
- Juslin, P. N., Laukka, P. Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological bulletin 129, 5 (2003), 770.Google Scholar
- Koelsch, S. Brain correlates of music-evoked emotions. Nature Reviews Neuroscience 15, 3 (2014), 170--180.Google ScholarCross Ref
- Kostoulas, T., Ganchev, T., Lazaridis, A., and Fakotakis, N. Enhancing emotion recognition from speech through feature selection. In Text, speech and dialogue, Springer (2010), 338--344. Google ScholarDigital Library
- Livingstone, S. R., Muhlberger, R., Brown, A. R., Thompson, W. F. Changing musical emotion: A computational rule system for modifying score and performance. Computer MusicJournal 34 (2010), 41. Google ScholarDigital Library
- Marjolijn H., Ren S., Pijnenborg, K. & M., Aleman, A. Impaired recognition and expression of emotional prosody in schizophrenia: Review and meta-analysis. Schizophrenia Research 96, 13 (2007), 135 -- 145.Google Scholar
- McCann, J., Peppe, S. Prosody in autism spectrum disorders: a critical review. International Journal of Language & Communication Disorders 38, 4 (2003), 325--350.Google ScholarCross Ref
- Minzenberg, M. J., Poole, J. H., Vinogradov, S. Social-emotion recognition in borderline personality disorder. Comprehensive Psychiatry 47, 6 (2006), 468.Google ScholarCross Ref
- Rao, K. S., S. G. Koolagudi. Robust Emotion Recognition using Spectral and Prosodic Features. Springer, 2013. Google ScholarDigital Library
- Ross, E. D. Affective prosody and the aprosodias.Google Scholar
- Russell, J. A. A circumplex model of affect. Journal of personality and social psychology 39, 6 (1980), 1161.Google Scholar
- Russell, J. A., Weiss, A., Mendelsohn, G. A. Affect grid: A single-item scale of pleasure and arousal.Google Scholar
- Saulnier, C. A., Klin, A. Brief report: social and communication abilities and disabilities in higher functioning individuals with autism and asperger syndrome. Journal of autism and developmental disorders 37, 4 (2007), 788--793.Google Scholar
- Schuller, B., Steidl, S., Batliner, A. The interspeech 2009 emotion challenge. INTERSPEECH, 312--315.Google Scholar
- Schuller, B., Steidl, S., Batliner, A., Burkhardt, F., Devillers, L., Muller, C., Narayanan, S. S. The interspeech 2010 paralinguistic challenge. In In Proceedings of InterSpeech (2010).Google ScholarCross Ref
- Schulze, F., Groh, G. Studying how character of conversation affects personal receptivity to mobile notifications. In CHI'14 Extended Abstracts, ACM (2014), 1729--1734. Google ScholarDigital Library
- Stratton, V. N., Zalanowski, A. H. Affective impact of music vs. lyrics. Empirical Studies of the Arts 12, 2 (1994), 173--184.Google ScholarCross Ref
- Wallis, I., Ingalls, T., Campana, E. Computer-generating emotional music: The design of an affective music algorithm. DAFx-08, Espoo, Finland (2008), 7--12.Google Scholar
- Wallis, I., Ingalls, T., Campana, E., Goodman, J. A rule-based generative music system controlled by desired valence and arousal. In Proceedings of 8th international sound and music computing conference (SMC) (2011).Google Scholar
- Watzlawick, P., Bavelas, J. B., Jackson, D. D. Pragmatics of human communication: A study of interactional patterns, pathologies and paradoxes. WW Norton & Company, 2011.Google Scholar
Index Terms
- Augmenting Affect from Speech with Generative Music
Recommendations
Expression of affect in spontaneous speech: Acoustic correlates and automatic detection of irritation and resignation
The majority of previous studies on vocal expression have been conducted on posed expressions. In contrast, we utilized a large corpus of authentic affective speech recorded from real-life voice controlled telephone services. Listeners rated a selection ...
Primitives-based evaluation and estimation of emotions in speech
Emotion primitive descriptions are an important alternative to classical emotion categories for describing a humans affective expressions. We build a multi-dimensional emotion space composed of the emotion primitives of valence, activation, and ...
AVEC 2013: the continuous audio/visual emotion and depression recognition challenge
AVEC '13: Proceedings of the 3rd ACM international workshop on Audio/visual emotion challengeMood disorders are inherently related to emotion. In particular, the behaviour of people suffering from mood disorders such as unipolar depression shows a strong temporal correlation with the affective dimensions valence and arousal. In addition, ...
Comments