Skip to main content
SpringerLink
Log in

Interconversion of Emotions in Speech Using TD-PSOLA

  • Conference paper
  • First Online:
Advances in Signal Processing and Intelligent Recognition Systems

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 425))

Abstract

Emotional speech plays a major role in identifying the mental state of the speaker. The presented work demonstrates the significance of incorporating dynamic variations in prosodic parameters in speech for the effective conversion of one emotion to another. Most existing methods focus on the incorporation of emotions in synthetically generated neutral speech. The proposed model discusses the usage of TD-PSOLA as an important tool in converting one emotion to another for speech samples in English language. It analyses the significance of various prosodic parameters in distinct emotions and explores how prosodic modifications to one emotion can result in different perceived emotions. The paper explores a technique for interconversion of emotions in synthesised speech and demonstrates a methodology for prosodic modifications on an English database.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Schroder, M.: Emotional speech synthesis- a review. In: Proc. Eurospeech, pp. 561–564 (2001)

    Google Scholar 

  2. Burkhardt, F., Sendilmeier, W.F.: Verification of acoustical correlates of emotional speech using formant synthesis. In: Proc. ISCA Workshop on Speech & Emotion, pp. 151–156 (2000)

    Google Scholar 

  3. Schroder, M.: Expressive speech synthesis: past, present and possible futures. In: Affective Information Processing, vol. 2, pp. 111–126. Springer (2009)

    Google Scholar 

  4. Tao, J., Kang, Y., Li, A.: Prosody conversion from neutral speech to emotional speech. IEEE Trans. Audio, Speech, and Language Processing 14, 1145–1154 (2006)

    Article  Google Scholar 

  5. Bulut, M., Narayanan, S.: On the robustness of overall f0 only modifications to the perception of emotions in speech. J. Acoust. Soc. Am. 123, 4547–4558 (2008)

    Article  Google Scholar 

  6. Fairbanks, G., Hoaglin, L.W.: An experimental study of pitch characteristics of voice during the expression of emotion. Speech Monographs 6, 87–104 (1939)

    Article  Google Scholar 

  7. Wang, Z., Yu, T.: Multi-level prosody and spectrum conversion for emotional speech synthesis. In: ICSP 2014 Proceedings (2014)

    Google Scholar 

  8. Anil, M.C., Shirbahadurkar, S.D.: Speech modification for prosody conversion in expressive marathi text-to-speech synthesis. In: Proceedings of IEEE International Conference on Signal Processing and Integrated Networks (SPIN), pp. 56–58 (2014)

    Google Scholar 

  9. Burkhardt, F., Paeschke, A., Weiss, B.: A database of German Emotional Speech. In: Proceedings of Interspeech, Lisbon, Portugal (2005)

    Google Scholar 

  10. Rao, K.S., Yegnanarayana, B.: Prosody modification using instants of significant excitation. IEEE Trans. Audio, Speech and Language Processing 14, 972–980 (2006)

    Article  Google Scholar 

  11. Mourlines, E., Laroche, J.: Non-parametric techniques for pitch-scale and time-scale modification of speech. Speech Commun. 16, 175–205 (1995)

    Article  Google Scholar 

  12. Govind, D., Prasanna, S.R.M.: Expressive Speech Synthesis: A Review. International Journal of Speech Technology 16, 237–260 (2013)

    Article  Google Scholar 

  13. Martin, O., Kotsia, I., Macq, B., Pitas, I.: The eNTERFACE 2005 Audio-Visual Emotion Database (2005)

    Google Scholar 

  14. Praat: Doing Phonetics by Computer. (n.d.). (retrieved from). www.praat.org. http://www.fon.hum.uva.nl/praat/

  15. Dung, N.T., Hai, N.D.: Time-Domain Pitch and Time Scale Modification of Speech Signal, School of Computing, National University of Singapore (2008)

    Google Scholar 

  16. Mochizuki, R., Kobayashi, T.: A low-band spectrum envelope modeling for high quality pitch modification. In: Proceedings of International Conference on Acoustics, Speech, and Signal Processing (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Amrita Vishwa Vidyapeetham, Bangalore, India

    B. Akanksh, Susmitha Vekkot & Shikha Tripathi

Authors
  1. B. Akanksh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Susmitha Vekkot
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shikha Tripathi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Susmitha Vekkot .

Editor information

Editors and Affiliations

  1. and Management – Kerala (IIITM-K), Indian Inst. of Information Technology, Trivandrum, Kerala, India

    Sabu M. Thampi

  2. Machine Intelligence Unit, Indian Statistical Institute, Kolkata, West Bengal, India

    Sanghamitra Bandyopadhyay

  3. Department of Electrical, Ryerson University, Toronto, Ontario, Canada

    Sri Krishnan

  4. Providence University, Taichung, Taiwan

    Kuan-Ching Li

  5. Computer Engineering Department, Vladimir State University, Vladimir Region, Russia

    Sergey Mosin

  6. School of Electrical, Nanyang Technological University, Singapore, Singapore

    Maode Ma

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Akanksh, B., Vekkot, S., Tripathi, S. (2016). Interconversion of Emotions in Speech Using TD-PSOLA. In: Thampi, S., Bandyopadhyay, S., Krishnan, S., Li, KC., Mosin, S., Ma, M. (eds) Advances in Signal Processing and Intelligent Recognition Systems. Advances in Intelligent Systems and Computing, vol 425. Springer, Cham. https://doi.org/10.1007/978-3-319-28658-7_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-28658-7_32

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-28656-3

  • Online ISBN: 978-3-319-28658-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation