skip to main content
10.1145/2037715.2037724acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
research-article

Simultaneous speech and animation synthesis

Published: 07 August 2011 Publication History

Abstract

Talking computer animated characters are a common sight in video games and movies. Although doing the mouth animation by hand gives the best results, because of cost and time constraints it is not always feasible. Furthermore the amount of speech in current games is ever increasing with some games having more than 200,000 lines of dialogue. This work proposes a system that can produce speech and the corresponding lip animation simultaneously using a statistical machine learning framework based on Hidden Markov Models (HMMs). The key point is that with the developed system never before seen or heard animated dialogues can be produced at a push of a button.

Reference

[1]
Tokuda, K., Yoshimura, T., Masuko, T., Kobayashi, T., and Kitamura, T. 2000. Speech parameter generation algorithms for HMM-based speech synthesis. In Proc. ICASSP, 1315--1318.

Cited By

View all
  • (2021)Write‐An‐Animation: High‐level Text‐based Animation Editing with Character‐Scene InteractionComputer Graphics Forum10.1111/cgf.1441540:7(217-228)Online publication date: 27-Nov-2021
  • (2017)A deep learning approach for generalized speech animationACM Transactions on Graphics10.1145/3072959.307369936:4(1-11)Online publication date: 20-Jul-2017
  • (2014)Joint Audiovisual Hidden Semi-Markov Model-Based Speech SynthesisIEEE Journal of Selected Topics in Signal Processing10.1109/JSTSP.2013.22810368:2(336-347)Online publication date: Apr-2014

Index Terms

  1. Simultaneous speech and animation synthesis

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SIGGRAPH '11: ACM SIGGRAPH 2011 Posters
      August 2011
      92 pages
      ISBN:9781450309714
      DOI:10.1145/2037715
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 August 2011

      Permissions

      Request permissions for this article.

      Check for updates

      Qualifiers

      • Research-article

      Conference

      SIGGRAPH '11
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)2
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 18 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)Write‐An‐Animation: High‐level Text‐based Animation Editing with Character‐Scene InteractionComputer Graphics Forum10.1111/cgf.1441540:7(217-228)Online publication date: 27-Nov-2021
      • (2017)A deep learning approach for generalized speech animationACM Transactions on Graphics10.1145/3072959.307369936:4(1-11)Online publication date: 20-Jul-2017
      • (2014)Joint Audiovisual Hidden Semi-Markov Model-Based Speech SynthesisIEEE Journal of Selected Topics in Signal Processing10.1109/JSTSP.2013.22810368:2(336-347)Online publication date: Apr-2014

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media