Abstract
Avatars and Artificial Actors in Virtual Environments can be controlled by speech, as an alternative to motion capture techniques. In this paper, we discuss some specific requirements for the successful implementation of speech-based control of guided actors. We describe our sublanguage approach to speech-based control and its associated parsing techniques, based on lexicalised grammars. After an introduction to the REALISM animation software, we report work in progress in the real-time processing of spoken commands based on the integration of speech processing in the REALISM control loop. We conclude by discussing the possible impact of voice-controlled artificial actors in interactive systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Webber, B., Badler, N., Di Eugenio, B., Geib, C., Levison, L., Moore, M.: Instructions, Intentions and Expectations. IRCS Report 94-01, Institute for Research In Cognitive Science, University of Pennsylvania (1994).
Beardon, C., Ye, V.: Using Behavioral Rules in Animation. Computer Graphics: Developments in Virtual Environments, Academic Press, San Diego (1995) 217–234
Kurlander, D., Ling, D.T.: Planning-Based Control of Interface Animation. Proceedings of CHI’95 Conference, ACM Press, New York (1995) 472–479.
Chapman, D.: Vision, Instruction and Action. MIT Press, Cambridge (1991)
Trost, H., Heinz, W., Matiasek, J., Buchberger, E.: Datenbank-DIALOG and the Relevance of Habitability, Proceedings of the Third Conference on Applied Natural Language Processing, ACL Press, (1992)
Oviatt, S.: User-centered Modeling for Spoken Language and Multimodal Interfaces, IEEE Multimedia, 3 (1996) 26–35
Bandhi, S., Thalmann, D.: Space Discretization for Efficient Human Navigation, Proceedings of EUROGRAPHICS Annual Conference, (1998)
Ishida, T., Korf, R.E.: Moving-Target Search: A Real-Time Search for Changing Goals, IEEE Transactions in Pattern Analysis and Machine Intelligence, 6 (1995) 609–619
Cavazza, M.: An Integated TFG Parser with Explicit Tree Typing,, Proceedings of the Fourth TAG+ Workshop, University of Pennsylvania (1998)
De Smedt, K., Kempen, G.: Segment Grammars: a Formalism for Incremental Sentence Generation, In: Paris, C.: Natural Language Generation and Computational Linguistics, Kluwer, Dodrecht (1990)
Abeillé, A.: Une grammaire léxicalisé d’arbres adjoints: application a l’analyse automatique. PhD Thesis, University of Paris 7 (1991)
Palmer, I.J, Grimsdale, R.L.: REALISM: Reusable Elements for Animation using Local Integrated Simulation Models, Proceedings of Computer Animation’94, IEEE Comp. Soc. Press (1994) 132–140
Nasr, A.: A Formalism and a Parser for Lexicalized Dependency Grammars, Proceedings of the Fourth International Workshop on Parsing technologies, Prague (1995)
Schabes, Y., Waters, R.: Tree-Insertion Grammar: A Cubic-Time Parsable Formalism That Lexicalizes Context-Free Grammars Without Changing the Trees Produced, Technical Report TR-94-13, Mitsubishi Electric Research Laboratories, Cambridge (1994)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1998 Springer-Verlag Berlin Heidelberg1998
About this paper
Cite this paper
Cavazza, M., Palmer, I., Parnell, S. (1998). Real-Time Requirements for the Implementation of Speech-Controlled Artificial Actors. In: Magnenat-Thalmann, N., Thalmann, D. (eds) Modelling and Motion Capture Techniques for Virtual Environments. CAPTECH 1998. Lecture Notes in Computer Science(), vol 1537. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49384-0_15
Download citation
DOI: https://doi.org/10.1007/3-540-49384-0_15
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-65353-0
Online ISBN: 978-3-540-49384-6
eBook Packages: Springer Book Archive