Abstract
Artists use words, lines, shapes, color, sound and their bodies to express emotions. Virtual humans use postures, gestures, face and voice to express emotions. Why are they limiting themselves to the body? The digital medium affords the expression of emotions using lights, camera, sound and the pixels in the screen itself. Thus, leveraging on accumulated knowledge from the arts, this work proposes a model for the expression of emotions in virtual humans which goes beyond embodiment and explores lights, shadows, composition and filters to convey emotions. First, the model integrates the OCC emotion model for emotion synthesis. Second, the model defines a pixel-based lighting model which supports extensive expressive control of lights and shadows. Third, the model explores the visual arts techniques of composition in layers and filtering to manipulate the virtual human pixels themselves. Finally, the model introduces a markup language to define mappings between emotional states and multimodal expression.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Collingwood, R.: Art and Craft. In: Feagin, S., Maynard, P. (eds.) Aesthetics, pp. 215–220. The Oxford University Press, New York, USA (1997)
Bell, C.: The Metaphysical Hypothesis. In: Feagin, S., Maynard, P. (eds.) Aesthetics, pp. 158–159. The Oxford University Press, New York, USA (1997)
Arijon, D.: Grammar of the Film Language. Silman-James Press, California, USA (1976)
Millerson, G.: Lighting for Television and film, 3rd edn. Focal Press, Oxford, UK (1999)
Birn, J.: [digital] Lighting and Rendering, 2nd edn. New Riders, California, USA (2006)
Juslin, P., Sloboda, J.: Music and Emotion: theory and research. Oxford University Press, New York, USA (2001)
Zettl, H.: Sight Sound Motion: Applied Media Aesthetics. Wadsworth Publishing, California, USA (2004)
Sayre, H.: A World of Art, 5th edn. Prentice-Hall, Englewood Cliffs (2007)
Gratch, J., Rickel, J., Andre, E., Badler, N., Cassell, J., Petajan, E.: Creating Interactive Virtual Humans: Some Assembly Required. IEEE Intelligent Systems 17(4), 54–63 (2002)
Orthony, A.: The Cognitive Structure of Emotions. Cambridge University Press, New York, USA (1990)
Batteux, A.: The Fine Arts Reduced to a Single Principle. In: Feagin, S., Maynard, P. (eds.) Aesthetics, pp. 102–104. The Oxford University Press, New York, USA (1997)
Clifford, G.: Art as a Cultural System. In: Feagin, S., Maynard, P. (eds.) Aesthetics, pp. 109–118. The Oxford University Press, New York, USA (1997)
Kant, I.: Art and Genius. In: Feagin, S., Maynard, P. (eds.) Aesthetics, pp. 180–192. The Oxford University Press, New York, USA (1997)
Elliot, R.: Aesthetic Theory and the Experience of Art. In: Feagin, S., Maynard, P. (eds.) Aesthetics, pp. 278–288. The Oxford University Press, New York, USA (1997)
Cassell, J.: Nudge, Nudge, Wink, Wink: Elements of Face-to-Face Conversation for Embodied Conversational Agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 1–27. The MIT Press, Massachusetts, USA (2000)
Noh, J., Neumann, U.: A Survey of Facial Modeling and Animation Techniques. USC Technical Report 99-705 (1998)
Schroder, M.: Speech and emotion research: an overview of research frameworks and a dimensional approach to emotional speech synthesis. PhD thesis. vol. 7 of Phonus, Research Report of the Institute of Phonetics, Saarland University (2004)
Amaya, K., Bruderlin, A., Calvert, T.: Emotion from motion. In: Proceedings Graphics Interface 1996, pp. 222–229 (1996)
Chi, D., Costa, M., Zhao, L., Badler, N.: The EMOTE model for effort and shape. In: Proceedings of SIGGRAPH 2000, pp. 173–182 (2000)
Hartmann, B., Mancini, A., Pelachaud, C.: Implementing Expressive Gesture Synthesis for Embodied Conversational Agents. In: Gibet, S., Courty, N., Kamp, J.-F. (eds.) GW 2005. LNCS (LNAI), vol. 3881, Springer, Heidelberg (2006)
de Melo, C., Paiva, A.: Environment Expression: Expressing Emotions through Cameras, Lights and Music. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 715–722. Springer, Heidelberg (2005)
Hunt, R.: The Reproduction of Colour, 6th edn. John Wiley & Sons, Ltd., Sussex, UK (2004)
Fraser, T., Banks, A.: Designer’s Color Manual: The Complete Guide to Color Theory and Application. Chronicle Books, California, USA (2004)
Moller, R., Haines, E.: Real-Time Rendering, 2nd edn. AK Peters Ltd., Massachusetts, USA (2002)
St-Laurent, S.: Shaders for Game Programmers and Artists. Thomson Course Technology, Massachusetts, USA (2004)
de Melo, C., Paiva, A.: Multimodal Expression in Virtual Humans. Computer Animation and Virtual Worlds Journal. 17(3), 239–248 (2006)
Picard, R.: Affective Computing. The MIT Press, Massachusetts, USA (1997)
SMIL: Synchronized Multimedia Integration Language (SMIL) (2007), http://www.w3.org/AudioVideo/
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
de Melo, C., Paiva, A. (2007). Expression of Emotions in Virtual Humans Using Lights, Shadows, Composition and Filters. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds) Affective Computing and Intelligent Interaction. ACII 2007. Lecture Notes in Computer Science, vol 4738. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74889-2_48
Download citation
DOI: https://doi.org/10.1007/978-3-540-74889-2_48
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74888-5
Online ISBN: 978-3-540-74889-2
eBook Packages: Computer ScienceComputer Science (R0)