Abstract
In intelligent virtual environments (IVEs), it is a challenging research issue to provide the intelligent virtual actors (or avatars) with the ability of visual perception and rapid response to virtual world events. Modeling an avatar’s cognitive and synthetic behavior appropriately is of paramount important in IVEs. We propose a new cognitive and behavior modeling methodology that integrates two previously developed complementary approaches. We present expression cloning, walking synthetic behavior modeling, and an autonomous agent cognitive model for driving an avatar’s behavior. Facial expressions are generated using our own-developed rule-based state transition system. Facial expressions are further personalized for individuals by expression cloning. An avatar’s walking behavior is modeled using a skeleton model that is implemented by seven-motion sequences and finite state machines (FSMs). We discuss experimental results demonstrating the benefits of our approach.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ashida K, Lee S-J, Allbeck J, Sun H, Badler N, Metaxas D (2001) Pedestrians: creating agent behaviors through statistical analysis of observation data. In: Proceedings of computer animation. IEEE Computer Society, Seoul, pp 84–92
Badler N, Allbeck J, Zhao L, Byun M. Representing and parameterizing agent behaviors. In: Proceedings of computer animation. IEEE Computer Society, Geneva, June 2002
Bindiganavale R, Schuler W, Allbeck JM, Badler NI, Joshi AK, Palmer M (2000) Dynamically altering agent behaviors using natural language instructions. In: Proceedings of the fourth international conference on Autonomous agents 2000, Barcelona, Spain, pp 293–300, 03–07 June 2000
Blumberg BM, Galyean TA (1995) Multi-Level Direction of autonomous creatures for real-time virtual environments. In: Proceedings of SIGGRAPH, 47–54
Tolani D, Goswami A, Badler NI (2000) Real-time inverse kinematics techniques for anthropomorphic limbs. Graph Models 62:353–388
Funge J, Tu X, Terzopoulos D (1999) Cognitive modeling: knowledge, reasoning and planning for intelligent characters. In: Proceedings of SIGGRAPH, pp 29–38
Golub GH, Heath M, Wahba G (1979) Generalized crossvalidation as a method for choosing a good ridge parameter. Technometrics 21(2):215–223
Gratch J, Marsella S (2005) Some lessons for emotion psychology for the design of lifelike characters. J Appl Artif Intell 19(3–4):215–233
Gratch J, Rickel J, André E, Badler N, Cassell J, Petajan E (2002) Creating interactive virtual humans: some assembly required. IEEE Intell Syst 17(4):54–63
Kähler K, Haber J, Seidel HP (2003) Reanimating the dead: reconstruction of expressive faces from skull data. ACM Trans Graph (SIGGRAPH 2003 Conf Proc) 22(3):554–561
Liang R, Pan Z, Chen C (2004) New algorithm for 3D facial model reconstruction and its application in virtual reality. J Comput Sci Technol 19(4):501–509
Liu Z, Pan Z, Zhang M (2002) Behavior animation of virtual human in virtual society. In: The 12th international conference on artificial reality and telexistence (ICAT), pp 186–187
Maes P, Darell T, Blumberg B (1995) The ALIVE system: full-body interaction with autonomous agents. In: Proceedings of IEEE computer animation, Switzerland, pp 11–18
Noh J, Neumann U (2001) Expression cloning. ACM SIGGRAPH, pp 277–288
Noser H (1997) A behavioural animation system based on L-systems and synthetic sensors for actors, PhD Thesis
Treuille A, Cooper S, Popović Z (2006) Continuum Crowds. In: Proceedings of ACM SIGGRAPH
Tu X, Terzopoulos D (1994) Artificial Fishes: physics, locomotion, perception, behavior. Proc SIGGRAPH 28(3):43–50
Waters K (1987) A muscle model for animation three-dimensional facial expression. Comput Graph 21(4):17–24
Zordan VB, Majkowska A, Chiu B (2005) Dynamic response for motion capture animation, ACM Trans Graph (Proc ACM SIGGRAPH 2005) 24(3):697–701
Acknowledgments
This work was partly supported by NSFC grants 60203013 and 60533080, and key project from Zhejiang Provincial Natural Science Foundation of China grants Z603262, 863 project: 2006AA01Z303 and pre-973 project: 2005CCA04400.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liang, R., Zhang, M., Liu, Z. et al. Cognitive and synthetic behavior of avatars in intelligent virtual environments. Virtual Reality 12, 47–54 (2008). https://doi.org/10.1007/s10055-008-0089-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10055-008-0089-7