Atsushi Nakano
ABSTRACT
Mental communication with characters is important for many entertainment applications. Human's mental statuses are complex, and mental behaviors typically consist of multiple components, such as poses and various unconscious movements. In this paper, we propose the layered behavior synthesis technique for integrating mental behavior and conversational gestures. We compose various mental behavior representations by considering the spatial consistency and co-occurrence probability in interactive games. We also show an example of a game that incorporates the mental behavior synthesis technique.
- Stone. M., DeCarlo, D., Oh, I., Rodriguez, C., Stere, A., Lees, A. and Bregler, C.:Speaking with hands: creating animated conversational characters from recordings of human performance, ACM Transactions on Graphics 23(3), pp. 506--513 (2004). Google Scholar
Digital Library
- Cassell, J., Vilhjálmsson, H., Bickmore, T.: BEAT: the Behavior Expression Animation Toolkit, Proceedings of SIGGRAPH '01, pp. 477--486 (2001). Google ScholarDigital Library
- Kopp, S., Wachsmuth, I.: Synthesizing Multimodal Utterances for Conversational Agents, The Journal Computer Animation and Virtual Worlds 15(1): pp.39--52 (2004). Google ScholarDigital Library
- Butterworth, B. & U. Hadar,: Gesture, speech, and computational stages: A reply to McNeill. Psychological Review, 96, pp. 168--174 (1989).Google ScholarCross Ref
- Kita, S. & A. Ozyurek, Semantic coordination between speech and gesture cross-linguistically: Evidence for the interface representation of spatial thinking and speaking. Journal of Memory and Language, under review.Google Scholar
- Kendon, A., How gesture can become like words. InPoyatos, F. (Ed.), Cross-cultural Perspective in Nonverbal Communication. pp. 131--141, Tronto: Hogrefe, 1988.Google Scholar
- Norman, Donald, "The Design of Everyday Things", Currency/Doubleday Google ScholarDigital Library
- Sang Il Park, Hyun Joon Shin, Taehoon Kim, and Sung Yong Shin. On-line Motion Blending for Real-time Locomotion Generation. Journal of Computer Animation and Virtual Worlds, Volume 15, Issue 3--4, Pages 125--138. July 2004. Google ScholarDigital Library
- Rose, C., Cohen, M., and Bodenheimer, B., "Verbs and Adverbs: Multidimensional Motion Interpolation", IEEE Computer Graphics and Applications, v. 18, no. 5, Sept. 1998, pp. 32--40. Google ScholarDigital Library
- Peter Bull, "Posture and Gesture", 1987.Google Scholar
- McNeill, D. Catchments and contexts: Non-modular factors in speech and gesture production. In D. McNeill (Ed.), Language and gesture. Cambridge University Press. pp. 312--328, 2000.Google Scholar
- Berlyne, D. E., Aesthetics and psychobiology, Appleton-Century-Crofts, 1971.Google Scholar
- Mehrabian, A., Inference of attitude from the posture, orientation and distance of a communicator, Journal of Consulting and Clinical Psychology 32, pp. 296--308, 1968.Google ScholarCross Ref
- Bond, M. H., Shiraishi, D., The effect of body lean and status of an interviewer on the non-verbal behavior of Japanese interviewees, International Journal of Psychology 9, pp. 117--128, 1974.Google ScholarCross Ref
- Mehrabian, A., Relationship of attitude to seated posture, orientation and distance, Journal of Personality and Social Psychology 10, pp. 359--372, 1968.Google ScholarCross Ref
- Mehrabian, A., Friar, J. T., Encoding of attitude by a seated communicator via posture and position cues, Journal of Consulting and Clinical Psychology 33, pp. 330--336, 1969.Google ScholarCross Ref
Index Terms
- Synthesizing pose, unconscious movement, and gesture for mental behavior expression of interactive characters
Recommendations
Evaluation of Mental Workload Based on Pursuit Eye Movement
ICBAKE '13: Proceedings of the 2013 International Conference on Biometrics and Kansei EngineeringMental workload (MWL) has been an important concept in Human Factors. In a human-machine system, MWL can explain operator errors at times. MWL is commonly measured by electrocardiography and electroencephalography, but during real-world tasks problems ...
Influence of personality traits on users’ viewing behaviour
Different views on the role of personal factors in moderating individual viewing behaviour exist. This study examined the impact of personality traits on individual viewing behaviour of facial stimulus. A total of 96 students (46 males and 50 females, ...
Consistency of personality in interactive characters
This study examined whether people would interpret and respond to verbal (text) and non-verbal cues (posture) of personality in interactive characters just as they interpret cues from a person. In a balanced, between-subjects experiment (N=40), ...
Comments