Yoshifumi Kitamura
Rong Rong
ABSTRACT
We present a novel approach for interactive multimedia content creation that establishes an interactive environment in cyberspace in which users interact with autonomous agents generated from video images of real-world creatures. Each agent has autonomy, personality traits, and behaviors that reflect the results of various interactions determined by an emotional model with fuzzy logic. After an agent's behavior is determined, a sequence of video images that best match the determined behavior is retrieved from the database in which a variety of video image sequences of the real creature's behaviors are stored. The retrieved images are successively displayed on the cyberspace to make it responsive. Thus the autonomous agent behaves continuously. In addition, an explicit sketch-based method directly initiate the reactive behavior of the agent without involving the emotional process. This paper describes the algorithm that establishes such an interactive system. First, an image processing algorithm to generate a video database is described. Then the process of behavior generation using emotional models and sketch-based instruction are introduced. Finally, two application examples are demonstrated: video agents with humans and goldfish.
Supplemental Material
- Asai, K., Kitamura, Y., Nishimoto, T., Hirano, Y., Hama, E., and Kishino, F., 2007. Video agents. ACM SIGGRAPH Emerging Technologies. Google Scholar
Digital Library
- Balaguer, J., and Gobbetti, E. 1995. Sketching 3D animations. Computer Graphics Forum 14, 3, 241--258.Google ScholarDigital Library
- Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M. P., and Tomlinson, B. 2002. Integrated learning for interactive synthetic characters. In Proc. of ACM SIGGRAPH, 417--426. Google ScholarDigital Library
- Chetverikov, D., and Szabó, Z. 1999. A simple and efficient algorithm for detection of high curvature points in planar curves. In Workshop of Austrian Pattern Recognition Group, 175--184.Google Scholar
- Costa, P. T., and McCrae, R. R. 1985. The NEO Personality Inventory. Psychological Assessment Resources.Google Scholar
- de Juan, C., and Bodenheimer, B. 2004. Cartoon textures. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 267--276. Google ScholarDigital Library
- Donikian, S. 2002. Hpts: A behaviour modeling language for autonomous agents. In Proc. of International Conference on Autonomous Agents, 401--408. Google ScholarDigital Library
- Ekman, P., and Davidson, R. J. 1994. The nature of emotion: fundamental questions. Oxford University Press.Google Scholar
- Elliott, C. 1992. The affective reasoner: a process model of emotions in a multi-agent system. PhD thesis, Northwestern University. Google ScholarDigital Library
- Frijda, N. 1986. The emotions. Cambridge University Press.Google Scholar
- Kombis, S. 1998. Virtual fishtank. In ACM SIGGRAPH Conference Abstracts and Applications, 116. Google ScholarDigital Library
- Kovar, L., Gleicher, M., and Pighin, F. 2002. Motion graphs. In Proc. of ACM SIGGRAPH, 473--482. Google ScholarDigital Library
- Kruskal, J. B., and Seery, J. B. 1980. Designing network diagrams. In Proc. of General Conference on Social Graphics, 22--50.Google Scholar
- Lin, I.-J., and Kung, S. Y. 2000. Video object extraction and representation: Theory and applications. Kluwer Academic Publishers. Google ScholarDigital Library
- Loyall, A. B., Reilly, W. S. N., Bates, J., and Weyhrauch, P. 2004. System for authoring highly interactive, personality-rich interactive characters. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 59--68. Google ScholarDigital Library
- Minsky, M. 1985. The society of mind. Simon and Schuster. Open source computer vision library. http://www.intel.com/technology/computing/opencv/. Google ScholarDigital Library
- Popovic, J., Seits, S. M., and Erdmann, M. 2003. Motion sketching for control of rigid-body aimulations. ACM Transactions on Graphics 22, 4, 1034--1054. Google ScholarDigital Library
- Radica, 2005. Cube world. http://www.radicauk.com/.Google Scholar
- Reynolds, C. W. 1987. Flocks, herds and schools: A distributed behavioral model. In Proc. of ACM SIGGRAPH, 25--34. Google ScholarDigital Library
- Ronald, A., Fujita, M., Takagi, T., and Hasegawa, R. 2003. An ethological and emotional basis for human-robot interaction. Robotics and Autonomous Systems 42, 191--201.Google ScholarCross Ref
- Schödl, A., and Essa, I. A. 2002. Controlled animation of video sprites. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 121--127. Google ScholarDigital Library
- Schödl, A., Szeliski, R., Salesin, D. H., and Essa, I. 2000. Video textures. In Proc. of ACM SIGGRAPH, 489--498. Google ScholarDigital Library
- Sloman, A. 1997. Designing human-like minds. In Proc. of European Conference on Artificial Life.Google Scholar
- Starck, J., Miller, G., and Hilton, A. 2005. Video-based character animation. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 49--58. Google ScholarDigital Library
- Su, W.-P., Pham, B., and Wardhani, A. 2005. High-level control posture of story characters based on personality and emotion. In Proc. of Australasian Conference on Interactive Entertainment, 179--186. Google ScholarDigital Library
- Sun, J., Zhang, W., Tang, X., and Shum, H.-Y. 2006. Background cut. In Proc. of European Conference on Computer Vision, 628--641. Google ScholarDigital Library
- Terzopoulos, D., and Tu, X. 1994. Artificial fishes: Physics, locomotion, perception, behavior. In Proc. of ACM SIGGRAPH, 43--50. Google ScholarDigital Library
- Thorne, M., Burke, D., and van de Panne, M. 2004. Motion doodles: an interface for sketching character motion. ACM Transactions on Graphics 23, 3 (Proc. of SIGGRAPH), 424--431. Google ScholarDigital Library
- Tomlinson, B., Downie, M., Berlin, M., Gray, J., Lyons, D., Cochran, J., and Blumberg, B. 2002. Leashing the alphawolves: mixing user direction with autonomous emotion in a pack of semi-autonomous virtual characters. In Proc. of ACM SIGGRAPH/Eurographics Symposium on Computer Animation, 7--14. Google ScholarDigital Library
- Ushida, H., Hirayama, Y., and Nakajima, H. 1998. Emotion model for life-like agent and its evaluation. In Proc. of Conference on Artificial Intelligence (AAAI), 62--69. Google ScholarDigital Library
- Velasquez, J. D. 1997. Modeling emotions and other motivations in synthetic agents. In Proc. of Conference on Artificial Intelligence (AAAI), 10--15. Google ScholarDigital Library
- Wang, J., Bhat, P., Colburn, R. A., Agrawala, M., and Cohen, M. F. 2005. Interactive video cutout. In Proc. of ACM SIGGRAPH, 585--594. Google ScholarDigital Library
Index Terms
- Video agent: interactive autonomous agents generated from real-world creatures
Recommendations
Osaka developing story: an application of video agents
ACE '10: Proceedings of the 7th International Conference on Advances in Computer Entertainment TechnologyIn this paper, we put forward a novel idea to create virtual alter egos by using video images of real-world humans; these alter egos can act autonomously and interactively in a virtual world. The design inspiration of this virtual world is Osaka City in ...
Image enhancement - An emergent pattern formation approach via decentralised multi-agent systems
Special Issue on Nature inspired systems for parallel, asynchronous and decentralised environmentsA multi-agent framework inspired by natural and physical systems is presented for data discovery and image enhancement. The input image is represented as a topographic landscape upon which a large population of independent simple, reactive, mobile ...
Faking dynamics of cloth animation for animated films
AMDO'10: Proceedings of the 6th international conference on Articulated motion and deformable objectsIn this paper we argue for the concept of fake dynamics to allow animators to interactively create visually pleasing animations of cloth models while keeping him/her in full control of the animation process. Existing animation and simulation techniques ...
Comments