Pilar Herrero
ABSTRACT
Although, at this moment, there are not many researches on perceptual models for Intelligent Virtual Agents, the few that exist are more focused on visual than on hearing perception. This paper describes the work that the Universidad Politicnica de Madrid, in collaboration with the University of Nottingham, is carrying on, with the aim of endowing Intelligent Virtual Agents with a synthetic model of human-like hearing perception. We have based the design and development of this model on Endsley studies about situational awareness [10,11], where perception can be understood as the first level of awareness. This perceptual model also extends and reinterprets the key concepts introduced by a CSCW model of awareness known as the Spatial Model of Interaction [4]. In this paper, we give an overview of those studies related to our work and we describe how we have achieved our purposes: selecting an agent architecture; re-defining and reinterpreting the set of key concepts introduced by the Spatial Model of Interaction; and analysing those factors that make the auditory perceptual model more realistic. We also expose how a mathematical function can describe the agents clarity of perception and how this model of perception has been implemented and evaluated.
- Astheimer, A. Acoustic Simulation for Visualization and Virtual Reality, Eurographics '95, State of The Art Reports, R.C. Veltkamp (ed), Maastricht, The Netherlands, Aug. 28 -Sept. 1, 1995.]]Google Scholar
- Balcisoy, S. Kallmann, M. Torre, R. Fua, P. Thalmann, D. Interaction Techniques with Virtual Humans in Mixed Environments. In International Symposium on Mixed Reality, Tokyo, Japan, 2001 (extended version to be publishedin Presence, MIT Press).]]Google Scholar
- Benford, S. et al. User Embodiment in Collaborative Virtual Environments Proc. ACM CHI95. 1995.]] Google ScholarDigital Library
- Benford, S.D., and Fahlén, L.E. A spatial Model of Interaction in Large Virtual Environments. Proc. Third European Conference on Computer Supported Cooperative Work (ECSCW'93), Milano, Italy. Kluwer Academic Publishers, 1993.]] Google ScholarDigital Library
- Beranek, L. Acoustics. Acoustical Society of America. 1986]]Google Scholar
- Blauert, J. Spatial Hearing. (MIT Press, Cambridge, MA). 1983]]Google Scholar
- Blumberg, B. Go with the Flow: Synthetic Vision for Autonomous Animated Creatures. Proceedings of the First International Conference on Autonomous Agents (Agents'97), Marina del Rey, CA, 1997.]] Google ScholarDigital Library
- Chenney Stevephen Sensing for Autonomous Agents in Virtual Environments. http://www.cs.berkeley.edu/˜schenney/ autonomous/sensing.html.1996.]]Google Scholar
- Dourish, P., Bellotti, V. Awareness and Coordination in Shared Workspaces. Proceedings of the 4th ACM Conference on CSCW. Toronto / Canada, Oktober 1992.]] Google ScholarDigital Library
- Endsley. M. Towards a theory of situation awareness. Technical report, Texas Technical University, Department of Industrial Engineering, 1993.]]Google Scholar
- Endsley. M., Design and evaluation for situation awareness enhancement. Proceedings of Human Factors Society and Annual Meeting, volume 1, 1988.]]Google ScholarCross Ref
- Geib C. W., Levison L., and Moore M. B., SodaJack: an architecture for agents that search for and manipulate objects. Tech. Rep. MS-CIS-94-16/LINC LAB 265, Department of Computer and Information Science, University of Pennsylvania, 1994.]]Google Scholar
- Herrero P., De Antonio A., A Human Based Perception Model for Cooperative Intelligent Virtual Agents. Tenth International Conference on Cooperative Information Systems (CoopIS 2002). University of California, Irvine. October 30 - November 1, 2002]] Google ScholarDigital Library
- Herrero P., De Antonio A., Benford S., Greenhalgh C., Increasing the Coherence between Human Beings and Virtual Agents. Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, Bologna, Italy, July, 2002.]] Google ScholarDigital Library
- Herrero P., De Antonio A., Segovia J. Is the Awareness of Avatars in a Virtual World Different from Human Awareness? Workshop on the Future of Cves: "Voltage in the Milky Night: The Future of CVE's" The Third International Conference on Collaborative Virtual Environments. ACM Collaborative Virtual Environments 2000. San Francisco (California). USA. September 2000.]]Google Scholar
- Herrero P., Developing a New Perception Model for Collaborative Virtual Environment. Doctoral Consortium at ECSCW 2001. The 7th European Conference on Computer Supported Cooperative Work. Bonn, Germany. September, 16-20, 2001]]Google Scholar
- Hill, R. Han, C. van Lent, M. Applying Perceptually Driven Cognitive Mapping To Virtual Urban Environments. Conference on Innovative Applications of Artificial Intelligence (IAAI-2002) in Edmonton, Canada.2002.]] Google ScholarDigital Library
- Hill, R. Kim, Y. van Lent. M. Anticipating Where to Look: Predicting the Movements of Mobile Agents in Complex Terrain. Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, Bologna, Italy, July, 2002.]] Google ScholarDigital Library
- Kendall G. 3D Sound. Center for Music Technology. School of Music. Northwestern University. Consulted 2002 http://www.northwestern.edu/musicschool/classes/3D.]]Google Scholar
- Lehnert, H. Fundamentlas of Auditory Virtual Environment. Artificial Life and Virtual Reality, N. M. Thalmann, D. Thalmann (edts), John Wiley and Sons Ltd, 1994.]]Google Scholar
- Logan, B., Fraser, M., Fielding, D., Benford, S., Greenhalgh, C., Herrero P. Keeping in Touch: Agents Reporting from Collaborative Virtual Environments. Artificial Intelligence and Interactive Entertainment: Papers from the 2002 AAAI Spring Symposium, Technical Report SS-02-01, AAAI Press, March 2002.]]Google Scholar
- Magnenat, N. Thalmann, D. The Artificial Life of Synthetic Actors, IEICE Transactions, Japan, invited paper, Vol. J76-D-II, No.8, pp.1506--1514. 1993.]]Google Scholar
- Nilsson, N. Teleo-Reactive Programs and the Triple-Tower Architecture. Electronic Transactions on Artificial Intelligence, Vol. 5, Section B, pp. 99-110. 2001.]]Google Scholar
- Noser, H. Renault, O. Thalmann, D. Magnenat N. Navigation for Digital Actors based on Synthetic Vision, Memory and Learning. Computers and Graphics, Pergamon Press, Vol.19, No1, 1995.]]Google Scholar
- Noser, H., Thalmann, D. Synthetic Vision and Audition for Digital Actors. Proc. Eurographics `95, Maastricht, August 1995, pp.325--336Noser, H., A Behavioral Animation System Based on L-systems and Synthetic Sensors for Actors. PhD Thesis. École Polytechnique Fédérale De Lausanne. 1997]]Google Scholar
- Pew R.W. and Mavor, A.S. editors. Modelling Human and Organizational Behaviour: Application to Military Simulations. National Academy Press, Wash., D.C. 1998.]]Google Scholar
- Ryder, J.M., Weiland, M.Z., Szczepkowski, M.A., & Zachary, W.W. Cognitive engineering of a new telephone operator workstation using COGNET. International Journal of Industrial Ergonomics 22, pp. 417--429, 1998.]]Google ScholarCross Ref
- Shinn-Cunningham, BG. Distance cues for virtual auditory space Proceedings of the IEEE 2000 International Symposium on Multimedia Information Processing. Sydney, Australia. December 2000.]]Google Scholar
- Shively, R. J., Brickner, M., Silbiger J., A Computational Model of Situational Awareness Instantiated in MIDAS 1997]]Google Scholar
- Takala, T. Hahn, J. Sound Rendering, Computer Graphics, proceedings, SIGGRAPH '92, Vol 26, No 2, July 92, ACM Press. 1992.]] Google ScholarDigital Library
- Terzopoulos D. and Rabie, T.F. Animat Vision: Active Vision in Artificial Animals. Published in Videre: Journal of Computer Vision Research, 1(1):2--19, 1997.]]Google Scholar
- Terzopoulos D., Tu X. and Grzeszczuk, R. Artificial fishes: Autonomous locomotion, perception, behavior, and learning in a simulated physical world. Journal of Artificial Life, 1, 4, 1994.]]Google Scholar
- Thalmann, D. The Foundations to Build a Virtual Human Society. Proc. Intelligent Virtual Actors (IVA'01), Madrid, Spain. 2001]] Google ScholarDigital Library
- Thalmann, D. Virtual Sensors: A Key Tool for the Artificial Life of Virtual Actors. Proc. Pacific Graphics `95, Seoul, Korea. 1995.]]Google Scholar
- Tu X. and Terzopoulos D., Artificial Fishes: Physics, Locomotion, Perception, Behaviour. Computer Graphics Proceedings of SIGGRAPH 94, pp 43--50, 1994.]] Google ScholarDigital Library
- Zahorik, P. Assessing auditory distance perception using virtual acoustics J. Acoust. Soc. Am., 111, 1832--1846. 2002]]Google ScholarCross Ref
- Zahorik, P. Estimating sound source distance with and without vision Optom. Vis. Sci., 78, 270--275. 2001]]Google ScholarCross Ref
- Zahorik, P., and Wightman, F. L. Loudness constancy with varying sound source distance. Nat. Neurosci., 4, 78--83. 2001.]]Google ScholarCross Ref
Index Terms
- Introducing human-like hearing perception in intelligent virtual agents
Recommendations
Increasing the coherence between human beings and virtual agents
AAMAS '02: Proceedings of the first international joint conference on Autonomous agents and multiagent systems: part 1The importance of an awareness model for a CSCW Environment has been underwritten by many studies and much interesting research has been undertaken in this research area. On the other hand, it is fundamental for an agent to have "knowledge" about its ...
Modelling the Sensory Abilities of Intelligent Virtual Agents
An important property of Intelligent Virtual Agents (IVAs) is their capability to acquire/perceive information from their environment. Bearing in mind some studies on situational awareness --- where sensitive perception can be understood as the first ...
Intelligent virtual agents keeping watch in the battlefield
One of the first areas where virtual reality found a practical application was military training. Two fairly obvious reasons have driven the military to explore and employ this kind of technique in their training; to reduce exposure to hazards and to ...
Comments