Dominik Fisch
Abstract
Intelligent agents often have the same or similar tasks and sometimes they cooperate to solve a given problem. These agents typically know how to observe their local environment and how to react on certain observations, for instance, and this knowledge may be represented in form of rules. However, many environments are dynamic in the sense that from time to time novel rules are required or old rules become obsolete. In this article we propose and investigate new techniques for knowledge acquisition by novelty detection and reaction as well as obsoleteness detection and reaction that an agent may use for self-adaptation to new situations. For that purpose we consider classifiers based on probabilistic rules. Premises of new rules are learned autonomously while conclusions are either obtained from human experts or from other agents which have learned appropriate rules in the past. By means of knowledge exchange, agents will efficiently be enabled to cope with situations they were not confronted with before. This kind of collaborative intelligence follows the human archetype: Humans are able to learn from each other by communicating learned rules. We demonstrate some properties of the knowledge acquisition techniques using artificial data as well as data from the field of intrusion detection.
- Aggarwal, C. C., Han, J., Wang, J., and Yu, P. S. 2003. A framework for clustering evolving data streams. In Proceedings of the 29th International Conference on Very Large Data Bases. 81--92. Google Scholar
Digital Library
- Andrade, D., Horeis, T., and Sick, B. 2008. Knowledge fusion using Dempster-Shafer theory and the imprecise Dirichlet model. In Proceedings of the IEEE Conference on Soft Computing in Industrial Applications (SMCia). 142--148.Google Scholar
- Bishop, C. M. 2006. Pattern Recognition and Machine Learning. Springer, New York. Google ScholarDigital Library
- Buchtala, O., Hofmann, A., and Sick, B. 2003. Fast and efficient training of RBF networks. In Artificial Neural Networks and Neural Information Processing -- ICANN/ICONIP 2003 (Joint International Conference), O. Kaynak, E. Alpaydin, E. Oja, and L. Xu, Eds. Lecture Notes in Computer Science, vol. 2714. Springer, 43--51. Google ScholarDigital Library
- Buchtala, O. and Sick, B. 2007. Functional knowledge exchange within an intelligent distributed system. In Architecture of Computing Systems -- ARCS 2007, P. Lukowicz, L. Thiele, and G. Tröster, Eds. Lecture Notes in Computer Science, vol. 4415. Springer, 126--141. Google ScholarDigital Library
- Cateni, S., Colla, V., and Vannucci, M. 2008. Outlier detection methods for industrial applications. In Advances in Robotics, Automation and Control, J. Aramburo and A. R. Trevino, Eds. IN-TECH, 265--282.Google Scholar
- Clifton, D., Bannister, P., and Tarassenko, L. 2007. A framework for novelty detection in jet engine vibration data. Key Engin. Mater. 347, 305--312.Google ScholarCross Ref
- Costantini, S. and Tocchio, A. 2005. Learning by knowledge exchange in logical agents. In 6th AI*IA/TABOO Joint Workshop “From Objects to Agents”. 1--8.Google Scholar
- Declercq, A. and Piater, J. H. 2008. Online learning of gaussian mixture models: A two-level approach. In Proceedings of the 3rd International Conference on Computer Vision Theory and Applications. Vol. 1. 605--611.Google Scholar
- Duda, R. O., Hart, P. E., and Stork, D. G. 2001. Pattern Classification. John Wiley & Sons, Chichester, New York. Google ScholarDigital Library
- Fisch, D., Hofmann, A., Hornik, V., Dedinski, I., and Sick, B. 2008. A framework for large-scale simulation of collaborative intrusion detection. In Proceedings of the IEEE Conference on Soft Computing in Industrial Applications. 125--130.Google Scholar
- Fisch, D., Hofmann, A., and Sick, B. 2010a. On the versatility of radial basis function neural networks: A case study in the field of intrusion detection. Inf. Sci. 180, 12, 2421--2439. Google ScholarDigital Library
- Fisch, D., Jänicke, M., Kalkowski, E., and Sick, B. 2009. Learning by teaching versus learning by doing: Knowledge exchange in organic agent systems. In Proceedings of the IEEE Symposium on Intelligent Agents (IA '09). 31--38.Google Scholar
- Fisch, D., Kühbeck, B., Sick, B., and Ovaska, S. 2010b. So near and yet so far: New insight into the relationship between some well-known classifier paradigms. Inf. Sci. 180, 18, 3381--3401. Google ScholarDigital Library
- Fisch, D. and Sick, B. 2009. Training of radial basis function classifiers with resilient propagation and variational Bayesian inference. In Proceedings of the International Joint Conference on Neural Networks (IJCNN '09). 838--847. Google ScholarDigital Library
- Hettich, S. and Bay, S. D. 1999. The UCI KDD archive. http://kdd.ics.uci.edu.Google Scholar
- Hickinbotham, S. J. and Austin, J. 2000. Neural networks for novelty detection in airframe strain data. In Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN). Vol. 6. 375--380. Google ScholarDigital Library
- Hofmann, A. and Sick, B. 2010. On-Line intrusion alert aggregation with generative data stream modeling. IEEE Trans. Depend. Secure Comput. http://doi.ieeecomputersociety.org/10.1109/TDSC.2009.36). Google ScholarDigital Library
- Jakob, M., Tozicka, J., and Pechoucek, M. 2007. Collaborative learning with logic-based models. In Adaptive Agents and Multi-Agents Systems, K. Tuyls, A. Nowe, Z. Guessoum, and D. Kudenko, Eds., Lecture Notes in Computer Science, vol. 4865. Springer, 102--116. Google ScholarDigital Library
- Lauer, M. 2001. A mixture approach to novelty detection using training data with outliers. In Proceedings of the 12th European Conference on Machine Learning (EMCL), L. D. Raedt and P. Flach, Eds. 300--311. Google ScholarDigital Library
- Lee, H.-j. and Roberts, S. 2008. On-Line novelty detection using kalman filters and extreme value theory. In Proceedings of the 19th International Conference on Pattern Recognition (ICPR '08). 1--4.Google Scholar
- Markou, M. and Singh, S. 2003a. Novelty detection: A review -- Part 1: Statistical approaches. Signal Process. 83, 12, 2481--2497. Google ScholarDigital Library
- Markou, M. and Singh, S. 2003b. Novelty detection: A review -- Part 2: Neural network based approaches. Signal Process. 83, 12, 2499--2521. Google ScholarDigital Library
- Mnif, M. and Müller-Schloer, C. 2006. Quantitative emergence. In Proceedings of the IEEE Mountain Workshop on Adaptive and Learning Systems. 78--84.Google Scholar
- Pollard, D. 2002. A User's Guide to Measure Theoretic Probability. Cambridge University Press.Google Scholar
- Roberts, S. 1999. Novelty detection using extreme value statistics. IEEE Proc. Vis. Image Signal Process. 146, 3, 124--129.Google ScholarCross Ref
- Song, M. and Wang, H. 2005. Highly efficient incremental estimation of gaussian mixture models for online data stream clustering. In Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, K. L. Priddy, Ed. Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series Series, vol. 5803. 174--183.Google Scholar
- Stauffer, C. and Grimson, W. 1999. Adaptive background mixture models for real-time tracking. In Proceedings IEEE Computer Society Conference on Computer Vision and Pattern. Vol. 2. 246--252.Google Scholar
- Tan, M. 1997. Multi-Agent reinforcement learning: Independent vs. cooperative agents. Read. Agents, 487--494. Google ScholarDigital Library
- Weiss, C. and Zell, A. 2008. Novelty detection and online learning for vibration-based terrain classification. In Proceedings of the 10th International Conference on Intelligent Autonomous Systems (IAS). 16--25.Google Scholar
- Würtz, R. P., Ed. 2008. Organic Computing. Understanding Complex Systems. Springer. Google ScholarDigital Library
- Yamanishi, K., Takeuchi, J.-I., Williams, G., and Milne, P. 2004. On-Line unsupervised outlier detection using finite mixtures with discounting learning algorithms. Data Min. Knowl. Discov. 8, 3, 275--300. Google ScholarDigital Library
- Zhou, A., Cao, F., Yan, Y., Sha, C., and He, X. 2007. Distributed data stream clustering: A fast em-based approach. In Proceedings of the IEEE 23rd International Conference on Data Engineering. 736--745.Google Scholar
Index Terms
- Techniques for knowledge acquisition in dynamically changing environments
Recommendations
Knowledge acquisition for knowledge-based engineering systems
This paper is essentially concerned with the development of formal representations of knowledge required prior to the development of knowledge-based engineering systems (KBESs). Initially, the paper provides a brief introduction to knowledge-based ...
Integrating machine learning with knowledge acquisition through direct interaction with domain experts
Knowledge elicitation from experts and empirical machine learning are two distinct approaches to knowledge acquisition with differing and mutually complementary capabilities. Learning apprentices have provided environments in which a knowledge engineer ...
Theoretical basis for hierarchical incremental knowledge acquisition
Human experts tend to introduce intermediate terms in giving their explanations. The expert's explanation of such terms is operational for the context that triggered the explanation; however, term definitions remain often incomplete. Further, the expert'...
Comments