Recognizing and Discovering Complex Events in Sequences

Abstract

Finding complex patterns in long temporal or spatial sequences from real world applications is gaining increasing interest in data mining. However, standard data mining techniques, taken in isolation, seem to be inadequate to cope with such a task. In fact, symbolic approaches show difficulty in dealing with noise, while non-symbolic approaches, such as neural networks and statistics show difficulty in dealing with very long subsequences where relevant episodes may be interleaved with large gaps. The way out we suggest is to integrate the logic approach with non-symbolic methods in a unified paradigm, as it has been already done in other Artificial Intelligence tasks. We propose a framework where a high level knowledge representation is used to incorporate domain specific knowledge, to focus the attention on relevant episodes during the mining process, and flexible matching algorithms developed in the pattern recognition area are used to deal with noisy data. The knowledge extraction process follows a machine learning paradigm combining inductive and deductive learning, where deduction steps can be interleaved with induction steps aimed at augmenting a weak domain theory with knowledge extracted from the data. Our framework is formally characterized and then is experimentally tested on an artificial dataset showing its ability at dealing with noise and with the presence of long gaps between the relevant episodes.