Christoffer Löffler
ABSTRACT
Event-Based Systems (EBS) can efficiently analyze large streams of sensor data in near-realtime. But they struggle with noise or incompleteness that is seen in the unprecedented amount of data generated by the Internet of Things.
We present a generic approach that deals with uncertain data in the middleware layer of distributed event-based systems and is hence transparent for developers. Our approach calculates alternative paths to improve the overall result of the data analysis. It dynamically generates, updates, and evaluates Bayesian Networks based on probability measures and rules defined by developers. An evaluation on position data shows that the improved detection rate justifies the computational overhead.
- M. Stonebraker, U. Çetintemel, and S. Zdonik, "The 8 requirements of real-time stream processing," SIGMOD Rec., vol. 34, no. 4, pp. 42--47, 2005. Google Scholar
Digital Library
- C. Mutschler and M. Philippsen, "Learning event detection rules with noise hidden markov models," in NASA/ESA Conf. Adaptive Hardware and Systems, (Nuremberg, Germany), pp. 159--166, 2012.Google Scholar
- A. Skarlatidis, G. Paliouras, G. Vouros, and A. Artikis, "Probabilistic event calculus based on markov logic networks," in RuleML America, pp. 155--170, Springer, Berlin, 2011. Google ScholarDigital Library
- S. Wasserkrug, A. Gal, and O. Etzion, "A model for reasoning with uncertain rules in event composition systems," in 21st Conf. Uncertainty in Artificial Intelligence, (Edinburgh, Scotland), pp. 699--606, 2005.Google Scholar
- S. Wasserkrug, A. Gal, O. Etzion, and Y. Turchin, "Efficient processing of uncertain events in rule-based systems," IEEE Trans. Knowledge and Data Engineering, vol. 24, no. 1, pp. 45--58, 2012. Google ScholarDigital Library
- T. Bouaziz and A. Wolski, "Applying fuzzy events to approximate reasoning in active databases," in 6th Intl. Conf. Fuzzy Systems, (Barcelona, Spain), pp. 729--735, 1997.Google Scholar
- N. Dalvi and D. Suciu, "Efficient query evaluation on probabilistic databases," in 30th VLDB Conf., (Toronto, Canada), pp. 523--544, 2004. Google ScholarDigital Library
- O. Benjelloun, A. D. Sarma, A. Halevy, and J. Widom, "Uldbs: Databases with uncertainty and lineage," in 32nd VLDB Conf., (Seoul, Korea), pp. 953--964, 2006. Google ScholarDigital Library
- D. Gyllstrom, E. Wu, H. Chae, Y. Diao, P. Stahlberg, and G. Anderson, "Sase: Complex event processing over streams," in 3rd Conf. Innovative Data Systems Research, (Asilomar, CA), 2007.Google Scholar
- G. Koch, B. Koldehofe, and K. Rothermel, "Quality-aware event correlation detection," Tech. Rep. TR-2012-06, Univ. of Stuttgart, Germany, 2012.Google Scholar
- H. Kawashima, H. Kitagawa, and X. Li, "Complex event processing over uncertain data streams," in 2010 Intl. Conf. Parallel, Grid, Cloud and Internet Computing, (Fukuoka, Japan), pp. 521--526, 2010. Google ScholarDigital Library
- Z. Shen, H. Kawashima, and H. Kitagawa, "Efficient probabilistic event stream processing with lineage and kleene-plus," Int. J. Commun. Netw. Distrib. Syst., vol. 2, no. 4, pp. 355--374, 2009. Google ScholarDigital Library
- Z. Li, T. Ge, and C. X. Chen, ε-matching: Event processing over noisy sequences in real time," in Intl. Conf. Management of Data, (New York, NY), pp. 601--612, 2013. Google ScholarDigital Library
Index Terms
- Approximative event processing on sensor data streams
Recommendations
Processing real-time sensor data streams for 3D web visualization
IWGS '14: Proceedings of the 5th ACM SIGSPATIAL International Workshop on GeoStreamingToday, myriads of sensors are surrounding us. Their usage ranges from environmental monitoring (e.g., weather and air quality), over sensor-equipped smart buildings, to the quantified self and other human observing applications. The data streams ...
Cost analysis for complex in-network event processing in heterogeneous wireless sensor networks
DEBS '11: Proceedings of the 5th ACM international conference on Distributed event-based systemComplex event processing requires events to be integrated from multiple sources. In heterogeneous Wireless Sensor Networks, this integration is performed at powerful gateway nodes, requiring continuous communication among sensor nodes and with gateway ...
Complex Event Processing over Uncertain Data Streams
3PGCIC '10: Proceedings of the 2010 International Conference on P2P, Parallel, Grid, Cloud and Internet ComputingPattern matching over event streams is well developed. However, with the increasing demand of measurement accuracy, confidence of more complex events sourced from original, continuously arriving events generated from sensor kind electronic devices is ...
Comments