Dominik Riemer
ABSTRACT
We present StreamPipes, a semantics-based approach aiming to provide a description and management layer to define and execute stream processing pipelines consisting of multiple, potentially heterogeneous runtime implementations. StreamPipes consists of i) an ontology-based model to describe requirements and capabilities of stream processing services, (ii) a software development kit to describe and publish existing event patterns according to the StreamPipes protocol, (iii) a matchmaking engine to compute matchings between streams, event processing agents and actuators and (iv) a web-based authoring tool to model pipelines in a drag-and-drop style. We implemented the solution to the 2015 DEBS Grand Challenge with StreamPipes using two underlying open source frameworks as runtime implementations. Our approach decouples event pattern descriptions from their specific implementations and therefore facilitates reuse of implemented stream processing elements in multiple pipelines without any further development effort.
- Z. Jerzak and H. Ziekow. The DEBS 2015 Grand Challenge. In DEBS 2015: the 9th ACM International Conference on Distributed Event-Based Systems, June 2015. Google Scholar
Digital Library
- D. Riemer, L. Stojanovic, and N. Stojanovic. Sepp: Semantics-based management of fast data streams. In Service-Oriented Computing and Applications (SOCA), 2014 IEEE 7th International Conference on, pages 113--118. IEEE, 2014. Google ScholarDigital Library
- D. Riemer, N. Stojanovic, and L. Stojanovic. A methodology for designing events and patterns in fast data processing. In Advanced Information Systems Engineering, pages 133--148. Springer, 2013. Google ScholarDigital Library
Index Terms
- StreamPipes: solving the challenge with semantic stream processing pipelines
Recommendations
Managing geo-distributed stream processing pipelines for the IIoT with StreamPipes edge extensions
DEBS '20: Proceedings of the 14th ACM International Conference on Distributed and Event-based SystemsThe industrial IoT and its promise to realize data-driven decision-making by analyzing industrial event streams is an important innovation driver in the industrial sector. Due to an enormous increase of generated data and the development of specialized ...
Study On Purchase Intention In Different Live Streaming Scenarios Based On Experimental Approach
ICEBI '22: Proceedings of the 2022 6th International Conference on E-Business and InternetLive streaming e-commerce has exploded recently. While the live streaming traffic is dominated by the top live streamers, merchants and ordinary live streamers attempt to establish self-operating live streaming, but the number of fans and sales ...
Event-based lossy compression for effective and efficient OLAP over data streams
An innovative event-based lossy compression model for effective and efficient OLAP over data streams, called ECM-DS, is presented and experimentally assessed in this paper. The main novelty of our compression approach with respect to traditional data ...
Comments