skip to main content
10.1145/2675743.2776765acmconferencesArticle/Chapter ViewAbstractPublication PagesdebsConference Proceedingsconference-collections
short-paper

StreamPipes: solving the challenge with semantic stream processing pipelines

Published: 24 June 2015 Publication History

Abstract

We present StreamPipes, a semantics-based approach aiming to provide a description and management layer to define and execute stream processing pipelines consisting of multiple, potentially heterogeneous runtime implementations. StreamPipes consists of i) an ontology-based model to describe requirements and capabilities of stream processing services, (ii) a software development kit to describe and publish existing event patterns according to the StreamPipes protocol, (iii) a matchmaking engine to compute matchings between streams, event processing agents and actuators and (iv) a web-based authoring tool to model pipelines in a drag-and-drop style. We implemented the solution to the 2015 DEBS Grand Challenge with StreamPipes using two underlying open source frameworks as runtime implementations. Our approach decouples event pattern descriptions from their specific implementations and therefore facilitates reuse of implemented stream processing elements in multiple pipelines without any further development effort.

References

[1]
Z. Jerzak and H. Ziekow. The DEBS 2015 Grand Challenge. In DEBS 2015: the 9th ACM International Conference on Distributed Event-Based Systems, June 2015.
[2]
D. Riemer, L. Stojanovic, and N. Stojanovic. Sepp: Semantics-based management of fast data streams. In Service-Oriented Computing and Applications (SOCA), 2014 IEEE 7th International Conference on, pages 113--118. IEEE, 2014.
[3]
D. Riemer, N. Stojanovic, and L. Stojanovic. A methodology for designing events and patterns in fast data processing. In Advanced Information Systems Engineering, pages 133--148. Springer, 2013.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
DEBS '15: Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems
June 2015
385 pages
ISBN:9781450332866
DOI:10.1145/2675743
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2015

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Short-paper

Funding Sources

  • European Community

Conference

DEBS '15

Acceptance Rates

Overall Acceptance Rate 145 of 583 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)4
  • Downloads (Last 6 weeks)0
Reflects downloads up to 16 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)A visual programming framework for distributed Internet of Things centric complex event processingComputers and Electrical Engineering10.1016/j.compeleceng.2018.02.00774:C(581-604)Online publication date: 18-Apr-2022
  • (2021)Prototyping Machine-Learning-Supported Lead Time Prediction Using AutoMLProcedia Computer Science10.1016/j.procs.2021.01.287180(649-655)Online publication date: 2021
  • (2020)StreamPipes Connect: Semantics-Based Edge Adapters for the IIoTThe Semantic Web10.1007/978-3-030-49461-2_39(665-680)Online publication date: 27-May-2020
  • (2019)Intelligent edge processingMachine Learning for Cyber Physical Systems10.1007/978-3-662-59084-3_5(35-42)Online publication date: 10-Apr-2019
  • (2018)Lambda-Blocks: Data Processing with Topologies of Blocks2018 IEEE International Congress on Big Data (BigData Congress)10.1109/BigDataCongress.2018.00009(9-16)Online publication date: Jul-2018
  • (2018)A Proactive Model for Joint Maintenance and Logistics Optimization in the Frame of Industrial Internet of ThingsOperational Research in the Digital Era – ICT Challenges10.1007/978-3-319-95666-4_3(23-45)Online publication date: 28-Sep-2018
  • (2018)The ProaSense Platform for Predictive Maintenance in the Automotive Lighting Equipment IndustryEnterprise Interoperability10.1002/9781119564034.ch30(247-253)Online publication date: 26-Oct-2018
  • (2017)Information Processing for Generating Recommendations Ahead of Time in an IoT-Based EnvironmentInternational Journal of Monitoring and Surveillance Technologies Research10.4018/IJMSTR.20171001035:4(38-62)Online publication date: 1-Oct-2017
  • (2017)Cost-Aware Streaming Workflow Allocation on Geo-Distributed Data CentersIEEE Transactions on Computers10.1109/TC.2016.259557966:2(256-271)Online publication date: 1-Feb-2017
  • (2017)An information system for deciding and acting ahead of time in sensing enterprises2017 8th International Conference on Information, Intelligence, Systems & Applications (IISA)10.1109/IISA.2017.8316372(1-6)Online publication date: Aug-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media