Loading [MathJax]/extensions/tex2jax.js
A Framework for Decentralized Parallel Complex Event Processing on Heterogeneous Infrastructures | IEEE Conference Publication | IEEE Xplore

A Framework for Decentralized Parallel Complex Event Processing on Heterogeneous Infrastructures

Publisher: IEEE

Abstract:

Low-latency stream processing applications (SPA) distribute the event streams on parallel instances of the application’s operators to avoid queuing. Each operator has a s...View more

Abstract:

Low-latency stream processing applications (SPA) distribute the event streams on parallel instances of the application’s operators to avoid queuing. Each operator has a set of processing nodes for its instances. Edge and fog infrastructures promise, among other things, low communication latency and are thus of interest for low-latency SPAs. Yet, they include heterogeneous, even volatile nodes which makes the parallel processing of SPAs challengingAvailable solutions for parallel SPAs often assume homogeneity and stable infrastructures.Thus, we aim to balance the stream processing among heterogeneous, instable infrastructures using a decentralized control mechanism. We propose a decentralized, dynamic, and lightweight approach to re-balance SPA-load according to the nodes current performance, while minimizing latencies. In doing so, we introduce the Coda-EFC framework for window-based stream processing on heterogeneous distributed infrastructures. It dynamically adapts its load balancing to node performance without computing quickly outdated schedules and aims for latency-optimal load balancing. We introduce two adaptive load balancing strategiesone tailored for heterogeneous, dynamic infrastructures, the other an adaptation of a state-of-the art approach.
Date of Conference: 15-18 December 2021
Date Added to IEEE Xplore: 13 January 2022
ISBN Information:
Publisher: IEEE
Conference Location: Orlando, FL, USA

References

References is not available for this document.