Mina Morcos
ABSTRACT
The DEBS Grand Challenge is an annual event in which different event-based systems compete to solve a real-world problem. For the year 2021, the challenge is computing information given air quality sensor data. Due to the pandemic many factories are forced to close down, and the aim is to find out the cities that have improved the most in air quality and cities that have achieved the longest sequence of good AQI values. This paper aims to solve the above challenges using Apache Flink, an open-source, unified stream-processing and batch-processing framework developed by the Apache Software Foundation.
- 2021. Source code on Github. https://github.com/842Mono/DEBS-2021-Group-15Google Scholar
- Paris Carbone, Stephan Ewen, Gyula Fóra, Seif Haridi, Stefan Richter, and Kostas Tzoumas. 2017. State management in Apache Flink®: consistent stateful distributed stream processing. Proceedings of the VLDB Endowment 10, 12 (2017), 1718--1729.Google ScholarDigital Library
- Paris Carbone, Asterios Katsifodimos, Stephan Ewen, Volker Markl, Seif Haridi, and Kostas Tzoumas. 2015. Apache flink: Stream and batch processing in a single engine. Bulletin of the IEEE Computer Society Technical Committee on Data Engineering 36, 4 (2015).Google Scholar
- Christoph Doblander, Sebastian Frischbier, Ruben Mayer, and Jawad Tahir. 2021. The DEBS 2021 Grand Challenge. In Proceedings of the 15th ACM International Conference on Distributed and Event-Based Systems (DEBS '21). Association for Computing Machinery, New York, NY, USA.Google Scholar
- F. Hueske and V. Kalavri. 2019. Stream Processing with Apache Flink: Fundamentals, Implementation, and Operation of Streaming Applications. O'Reilly Media, Incorporated. https://books.google.com/books?id=64GHAQAACAAJGoogle ScholarCross Ref
- Tilmann Rabl, Jonas Traub, Asterios Katsifodimos, and Volker Markl. 2016. Apache Flink in current research. it - Information Technology 58, 4 (2016), 157--165. https://doi.org/ Google ScholarCross Ref
- Open Data Stuttgart. 2021. https://sensor.community/en/Google Scholar
- Tarek Zaarour, Niki Pavlopoulou, Souleiman Hasan, Umair ul Hassan, and Edward Curry. 2017. Automatic Anomaly Detection over Sliding Windows: Grand Challenge. In Proceedings of the 11th ACM International Conference on Distributed and Event-Based Systems (Barcelona, Spain) (DEBS '17). Association for Computing Machinery, New York, NY, USA, 310--314. Google ScholarDigital Library
Index Terms
- Solving the 2021 DEBS grand challenge using Apache Flink
Recommendations
DEBS grand challenge: real-time detection of air quality improvement with Apache Flink
DEBS '21: Proceedings of the 15th ACM International Conference on Distributed and Event-based SystemsThe topic of the DEBS Grand Challenge 2021 is to develop a solution for detecting areas in which the air quality index (AQI) improved the most when compared to the previous year. The solution must run two given continuous queries in parallel on the ...
The DEBS 2012 grand challenge
DEBS '12: Proceedings of the 6th ACM International Conference on Distributed Event-Based SystemsThe goal of the DEBS Grand Challenge series is to contribute to the Event Processing Grand Challenge, that serves as a common goal and mechanism for coordinating research focusing on event processing. DEBS Grand Challenge series provides a common ground ...
The DEBS 2013 grand challenge
DEBS '13: Proceedings of the 7th ACM international conference on Distributed event-based systemsThe ACM DEBS 2013 Grand Challenge is the third in a series of challenges which seek to provide a common ground and evaluation criteria for a competition aimed at both research and industrial event-based systems. The goal of the Grand Challenge ...
Comments