Wrapping Rings in Lattices: An Algebraic Symbiosis of Incremental View Maintenance and Eventual Consistency
Authors: 
Conor Power, Saikrishna Achalla, Ryan Cottone, Nathaniel Macasaet, 
Joseph M. HellersteinAuthors Info & Claims
Conor Power, Saikrishna Achalla, Ryan Cottone, Nathaniel Macasaet, Joseph M. HellersteinAuthors Info & ClaimsPages 15 - 22
Abstract
We reconcile the use of semi-lattices in CRDTs and the use of groups and rings in incremental view maintenance to construct systems with strong eventual consistency, incremental computation, and database query optimization.
References
[1]
Serge Abiteboul, Richard Hull, and Victor Vianu. 1995. Foundations of databases. Vol. 8. Addison-Wesley Reading.
[2]
Mahmoud Abo Khamis, Hung Q Ngo, Reinhard Pichler, Dan Suciu, and Yisu Remy Wang. 2022. Convergence of datalog over (pre-) semirings. In Proceedings of the 41st ACM SIGMOD-SIGACT-SIGAI Symposium on Principles of Database Systems. 105--117.
[3]
Divyakant Agrawal, Amr El Abbadi, Achour Mostéfaoui, Michel Raynal, and Matthieu Roy. 2002. The lord of the rings: Efficient maintenance of views at data warehouses. In Distributed Computing: 16th International Conference, DISC 2002 Toulouse, France, October 28--30, 2002 Proceedings 16. Springer, 33--47.
[4]
AWS. 2021. Refreshing a Materialized View. https://docs.aws.amazon.com/redshift/latest/dg/materialized-view-refresh.html.
[5]
Eric Brewer. 2012. CAP twelve years later: How the" rules" have changed. Computer 45, 2 (2012), 23--29.
[6]
Manfred Broy, Martin Wirsing, and Peter Pepper. 1987. On the algebraic definition of programming languages. ACM Transactions on Programming Languages and Systems (TOPLAS) 9, 1 (1987), 54--99.
[7]
Mihai Budiu. 2024. Incremental Database Computations. https://www.feldera.com/blog/incremental-database-computations/.
[8]
Mihai Budiu, Frank McSherry, Leonid Ryzhyk, and Val Tannen. 2022. DBSP: Automatic incremental view maintenance for rich query languages. arXiv preprint arXiv:2203.16684 (2022).
[9]
Alvin Cheung, Natacha Crooks, Joseph M Hellerstein, and Matthew Milano. 2021. New directions in cloud programming. arXiv preprint arXiv:2101.01159 (2021).
[10]
Rada Chirkova, Jun Yang, et al. 2012. Materialized views. Foundations and Trends® in Databases 4, 4 (2012), 295--405.
[11]
David Steven Dummit and Richard M Foote. 2004. Abstract algebra. Vol. 3. Wiley Hoboken.
[12]
Iman Elghandour, Ahmet Kara, Dan Olteanu, and Stijn Vansummeren. 2018. Incremental techniques for large-scale dynamic query processing. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 2297--2298.
[13]
Craig Gentry. 2009. Fully homomorphic encryption using ideal lattices. In Proceedings of the forty-first annual ACM symposium on Theory of computing. 169--178.
[14]
Todd J Green, Grigoris Karvounarakis, and Val Tannen. 2007. Provenance semirings. In Proceedings of the twenty-sixth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems. 31--40.
[15]
Richard Hull and Gang Zhou. 1996. A framework for supporting data integration using the materialized and virtual approaches. In Proceedings of the 1996 ACM SIGMOD international conference on Management of data. 481--492.
[16]
Ahmet Kara, Hung Q Ngo, Milos Nikolic, Dan Olteanu, and Haozhe Zhang. 2020. Maintaining triangle queries under updates. ACM Transactions on Database Systems (TODS) 45, 3 (2020), 1--46.
[17]
Jeremy Kepner, Peter Aaltonen, David Bader, Aydin Buluç, Franz Franchetti, John Gilbert, Dylan Hutchison, Manoj Kumar, Andrew Lumsdaine, Henning Meyerhenke, et al. 2016. Mathematical foundations of the GraphBLAS. In 2016 IEEE High Performance Extreme Computing Conference (HPEC). IEEE, 1--9.
[18]
Christoph Koch, Yanif Ahmad, Oliver Kennedy, Milos Nikolic, Andres Nötzli, Daniel Lupei, and Amir Shaikhha. 2014. DBToaster: higher-order delta processing for dynamic, frequently fresh views. The VLDB Journal 23 (2014), 253--278.
[19]
Jessica Laughlin. 2020. Why use a Materialized View? https://materialize.com/blog/why-use-a-materialized-view/.
[20]
Derek G Murray, Frank McSherry, Michael Isard, Rebecca Isaacs, Paul Barham, and Martin Abadi. 2016. Incremental, iterative data processing with timely dataflow. Commun. ACM 59, 10 (2016), 75--83.
[21]
Milos Nikolic, Haozhe Zhang, Ahmet Kara, and Dan Olteanu. 2020. F-IVM: learning over fast-evolving relational data. In Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data. 2773--2776.
[22]
Yannis Papakonstantinou Nitin Sharma Andreas Neumann Paul Lappas, Michael Armbrust. 2023. Introducing Materialized Views and Streaming Tables for Databricks SQL. https://www.databricks.com/blog/introducing-materialized-views-and-streaming-tables-databricks-sql.
[23]
Nuno Preguiça. 2018. Conflict-free Replicated Data Types: An Overview. arXiv e-prints (2018), arXiv-1806.
[24]
Nuno Preguiça, Carlos Baquero, and Marc Shapiro. 2018. Conflict-free replicated data types (CRDTs). arXiv preprint arXiv:1805.06358 (2018).
[25]
Ronald L Rivest, Adi Shamir, and Leonard Adleman. 1978. A method for obtaining digital signatures and public-key cryptosystems. Commun. ACM 21, 2 (1978), 120--126.
[26]
Marc Shapiro, Nuno Preguiça, Carlos Baquero, and Marek Zawirski. 2011. A comprehensive study of convergent and commutative replicated data types. In Technical Report, Inria-Centre Paris-Rocquencourt; INRIA.
[27]
Marc Shapiro, Nuno Preguiça, Carlos Baquero, and Marek Zawirski. 2011. Conflict-free replicated data types. In Symposium on Self-Stabilizing Systems. Springer, 386--400.
[28]
Sindhu Subhas. 2021. Hive - Materialized Views. https://techcommunity.microsoft.com/t5/analytics-on-azure-blog/hive-materialized-views/ba-p/2502785.
[29]
Albert van der Linde, João Leitão, and Nuno Preguiça. 2016. δ-crdts: Making δ-crdts delta-based. In Proceedings of the 2nd Workshop on the Principles and Practice of Consistency for Distributed Data. 1--4.
[30]
Chenggang Wu, Jose M Faleiro, Yihan Lin, and Joseph M Hellerstein. 2019. Anna: A kvs for any scale. IEEE Transactions on Knowledge and Data Engineering 33, 2 (2019), 344--358.
[31]
Chenggang Wu, Vikram Sreekanti, and Joseph M Hellerstein. 2019. Autoscaling tiered cloud storage in Anna. Proceedings of the VLDB Endowment 12, 6 (2019), 624--638.
[32]
Yue Zhuge, Hector Garcia-Molina, Joachim Hammer, and Jennifer Widom. 1995. View maintenance in a warehousing environment. In Proceedings of the 1995 ACM SIGMOD international conference on Management of data. 316--327.
[33]
Yue Zhuge, Hector Garcia-Molina, and Janet L Wiener. 1996. The strobe algorithms for multi-source warehouse consistency. In Fourth International Conference on Parallel and Distributed Information Systems. IEEE, 146--157.
[34]
Ling Zhuo and Viktor K Prasanna. 2005. High performance linear algebra operations on reconfigurable systems. In SC'05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing. IEEE, 2--2.
Recommendations
Constraining the eventual in eventual consistency
PaPoC '18: Proceedings of the 5th Workshop on the Principles and Practice of Consistency for Distributed DataCRDTs are highly available replicated data structures which offer strong eventual consistency in the face of concurrent operations [3]. By their definition, CRDTs eventually converge to a consistent state given enough time. However, this is not strict ...
The Weakest Failure Detector for Eventual Consistency
PODC '15: Proceedings of the 2015 ACM Symposium on Principles of Distributed ComputingIn its classical form, a consistent replicated service requires all replicas to witness the same evolution of the service state. Assuming a message-passing environment with a majority of correct processes, the necessary and sufficient information about ...
Strong eventual consistency of the collaborative editing framework WOOT
AbstractCommutative Replicated Data Types (CRDTs) are a promising new class of data structures for large-scale shared mutable content in applications that only require eventual consistency. The WithOut Operational Transforms (WOOT) framework is the first ...
Comments
Information & Contributors
Information
Published In
April 2024
69 pages
ISBN:9798400705441
DOI:10.1145/3642976
This work is licensed under a Creative Commons Attribution International 4.0 License.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 April 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
PaPoC '24
Sponsor:
PaPoC '24: 11th Workshop on Principles and Practice of Consistency for Distributed Data
April 22, 2024
Athens, Greece
Acceptance Rates
Overall Acceptance Rate 34 of 47 submissions, 72%
Upcoming Conference
EuroSys '25
- Sponsor:
- sigops
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 716Total Downloads
- Downloads (Last 12 months)716
- Downloads (Last 6 weeks)59
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in