Reference Hub2
A Cached-Based Stream-Relation Join Operator for Semi-Stream Data Processing

A Cached-Based Stream-Relation Join Operator for Semi-Stream Data Processing

M. Asif Naeem, Imran Sarwar Bajwa, Noreen Jamil
Copyright: © 2016 |Volume: 12 |Issue: 3 |Pages: 18
ISSN: 1548-3924|EISSN: 1548-3932|EISBN13: 9781466689268|DOI: 10.4018/IJDWM.2016070102
Cite Article Cite Article

MLA

Naeem, M. Asif, et al. "A Cached-Based Stream-Relation Join Operator for Semi-Stream Data Processing." IJDWM vol.12, no.3 2016: pp.14-31. http://doi.org/10.4018/IJDWM.2016070102

APA

Naeem, M. A., Bajwa, I. S., & Jamil, N. (2016). A Cached-Based Stream-Relation Join Operator for Semi-Stream Data Processing. International Journal of Data Warehousing and Mining (IJDWM), 12(3), 14-31. http://doi.org/10.4018/IJDWM.2016070102

Chicago

Naeem, M. Asif, Imran Sarwar Bajwa, and Noreen Jamil. "A Cached-Based Stream-Relation Join Operator for Semi-Stream Data Processing," International Journal of Data Warehousing and Mining (IJDWM) 12, no.3: 14-31. http://doi.org/10.4018/IJDWM.2016070102

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Stream-based join algorithms got a prominent role in the field of real-time data warehouses. One particular type of stream-based joins is a semi-stream join where a single stream is joined with a disk -based relation. Normally the size of this disk-based relation is large enough and cannot be fit into memory, available for join operator. Therefore, the relation is loaded into memory in partitions. A well-known join algorithm called MESHJOIN (Mesh Join) has been presented in the literature to process semi-stream data. However, the algorithm has some limitations. In particular, MESHJOIN does not consider the characteristics of stream data and therefore does not perform well for skewed stream data. This article introduces the concept of caching and based on that presents a novel algorithm called Cached-based Stream-Relation Join (CSRJ). The algorithm exploits skewed distributions more appropriately, and the authors present results for Zipfian distributions of the type that appear in many applications. They test their algorithm using synthetic, TPC-H and real datasets. Their experiments show that CSRJ forms significantly better than MESHJOIN. They also drive the cost model for their algorithm and based on that they tune the algorithm.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.