Welcome to the InfoSci Platform
Reference Hub11
Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing

Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing

Tho Manh Nguyen, Peter Brezany, A. Min Tjoa, Edgar Weippl
Copyright: © 2005 |Volume: 1 |Issue: 4 |Pages: 34
ISSN: 1548-3924|EISSN: 1548-3932|ISSN: 1548-3924|EISBN13: 9781615202140|EISSN: 1548-3924|DOI: 10.4018/jdwm.2005100102
Cite Article Cite Article

MLA

Nguyen, Tho Manh, et al. "Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing." IJDWM vol.1, no.4 2005: pp.22-55. http://doi.org/10.4018/jdwm.2005100102

APA

Nguyen, T. M., Brezany, P., Tjoa, A. M., & Weippl, E. (2005). Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing. International Journal of Data Warehousing and Mining (IJDWM), 1(4), 22-55. http://doi.org/10.4018/jdwm.2005100102

Chicago

Nguyen, Tho Manh, et al. "Toward a Grid-Based Zero-Latency Data Warehousing Implementation for Continuous Data Streams Processing," International Journal of Data Warehousing and Mining (IJDWM) 1, no.4: 22-55. http://doi.org/10.4018/jdwm.2005100102

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Continuous data streams are information sources in which data arrives in high volume in unpredictable rapid bursts. Processing data streams is a challenging task due to (1) the problem of random access to fast and large data streams using present storage technologies and (2) the exact answers from data streams often being too expensive. A framework of building a Grid-based Zero-Latency Data Stream Warehouse (GZLDSWH) to overcome the resource limitation issues in data stream processing without using approximation approaches is specified. The GZLDSWH is built upon a set of Open Grid Service Infrastructure (OGSI)-based services and Globus Toolkit 3 (GT3) with the capability of capturing and storing continuous data streams, performing analytical processing, and reacting autonomously in near real time to some kinds of events based on a well-established knowledge base. The requirements of a GZLDSWH, its Grid-based conceptual architecture, and the operations of its service are described in this paper. Furthermore, several challenges and issues in building a GZLDSWH, such as the Dynamic Collaboration Model between the Grid services, the Analytical Model, and the Design and Evaluation aspects of the Knowledge Base Rules are discussed and investigated.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.