Abstract
This paper describes the implementation of a ScanOnce algorithm in SQL for quick association rule mining and the development of a data mining infrastructure JetGrid. The architecture of JetGrid is designed to be compatible with lower-level grid mechanisms since it is to operate on top of Relational Grid Monitoring Architecture (R-GMA) provided by European Data Grid (EDG). JetGrid for quick knowledge discovery was preliminarily prototyped and it is extensible, using an object-oriented design that was coded in C++. Mining agents will be staged to one or more computing elements on the EDG. They will mine data delivered using GridFTP and/or Globus transport mechanism. Some initial experimental results are presented, which provide some indication of the performance of the JetGrid data mining infrastructure on top of EDG.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Cannataro, M., Talia, D.: The knowledge grid. Communications of the ACM 46(1) (2003)
Foster, I., Kesselman, C.: Globus: A metacomputing infrastructure toolkit. Intl J. of Supercomputer Applications 11(2), 115–128 (1997)
Hinke, T., Novotny, J.: Data Mining on NASA’s Information Power Grid. In: Proc. of 9th IEEE International Symposium on High Performance Distributed Computing, Pittsburgh, August 1-4 (2000)
Manku, G., Motwani, R.: Approximate Frequency Counts over Data Streams. In: Proceedings of the 28th VLDB Conference, Hong Kong, China (2002)
Orlando, S., Palmerini, P., Perego, R., Silvestri, F.: Scheduling High Performance Data Mining Tasks on a Data Grid Environment. In: Proceedings of Europar 2002 (2002)
Wang, F.: A ScanOnce Algorithm for Large Database Mining. In: Proceedings of the 2002 International Conference on Data Mining, Bologna, Italy, September 25-27 (2002) ISBN: 1-85312-925-9
Wang, F., Helian, N.: Scanning Once a Large Database to Mine Association Rules By Growing A Prefix Tree for Each Transaction. In: The International Conference on Information and Knowledge Engineering (IKE 2003), USA, June 23-26 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, F., Helian, N., Guo, Y., Thompson, S., Gordon, J. (2004). Prototype a Knowledge Discovery Infrastructure by Implementing Relational Grid Monitoring Architecture (R-GMA) on European Data Grid (EDG). In: Li, M., Sun, XH., Deng, Q., Ni, J. (eds) Grid and Cooperative Computing. GCC 2003. Lecture Notes in Computer Science, vol 3033. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24680-0_129
Download citation
DOI: https://doi.org/10.1007/978-3-540-24680-0_129
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21993-4
Online ISBN: 978-3-540-24680-0
eBook Packages: Springer Book Archive