Michael A. Kochte
ABSTRACT
We describe a software framework for deploying, scheduling and executing parallel DBMS user-defined programs on an attached high-performance computer (HPC) platform. This framework is advantageous for many DBMS workloads in the following two aspects. First, the long-running user-defined programs can be speeded up by taking advantage of the greater hardware parallel-ism available on the attached HPC platform. Second, the interac-tive response time of the remaining applications on the database server platform is improved by the off-loading of long-running user-defined programs to the attached HPC platform. Our frame-work provides a new approach for integrating high-performance computing into the workflow of query-oriented, computationally-intensive applications.
- Becla, J., and Wong, D. L. 2005 Lessons Learned From Man-aging a Petabyte, Second Biennal Conference On Innovative Data Systems Research, pp. 70--83, Asilomar CA.Google Scholar
- Chamberlin, D. 1998 A Complete Guide to DB2 Universal Database, Morgan-Kaufman, San Francisco. Google ScholarDigital Library
- Lee, K. C., Hickey, T. M. and Mak, V. W. 1991 VLSI Accel-erators for Large Database Systems, IEEE Micro, vol. 11, no. 6, pp. 8--20. Google ScholarDigital Library
- Faudemay, P. and Mhiri, M. 1991 An Associative Accelerator for Large Databases, IEEE Micro, vol. 11, no. 6, pp. 22--34. Google ScholarDigital Library
- Abdelguerfi, M. and Sood, A. K. 1991 A Fine-Grain Archi-tecture for Relational Database Aggregation Operations, IEEE Micro, vol. 11, no. 6, pp. 35--43. Google ScholarDigital Library
- Mak V. W., Lee, K. C., and Frieder, O. 1991 Exploiting Par-allelism in Pattern Matching: An Information Retrieval Ap-plication, ACM Transactions on Information Systems, vol. 9, no. 1, pp. 52--74. Google ScholarDigital Library
- Riedel, E., Faloutsos, C., Gibson, G. A. and Nagle, D. 2001 Active Disks for Large-Scale Data Processing, IEEE Com-puter, vol. 34, no. 6, pp. 68--74. Google ScholarDigital Library
- The message passing interface (MPI) standard, http://www-unix.mcs.anl.gov/mpi 2007.Google Scholar
- IBM DB2 Version 9.1, http://www.ibm.com/software/data/db22007.Google Scholar
- Gara, A. et al. 2005 Overview of the Blue Gene/L system architecture, IBM Journal of Research and Development, vol. 49, no. 2/3, pp. 195--212. Google ScholarDigital Library
- Pearson, R. 2000 Protein Sequence comparison and Protein evolution, Tutorial of Third International Conference on Intel-ligent Systems in Molecular Biology, La Jolla CA.Google Scholar
- Haas, L. M., Schwarz, P. M., Kodali, P., Kotler, E., Rice, J. E., and Swope, W. C. 2001 DiscoveryLink: A System for In-tegrated Accesss to Life Sciences Data Services, IBM Sys-tems Journal, Vol. 40, no. 2, pp. 489--511 . Google ScholarDigital Library
- Stephens, S. M., Chen, J. Y., Davidson, M. G., Thomas, S. and Trute, B. M. 2005 Oracle Database 10g: a platform for BLAST search and Regular Expression pattern matching in life sciences, Nucleic Acids Research, Vol. 33, Database is-sue, pp. 675--679.Google Scholar
- Eckman, B. and Del Prete, D. 2004 Efficient Access to BLAST Using IBM DB2 Information Integrator, IBM Healthcare and Life Science Publication.Google Scholar
- Chen, Y., Mak, J., Skawratananond, C. and Tzeng, T-H. K. 2004 Scalability Comparison of Bioinformatics for Applica-tions on AIX and Linux on IBM e-server pSeries 690, IBM Redbook, http://www.redbooks.ibm.com/abstracts/redp3803.html 2004.Google Scholar
- Darling, A. E., Carey, L. and Feng, W. 2003 The Design, Implementation and Evaluation of mpiBLAST, Proceedings of the 2003 Clusterworld conference, San Jose CA.Google Scholar
- Lin, H., Ma, X., Chandramohan, P., Geist, A. and Samatova, N. 2005 Efficient data access for parallel blast, Proceedings of the 19th IEEE International Parallel and Distributed Process-ing Symposium, pp. 72--74, Denver CO. Google ScholarDigital Library
- Braun, R. C., Pedretti, K.T., Casavant, T.L., Scheetz, T.E, Birkett, C.L., and. Roberts, C.A. 1999 Three Complememtary Approaches to Parallelization of Local BLAST Service on Workstation Clusters, Proceedings of the 5th International Conference on Parallel Computing Technologies (PACT), Lecture Notes in Computer Science (LNCS), vol.1662, pp. 271--282. Google ScholarDigital Library
- Rangwala, H., Lant, E., Musselman, R., Pinnow, K., Smith, B. and Wallenfelt, B. 2005 Massively Parallel BLAST for the Blue Gene/L, High Availability and Performance Computing Workshop, Santa Fe NM.Google Scholar
- SSEARCH documentation, http://helix.nih.gov/docs/gcg/ssearch.html 2007.Google Scholar
- Bairoch, A. 2000 Serendipity in bioinformatics, the tribula-tions of a Swiss bioinformatician through exciting times! Bio-informatics vol. 16, no. 1, pp. 48--64.Google Scholar
- sts database, ftp://ftp.ncbi.nih.gov/blast/db 2008.Google Scholar
- Boguski, M. S. 1995 The turning point in genome research, Trends in Biochemical Sciences, vol. 20, no. 8, pp. 295--296.Google ScholarCross Ref
- Dean, J. and Ghemawat, S. 2004 MapReduce: Simplified Data Processing on Large Clusters, Proceedinsg of Operating System Design and Implementation, pp. 137--150, San Francisco CA. Google ScholarDigital Library
- Yom-Tov, E., Aharoni, U., Ghoting, A., Pednault, E., Pelleg, D., Toledano, H. and Natarajan, R. An Introduction to the IBM Parallel Mining Toolkit, http://www.ibm.com/developerworks/grid/library/gr-ipmlt/index.html 2007.Google Scholar
Index Terms
- A framework for scheduling parallel dbms user-defined programs on an attached high-performance computer
Recommendations
High-Performance Computing Education
Many successful efforts are currently addressing the critical shortage of a diverse, well-prepared high-performance computing (HPC) workforce. The guest editors' goal, with this issue, is to stimulate large-scale international discourse to accelerate ...
High-Performance Computing with Accelerators
This issue of CiSE is based on work presented at the US National Science Foundation workshop, Path to Petascale: Adapting Geo/Chem/Astro Applications for Accelerators and Accelerator Clusters, held at the US National Center for Supercomputing ...
A Scalable Runtime Fault Localization Framework for High-Performance Computing Systems
Fault localization has become an increasingly challenging issue in high-performance computing (HPC) systems. Various techniques have been used for HPC systems. However, as the HPC systems scale out, resulting in the rapid deterioration of the existing ...
Comments