Skip to main content
SpringerLink
Log in

A parallel programming interface for out-of-core cluster applications

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Clusters of workstations are a practical approach to parallel computing that provide high performance at a low cost for many scientific and engineering applications. In order to handle problems with increasing data sets, methods supporting parallel out-of-core computations must be investigated. Since writing an out-of-core version of a program is a difficult task and virtual memory systems do not perform well in some cases, we have developed a parallel programming interface and the support library to provide efficient and convenient access to the out-of-core data. This paper focuses on how these components extend the range of problem sizes that can be solved on the cluster of workstations. Execution time of Jacobi iteration when using our interface, virtual memory and PVFS are compared to characterize the performance for various problem sizes, and it is concluded that our new interface significantly increases the sizes of problems that can be efficiently solved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. J. Mache, J. Bower-Cooley, R. Broadhurst, J. Cranfill, and C. Kirkman IV, Parallel i/o performance of pc clusters, In: 10th SIAM Conf. on Parallel Processing for Scientific Computing, Portsmouth, VA, USA, (March 2001).

  2. High performance computing and communications: Grand challenges 1993 report. Technical report, A Report by the Committee on Physical, Mathematical and Engineering Sciences, Federal Coordinating Council for Science, Engineering and Technology, (1993).

  3. D. Womble, D. Greenberg, R. Riesen, and S. Wheat, s Out of core, out of mind: Practical parallel i/o. In: Proceedings of the Conference on Scalable Parallel Libraries, A. Skjellum, Washington DC, USA, (1993). IEEE Computer Society.

  4. T. Jones, A. Koniges, and R.K. Yates, Performance of the ibm general parallel file system. In: Proceedings of 14th International Parallel and Distributed Processing Symposium, (May 2000) pp. 673–681.

  5. R. Thakur, W. Gropp, and E. Lusk, Data sieving and collective i/o in romio. In: Proceedings of the Seventh Symposium on the Frontiers of Massively Parallel Computation, (February 1999) pp. 182– 189.

  6. J.V. Huber, A.A. Chien, C. L. Elford, D. S. Blumenthal, and D.A. Reed, Ppfs: A high performance portable parallel file system. In: Proceedings of the 9th ACM international conference on Supercomputing, (July 1995) pp. 385–394.

  7. R. Thakur, A. Choudhary, R. Bordawekar, S. More, and S. Kuditipudi, Passion: Optimized i/o for parallel applications. Computer 29(6) (1996) 70–78.

    Google Scholar 

  8. P.H. Carns, W.B. Ligon III, R.B. Ross, and R. Thakur, Pvfs: A parallel file system for linux clusters. In: Proceidings of the 4th Annual Linux Showcase and Conference, Atlanta, GA, USA, (October 2000) pp. 317–327.

  9. A. Ching, A. Choudhary, W. Liao, R. Ross and W. Gropp, Noncontiguous i/o through pvfs. In: Proceedings of IEEE International Conference on Cluster Computing, (September 2002) pp. 405–414.

  10. http://www.pvfs.org/.

  11. M.M. Cettei, W.B. Ligon III, and R.B. Ross, Support for parallel out of core applications on beowulf workstations. In: Proceidings of the 1998 IEEE Aerospace Conference, (March 1998).

  12. D. Gannon, X.Y. Shelby, and P. Beckman, User guide for a portable parallel c++ programming system: pc++. Technical report, Indiana University, (September 1994).

  13. http://www.extreme.indiana.edu/sage/.

  14. http://www.mpi-forum.org/.

  15. http://www.netlib.org/pvm3/.

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Harbin Institute of Technology, Harbin, China

    Jianqi Tang, Binxing Fang, Mingzeng Hu & Hongli Zhang

Authors
  1. Jianqi Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Binxing Fang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mingzeng Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hongli Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jianqi Tang.

Additional information

Jianqi Tang received B.Sc. and M.Sc. from Harbin Institute of Technology in 1997 and 1999 respectively, both in computer application. Currently, she is a Ph.D. candidate at the Department of Computer Science and engineering, Harbin Institute of Technology. She has participated in several National research projects. Her research interests include parallel computing, parallel I/O and grid computing.

Binxing Fang received M.Sc. in 1984 from Tsinghua University and Ph.D. from Harbin Institute of Technology in 1989, both in computer science. From 1990 to 1993 he was with National University of Defense Technology as a postdoctor. Since 1984, he is a faculty member at the Department of Computer Science and engineering of Harbin Institute of Technology, where he is presently a Professor. He is a Member of the National Information Expert Consultant Group and a Standing Member of the Council of Chinese Society of Communications. His research efforts focus on parallel computing, computer network and information security. Professor Fang has implemented over 30 projects from the state and ministry/province.

Mingzeng Hu was born in 1935. He has been with the Department of Computer Science and engineering in Harbin Institute of Technology since 1958, where he is currently a Professor. He was a visiting scholar in the Siemens Company, Germany from 1978 to 1979, a visiting associate professor in Chiba University, Japan from 1984 to 1985, and a visiting professor in York University, Canada from 1989 to 1995. He is the Director of the National Key Laboratory of Computer Information Content Security. He is also a Member of 3rd Academic Degree Committee under the State Council of China. Professor Hu’s research interests include high performance computer architecture and parallel processing technology, fault tolerant computing, network system, VL design, and computer system security technology. He has implemented many projects from the state and ministry/province and has won several Ministry Science and Technology Progress Awards. He published over 100 papers in core journals home and abroad and one book. Professor Hu has supervised over 20 doctoral students.

Hongli Zhang received M.Sc in computer system software in 1996 and Ph.D. in computer architecture in 1999 from Harbin Institute of Technology. Currently, she is an Associate Professor at the Department of Computer Science and engineering, Harbin Institute of Technology. Her research interests include computer network security and parallel computing.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tang, J., Fang, B., Hu, M. et al. A parallel programming interface for out-of-core cluster applications. Cluster Comput 9, 321–327 (2006). https://doi.org/10.1007/s10586-006-9744-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-006-9744-5

Keywords

Search

Navigation