Abstract
The distributed computing performance is usually limited by the data transfer rate and access latency. Techniques such as data caching and prefetching were developed to overcome this limitation. However, such techniques require the knowledge of application behavior in order to be effective. In this sense, we propose new application communication behavior discovery techniques that, by classifying and analyzing application access patterns, is able to predict future application data accesses. The proposed techniques use stochastic methods for application state change prediction and neural networks for access pattern discovery based on execution history, and is evaluated using the NAS Parallel Benchmark suite.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kotz, D., Ellis, C.S.: Practical prefetching techniques for multiprocessor file systems. Journal of Distributed and Parallel Databases 1(1), 33–51 (1993)
Madhyastha, T.M., Reed, D.A.: Input/output access pattern classification using hidden Markovmodels. In: Proceedings of the Fifth Workshop on Input/Output in Parallel and Distributed Systems, San Jose, CA, pp. 57–67. ACM Press, New York (1997)
Lei, H., Duchamp, D.: An analytical approach to file prefetching. In: 1997 USENIX Annual Technical Conference, Anaheim, California, USA (1997)
Dodonov, E., Sousa, J.Q., Guardia, H.C.: Gridbox: securing hosts from malicious and greedy applications. In: Proceedings of the 2nd workshop on Middleware for grid computing, pp. 17–22. ACM Press, New York (2004)
Mello, R., Senger, L., Yang, L.: Automatic text classification using an artificial neural network. High Performance Computational Science and Engineering 1, 1–21 (2005)
Bailey, D.H., Barszcz, E., Barton, J.T., Browning, D.S., Carter, R.L., Dagum, D., Fatoohi, R.A., Frederickson, P.O., Lasinski, T.A., Schreiber, R.S., Simon, H.D., Venkatakrishnan, V., Weeratunga, S.K.: The nas parallel benchmarks. The International Journal of Supercomputer Applications 5(3), 63–73 (1991)
Cao, P., Felten, E.W., Karlin, A.R., Li, K.: A study of integrated prefetching and caching stategies. In: Proceedings of the 1995 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems, pp. 188–197. ACM Press, New York (1995)
Dodonov, E., Guardia, H.C.: An architecture for integrated caching and prefetching mechanisms for distributed parallel file systems. In: Proceedings of the 2002 CLEI (2002)
Reddy, A.L.N.: Evaluation of caching strategies for a multimedia storage server. In: International Conference on Multimedia Computing and Systems, pp. 118–125 (1997)
Cortes, T., Labarta, J.: Linear aggressive prefetching: A way to increase the performance of cooperative caches. In: Proceedings of the Joint International Parallel Processing Symposium and IEEE Symposium on Parallel and Distributed Processing, San Juan, Puerto Rico, pp. 45–54 (1999)
Bianchini, R., Pinto, R., Amorim, C.L.: Data prefetching for software DSMs. In: International Conference on Supercomputing, pp. 385–392 (1998)
Mehrotra, S., Harrison, L.: Examination of a memory access classification scheme for pointer-intensive and numeric programs. In: ICS 1996, pp. 133–140 (1996)
Senger, L.J., Mello, R.F., Santana, M.J., Santana, R.C.: An on-line approach for classifying and extracting application behavior on linux. In: Yang, L.T., Guo, M. (eds.) High Performance Computing: Paradigm and Infrastructure, John Wiley and Sons, Chichester (2005)
Carpenter, G.A., Grossberg, S.: Art 2: Selforganisation of stable category recognition codes for analog input patterns. Applied Optics 26, 4919–4930 (1987)
Waibel, A., Hanazawa, T., Hinton, G., Shikano, K., Lang, K.: Phoneme recognition using time delay neural networks. IEEE Transactions on Accoustics, Speech and Signal Processing 37, 328–339 (1989)
Burns, G., Daoud, R., Vaigl, J.: LAM: An Open Cluster Environment for MPI. In: Proceedings of Supercomputing Symposium, pp. 379–386 (1994)
Dodonov, E., de Mello, R.F., Yang, L.T.: A network evaluation for lan, man and wan grid environments. In: Yang, L.T., Amamiya, M., Liu, Z., Guo, M., Rammig, F.J. (eds.) EUC 2005. LNCS, vol. 3824, pp. 1133–1146. Springer, Heidelberg (2005)
Zell, A., Mache, N., Sommer, T., Korb, T.: Design of the snns neural network simulator. In: Kaindl, H. (ed.) 7. Österreichische Artificial-Intelligence-Tagung, pp. 93–102. Springer, Heidelberg (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Dodonov, E., de Mello, R.F., Yang, L.T. (2006). Adaptive Technique for Automatic Communication Access Pattern Discovery Applied to Data Prefetching in Distributed Applications Using Neural Networks and Stochastic Models. In: Guo, M., Yang, L.T., Di Martino, B., Zima, H.P., Dongarra, J., Tang, F. (eds) Parallel and Distributed Processing and Applications. ISPA 2006. Lecture Notes in Computer Science, vol 4330. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11946441_30
Download citation
DOI: https://doi.org/10.1007/11946441_30
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-68067-3
Online ISBN: 978-3-540-68070-3
eBook Packages: Computer ScienceComputer Science (R0)