Abstract
The developed hybrid model of high performance computing and the realized applications on the basis of MapReduce Hadoop and MPI technologies allow to solve effectively the different classes of oil production problems.
Investigations of high performance computing to solve the problem of 3D hydrodynamic calculation of oil production resulted in proposition of a constructive approach to organization of distributed parallel computing using MapReduce Hadoop and MPI technologies for which a general scheme of the iteration infrastructure of MapReduce model is designed; the structure for fulfillment of map and reduce methods and organization of decomposition of the computational area at different Map/Reduce stages are presented; a computational experiment on specific infrastructure is carried out. As the result of this work the architecture of the system realized on the advantages of MapReduce Hadoop and MPI technologies is constructed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aziz, K., Settari, A.: Petroleum Reservoir Simulation, p. 407. Applied Science Publishers Ltd., London (1979)
Imankulov, T.S., Mukhambetzhanov, S.T., Akhmed-Zaki, D.Z.: Simulation of generalized plane fluid filtration in a deformable environment. In: Computational Technologies, part 1, vol. 1, pp. 183–191 (2013). Bulletin of the East-Kazakhstan State Technical University Named by D. Serikbaev
Zhumagulov, B.T., Mukhambetzhanov, S.T., Akhmed-Zaki, D., Imankulov, T.S.: Computer modeling of nonisothermal oil displacement at gelepolimer flooding. Bull. NEA RK. 4(50), 14–22 (2013)
Samarskiy, A.A., Gulin, A.V.: Numerical Methods. Nauka, Moscow (1989). (in Russian)
Jin, H., He, X.: Sun performance comparison under failures of MPI and MapReduce. An analytical approach. J. Future Gener. Comput. Syst. 7(29), 1808–1815 (2013)
Lu, X., Wang, B., Zha, L., Xu, Z.: Can MPI benefit Hadoop and MapReduce applications? In: Proceedings of the 2011 40th International Conference on Parallel Processing Workshops, ICPPW 2011, pp. 371–379 (2011)
Mohamed, H., Marchand-Maillet, S.: Enhancing MapReduce using MPI and an optimized data exchange policy. In: Proceedings of the 2012 41st International Conference on Parallel Processing Workshops, ICPPW 2012, pp. 11–18 (2012)
Steven, J., Plimpton, K.D.: Devine MapReduce in MPI for large-scale graph algorithms. J. Parallel Comput. 9(37), 610–632 (2011)
Matsunaga, A., Tsugawa, M., Fortes, J.: CloudBLAST: combining MapReduce and virtualization on distributed resources for bioinformatics applications. In: IEEE 4th International Conference on eScience 2008. IEEE (2008)
Sul, S., Tovchigrechko, A.: Parallelizing BLAST and SOM algorithms with MapReduce-MPI library. In: Proceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum, IPDPSW 2011, pp. 481–489 (2011)
Hoefler, T., Lumsdaine, A., Dongarra, J.: Towards efficient MapReduce using MPI. In: Ropo, M., Westerholm, J., Dongarra, J. (eds.) PVM/MPI. LNCS, vol. 5759, pp. 240–249. Springer, Heidelberg (2009)
Slawinski, V.S.: Adapting MPI to MapReduce PaaS clouds: an experiment in cross-paradigm execution. In: 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing, pp. 199–203 (2012)
Akhmed-Zaki, D., Danaev, N., Matkerim, B., Bektemessov, A.: Design of distributed parallel computing using by MapReduce/MPI technology. In: Malyshkin, V. (ed.) PaCT 2013. LNCS, vol. 7979, pp. 139–148. Springer, Heidelberg (2013)
Kumalakov, B., Shomanov, A., Dadykina, Y., Ikhsanov, S., Tulepbergenov, B.: Solving Dirichlet problem for Poisson’s equation using MapReduce Hadoop. In: Theoretical and Applied Aspects of Cybernetics, Proceedings of the III International Scientific Conference of Students and Young Scientists, pp. 224–227. Kyiv (2013)
Akhmed-Zaki, D., Mansurova, M., Matkerim, B., Kumalakov, B., Shomanov, A.: Iterative MapReduce oil reservoir simulator. Applying MDA and Hadoop to solve hydrodynamics problems. In: Extended Abstracts of the International Conference Electronics, Telecommunications and Computers, Lisbon, Portugal (2013)
Mansurova, M., Akhmed-Zaki, D., Kumalakov, B., Matkerim, B.: Distributed parallel algorithm for numerical solving of 3D problem of fluid dynamics in anisotropic elastic porous medium using MapReduce and MPI technologies. In: Proceedings of 9th International Joint Conference on Software Technologies ICSOFT 2014, Vienna, Austria, pp. 525–528 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Akhmed-Zaki, D., Mansurova, M., Imankulov, T., Matkerim, B., Dadykina, E. (2015). Development of a Distributed Parallel Algorithm of 3D Hydrodynamic Calculation of Oil Production on the Basis of MapReduce Hadoop and MPI Technologies. In: Malyshkin, V. (eds) Parallel Computing Technologies. PaCT 2015. Lecture Notes in Computer Science(), vol 9251. Springer, Cham. https://doi.org/10.1007/978-3-319-21909-7_48
Download citation
DOI: https://doi.org/10.1007/978-3-319-21909-7_48
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-21908-0
Online ISBN: 978-3-319-21909-7
eBook Packages: Computer ScienceComputer Science (R0)