Abstract
For efficient permeability modeling and prediction in oil and gas reservoirs, the recorded well-log data and the discrete lithofacies are calibrated with the limited core data available and then used for the prediction in unobserved and unsampled well-bore sections. Like other machine learning models, the gradient boosting model (GBM) requires hyperparameter tuning to optimize their prediction performance. Two GBM configurations are evaluated that involve grid search (GS-GBM-HPO) and random search (RS-GBM-HPO) to optimize (tune) the model’s hyperparameters settings and compare their prediction performances with default settings (GBM-DHP). These three GBM configurations are first trained and tested through cross-validation, in classification mode, to predict lithofacies, based on six well-log distributions, from a partially cored well drilled into an extensive carbonate oil and gas reservoir (Mishrif Formation, Iraq). The predicted discrete lithofacies distribution is then incorporated with the six well-log distributions to tune another set of GS-GBM-HPO, RS-GBM-HPO, and GBM-DHP models is trained and tested, in regression mode, to predict Mishrif reservoir permeability throughout the wellbore. Total-correct percentage (TCP) values assess the lithofacies classification accuracy of the GBM models. The highest TCP of 96.6% was achieved by the RS-GBM-HPO model applied to the lithofacies testing subset. Mean absolute error (MAE) and root mean square error (RMSE) assess permeability prediction accuracy. The lowest permeability prediction errors were achieved by the RS-GBM-HPO model, configured in regression mode, and applied to the testing subset (MAE = 6.85 mD; RMSE = 15.34 mD). The trained RS-GBM-HPO model was used to predict Mishrif permeability in a separate non-cored well (Well X) and these predictions closely matched permeability values derived from nuclear magnetic resonance (NMR) logging of Well X. The presented RS-GBM-HPO model can provide dependable permeability predictions in non-cored sections of the well used for GMB model training. Moreover, the trained GMB models can be generalized for application to other field wells lacking core data.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data Availability
The data used in this research can be provided upon request from the corresponding author.
References
Abbas, MA, Al Lawe EM (2019) Clustering Analysis and Flow Zone Indicator for Electrofacies Characterization in the Upper Shale Member in Luhais Oil Field, Southern Iraq. Abu Dhabi International Petroleum Exhibition & Conference, Abu Dhabi, UAE. https://doi.org/10.2118/197906-MS
Abbas MA, Al-Mudhafar WJ (2021) Lithofacies Classification of Carbonate Reservoirs Using Advanced Machine Learning: A Case Study from a Southern Iraqi Oil Field. Offshore Technol Conf Virt Houston, Texas. https://doi.org/10.4043/31114-MS
Abbas, LK, Mahdi, TA (2020) Reservoir Modeling of Mishrif Formation in Majnoon Oil Field, Southern Iraq. Iraqi Geol J, 53(1B). https://doi.org/10.46717/igj.53.1B.6Rz-02/03/2020
Abbas LK, Mahdi TA (2019) Reservoir units of Mishrif Formation in Majnoon Oil field Southern Iraq. Iraqi J Sci 60(12):2656–2663. https://doi.org/10.24996/ijs.2019.60.12.15
Ahmadi MA, Chen Z (2019) Comparison of machine learning methods for estimating permeability and porosity of oil reservoirs via petro-physical logs. Petroleum 5(3):271–284. https://doi.org/10.1016/j.petlm.2018.06.002
Al-Ali, A., Stephen, K., and Shams, A. 2019. Improved Carbonate Reservoir Characterization: A Case Study from a Supergiant Field in Southern of Iraq. SPE Middle East Oil and Gas Show and Conference, Manama, Bahrain. https://doi.org/10.2118/194934-MS
Al-Anazi AF, Gates ID (2011) Support-vector regression for permeability prediction in a heterogeneous reservoir: a comparative study. SPE Reservoir Eval Eng 13(3):485–495. https://doi.org/10.2118/126339-PA
Albuslimi, M, Alkalby, Y, Al-Taweel, T (2021) K-Mean Clustering Analysis and Logistic Boosting Regression for Rock Facies Characterization and Classification in Zubair Reservoir in Luhais Oil Field, Southern Iraq. Iraqi Geol J, 54(2B). https://doi.org/10.46717/igj.54.2B.6Ms-2021-08-26
Ali J, Ashraf U, Anees A, Peng S, Umar MU, Vo Thanh H, Khan U, Abioui M, Mangi HN, Ali M, Ullah J (2022) Hydrocarbon potential assessment of carbonate-bearing sediments in a Meyal Oil Field, Pakistan: Insights from logging data using machine learning and quanti elan modeling. ACS Omega 7:39375–39395. https://doi.org/10.1021/acsomega.2c05759
Al-Mudhafar, WJ (2016a) Incorporation Bootstrapping and Cross-Validation for Efficient Lithofacies Classification and Formation Permeability Modeling. SPE-180277-MS, the SPE Low Perm Symposium, Denver, CO, USA. https://doi.org/10.2118/180277-MS
Al-Mudhafar, WJ (2016b) Applied geostatistical reservoir characterization in R: review and implementation of permeability estimation modeling and prediction algorithms- Part II. In: Offshore Technology Conference, Houston, Texas, USA. https://doi.org/10.4043/26932-MS
Al-Mudhafar WJ (2017) Incorporating well log interpretations for lithofacies classification and permeability modeling through advanced machine learning algorithms. J Petrol Explor Prod Technol 7(4):1023–1033. https://doi.org/10.1007/s13202-017-0360-0
Al-Mudhafar, WJ (2020a) Advanced Supervised Machine Learning Algorithms for Efficient Electro- facies Classification of a Carbonate Reservoir In a Giant Southern Iraqi Oil Field. OTC. Houston, Texas, USA. https://doi.org/10.4043/30906-MS
Al-Mudhafar WJ (2020b) Integrating machine learning and data analytics for geostatistical characterization of clastic reservoirs. J Petrol Sci Eng 195(1):1–14. https://doi.org/10.1016/j.petrol.2020.107837
Al-Mudhafar WJ, Abbas MA, Wood DA (2022) Performance evaluation of boosting machine learning algorithms for lithofacies classification in heterogeneous carbonate reservoirs. Mar Pet Geol 145:105886. https://doi.org/10.1016/j.marpetgeo.2022.105886
Alobaidi DA (2016) Permeability prediction in one of iraqi carbonate reservoir using hydraulic flow units and neural networks. Iraqi J Chem Pet Eng 17(1):1–11
Ameur-Zaimeche O, Aziez Z, Heddam S, Kechiched R (2020) Lithofacies prediction in non- cored wells from the Sif Fatima oil field (Berkine basin, southern Algeria): a comparative study of multilayer perceptron neural network and cluster analysis-based approaches. J Afr Earth Sci 166:103826. https://doi.org/10.1016/j.jafrearsci.2020.103826
Anggoro, DA, Mukti SS (2021) "Performance Comparison of Grid Search and Random Search Methods for Hyperparameter Tuning in Extreme Gradient Boosting Algorithm to Predict Chronic Kidney Failure." Int J Intell Eng Syst 14. https://doi.org/10.22266/ijies2021.1231.19
Bellen RC van, Dunnington HV, Wetzel R, Morton DM (1959) Iraq.- Lexique Stratigraphique International, Paris, vol III, Asie, Fascicule 10a
Bengio, Y, Grandvalet, Y (2004) No unbiased estimator of the variance of k-fold cross-validation. J Mach Learn Res, 5(Sep): 1089–1105. https://www.jmlr.org/papers/volume5/grandvalet04a/grandvalet04a.pdf
Bergstra JS, Bengio Y (2012) Random Search for HyperParameter Optimization. J Mach Learn Res 13:281–305
Bergstra, JS, Bardenet R, Bengio Y, Kégl B (2011) Algorithms for hyperparameter optimization. Adv Neural Inf Process 24:2546–2554. https://proceedings.neurips.cc/paper_files/paper/2011/file/86e8f7ab32cfd12577bc2619bc635690-Paper.pdf
Chatterjee S (2016) Package “fastAdaboost”. Available at: https://cran.r-project.org/src/contrib/Archive/fastAdaboost/
Chen T et al. (2021) Package ”xgboost”. Available at https://cran.r-project.org/web/packages/xgboost/
Dahraj, NUH, Bhutto, AA (2014) Linear mathematical model developed using statistical methods to predict permeability from porosity. In: PAPG/SPE Pakistan Section Annual Technical Conference, Islamabad, Pakistan. https://doi.org/10.2118/174716-MS
El-Sebakhy EA, Asparouhov O, Abdulraheem A, Wu D, Latinski K, Spries W (2010) Data mining in identifying carbonate litho-facies from well logs based from extreme learning and support vector machines. AAPG Geoscience Conference & Exhibition, Manama, Bahrain (March 7-10). https://www.searchanddiscovery.com/abstracts/html/2010/geo_bahrain/abstracts/El_Sebakhy.html
Elgeldawi, E, Sayed A, Galal AR, Zaki AM (2021) "Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis." Informatics https://doi.org/10.3390/informatics8040079
Friedman JH (2001) Greedy function approximation: a gradient boosting machine. The Annals Stat (Institute of Mathematical Statistics, JSTOR) 29(5):1189–1232. https://www.jstor.org/stable/2699986
Friedman JH (2022) Stochastic gradient boosting. Comput Stat Data Anal (ELSEVIER) 38(4):367–378. https://doi.org/10.1016/S0167-9473(01)00065-2
Gu Y, Zhang D, Bao Z (2021) A new data-driven predictor, PSO-XGBoost, used for permeability of tight sandstone reservoirs: A case study of member of chang 4+5, western Jiyuan Oilfield, Ordos Basin. J Petroleum Sci Eng 199:108350. https://doi.org/10.1016/j.petrol.2021.108350
Hutter, F, Kotthoff L, Vanschoren J (2019) Automated Machine Learning. Springer Cham. https://doi.org/10.1007/978-3-030-05318-5
João, RS, Fafalios P, Dietze S (2020) Better Together - An Ensemble Learner for Combining the Results of Ready-made Entity Linking Systems. The 35th Annual ACM Symp Appl Comput, 851–858.https://doi.org/10.1145/3341105.3373883
Kapur L, Lake LW, Sepehrnoori K, Herrick DC, Kalkomey CT (1998) Facies prediction from core and log data using artificial neural networks technology. SPWLA-1998-PP, paper presented at the SPWLA 39th Annual Logging Symposium, Keystone, Colorado
Kalule R, Abderrahmane HA, Alameri W, Sassi M (2023) Stacked ensemble machine learning for porosity and absolute permeability prediction of carbonate rock plugs. Sci Rep 13:9855. https://doi.org/10.1038/s41598-023-36096-2
Lee, SH, Datta-Gupta, A (1999) Electrofacies characterization and permeability predictions in carbonate reservoirs: role of multivariate analysis and nonparametric regression. In: SPE Annual Technical Conference and Exhibition, Houston, Texas. https://doi.org/10.2118/56658-MS
Liu, J-J, Liu, J-C (2022) Permeability Predictions for Tight Sandstone Reservoir Using Explainable Machine Learning and Particle Swarm Optimization, Geofluids. https://doi.org/10.1155/2022/2263329
Long JS (2006) Regression Models for Categorical and Limited Dependent Variables Using Stata. Stata Press, Texas
Mohaghegh S, Balan B, Ameri S (1997) Permeability determination from well log data. SPE Form Eval 12(3):170–174. https://doi.org/10.2118/30978-PA
Mohammadian E, Kheirollahi M, Liu B, Ostadhassan M, Sabet M (2022) A case study of petrophysical rock typing and permeability prediction using machine learning in a heterogenous carbonate reservoir in Iran. Sci Rep 12:4505. https://doi.org/10.1038/s41598-022-08575-5
Moradi M, Tokhmechi B, Masoudi P (2019) Inversion of well logs into rock types, lithofacies and environmental facies, using pattern recognition, a case study of carbonate Sarvak Formation. Carbonates Evaporites 34(2):335–347. https://doi.org/10.1007/s13146-017-0388-8
Murphy KP (2006) Naive bayes classifiers. University of British Columbia, Vancouver, British Columbia, Canada. https://www.ic.unicamp.br/~rocha/teaching/2011s2/mc906/aulas/naive-bayes.pdf
Nanjo, T, Tanaka, S (2019) Carbonate Lithology Identification with Machine Learning. Abu Dhabi International Petroleum Exhibition & Conference, Abu Dhabi, UAE. https://doi.org/10.2118/197255-MS
Nguyen V (2019) Bayesian Optimization for Accelerating Hyper-Parameter Tuning. IEEE Second International Conference on Artificial Intelligence and Knowledge Engineering (AIKE), Sardinia, Italy, pp 302–305. https://doi.org/10.1109/AIKE.2019.00060
Otchere DA, ArbiGanat TO, Gholami R, Lawal M (2021) A novel custom ensemble learning model for an improved reservoir permeability and water saturation prediction. J Nat Gas Sci Eng 91:103962. https://doi.org/10.1016/j.jngse.2021.103962
Pires A, Branco JA (2010) Projection-pursuit approach to robust linear discriminant analysis. J Multivar Anal 101(10):2464–2485. https://doi.org/10.1016/j.jmva.2010.06.017
Phukan, M, Abdelmalek M, Saad S (2019) A Sedimentological Study of the Mishrif Formation, Majnoon Field, Iraq. Weatherford. Interior Report (Unpublished)
Rafik, B, Kamel, B, (2016) Prediction of permeability and porosity from well log data using the nonparametric regression with multivariate analysis and neural network, Hassi RMel Field, Algeria. Egypt J Petrol https://doi.org/10.1016/j.ejpe.2016.10.013
Vo Thanh H, Sugai Y, Nguele R, Sasaki K (2019) Integrated Workflow in 3D Geological Model Construction for Evaluation of CO2 Storage Capacity of a Fractured Basement Reservoir in Cuu Long Basin Vietnam. Int J Greenhouse Gas Control 90:102826. https://doi.org/10.1016/j.ijggc.2019.102826
Vo Thanh H, Sugai Y, Sasaki K (2020) Impact of a New Geological Modelling Method on the Enhancement of the CO2Storage Assessment of E Sequence of Nam Vang Field, Offshore Vietnam. Energ Sources A: Recover Util Environ Eff 42(12):1499–1512. https://doi.org/10.1080/15567036.2019.1604865
Wang R (2012) AdaBoost for feature selection, classification and its relation with SVM, a review. Phys Procedia 25:800–807. https://doi.org/10.1016/j.phpro.2012.03.160
Wicaksono AS, Supianto AF (2019) Hyper parameter optimization using genetic algorithm on machine learning methods for online news popularity prediction. Int J Adv Comput Sci Appl 9(12):2018. https://doi.org/10.14569/IJACSA.2018.091238
Wood DA (2020) Predicting porosity, permeability and water saturation applying an optimized nearest-neighbour, machine-learning and data-mining network of well-log data. J Pet Sci Eng 184:106587. https://doi.org/10.1016/j.petrol.2019.106587
Wood DA (2022) Gamma-ray log derivative and volatility attributes assist facies characterization in clastic sedimentary sequences for formulaic and machine learning analysis. Adv Geo-Energ Res 6(1):69–85. https://doi.org/10.46690/ager.2022.01.06
Xie J (2008) Improved permeability prediction using multivariate analysis methods. M. Sc. Thesis. Texas A&M University. Available electronically from https://hdl.handle.net/1969.1/ETD-TAMU-3223
Zhao X, Chen X, Huang Q, Lan Z, Wang X, Yao G (2022) Logging-data-driven permeability prediction in low-permeable sandstones based on machine learning with pattern visualization: A case study in Wenchang A Sag, Pearl River Mouth Basin. J Pet Sci Eng 214:110517. https://doi.org/10.1016/j.petrol.2022.110517
Zhao L, Guo Y, Mohammadian E, Hadavimoghaddam F, Jafari M, Kheirollahi M, Rozhenko M, Liu B (2023) Modeling Permeability Using Advanced White-Box Machine Learning Technique: Application to a Heterogeneous Carbonate Reservoir. ACS Omega 8(25):22256–23226. https://doi.org/10.1021/acsomega.3c01927
Funding
The authors declare that they have not received any fund to conduct this research.
Author information
Authors and Affiliations
Contributions
Mohammed A. Abbas and Watheq J. Al-Mudhafar accomplished the whole work, wrote the main manuscript text, and David A. Wood edited the manuscipt and provided depp discussion. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Competing Interests
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
The data used in this research can be provided upon request from the corresponding author.
Additional information
Communicated by: H. Babaie
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Abbas, M.A., Al-Mudhafar, W.J. & Wood, D.A. Improving permeability prediction in carbonate reservoirs through gradient boosting hyperparameter tuning. Earth Sci Inform 16, 3417–3432 (2023). https://doi.org/10.1007/s12145-023-01099-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12145-023-01099-0