Abstract
Stratum identification is critical in numerous fields related to earth sciences, such as geotechnical engineering, mining engineering. This study presents and evaluates a feature-fusion image recognition model of stratum for rotary drilling rig foundation building, with the aim to identify stratum rapidly and accurately during real-time drilling of drilling rigs. To begin, the color domain illumination estimation method is employed in conjunction with the Bradford chromaticity adaption conversion formula to rectify the color bias of stratum images induced by complicated illumination in the field. Then, using the modified watershed method and color statistical features, an image concrete feature extractor is built, and the feature recursion algorithm selects the ideal feature combination. The image's abstract features are then extracted using a lightweight convolutional neural network. Finally, the depth fusion of concrete and abstract features is used to construct a stratum recognition model. The results reveal that the color correction method aids in the resolution of color bias produced by complicated illumination and that the accuracy of the recognition model trained using the corrected image features improves by 4% on average. The suggested recognition model achieves 91% accuracy with very high information quality in the fused features. The method has high efficiency and accuracy and is expected to contribute to the engineering applications of stratum identification.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The data are not publicly available due to Privacy of data. Other relevant materials during the current study are available from the corresponding author on reasonable request.
Reference
Abija FA (2023) Ground variation, geotechnical uncertainties and reliability of Foundation Design for Sustainable Building Infrastructures with case histories. J Mat Sci Eng Technol 1:1–11
Alzubaidi F, Mostaghimi P, Swietojanski P, Clark SR, Armstrong RT (2021) Automated lithology classification from drill core images using convolutional neural networks. J Pet Sci Eng 197:107933. https://doi.org/10.1016/j.petrol.2020.107933
Amankwah A, Aldrich C (2010) Rock image segmentation using watershed with shape markers. In: 2010 IEEE 39th Applied Imagery Pattern Recognition Workshop (AIPR). pp 1-7
Awotunde JB, Misra S, Obagwu D, Florez H (2022) Multiple colour detection of RGB Images using machine learning algorithm. Appl Inform 60-74. https://doi.org/10.1007/978-3-031-19647-8_5
Chatterjee S (2013) Vision-based rock-type classification of limestone using multi-class support vector machine. Appl Intell 39:14–27. https://doi.org/10.1007/s10489-012-0391-7
Chen T, Guestrin C (2016) XGBoost: A scalable tree boosting system. pp 785-794
Cheng Y-C, Chen S-Y (2003) Image classification using color, texture and regions. Image Vis Comput 21:759–776. https://doi.org/10.1016/S0262-8856(03)00069-6
Cheng D, Prasad DK, Brown MS (2014) Illuminant estimation for color constancy: why spatial-domain methods work and the role of the color distribution. J Opt Soc Am A 31:1049–1058. https://doi.org/10.1364/JOSAA.31.001049
Childs OE (1977) Implications for future petroleum exploration. The future supply of nature-made petroleum and gas. Pergamon, pp 81–99. https://doi.org/10.1016/B978-0-08-021735-2.50014-8
Das R, Cleary PW (2010) Effect of rock shapes on brittle fracture using smoothed particle hydrodynamics. Theor Appl Fract Mech 53:47–60. https://doi.org/10.1016/j.tafmec.2009.12.004
Ding Y, Tan Z, Li S, Miao Z, Qu H (2021) Research on formation identification based on drilling shock and vibration parameters and energy principle. Shock Vib 2021:1–22. https://doi.org/10.1155/2021/6662777
Edel G, Kapustin V (2022) Exploring of the MobileNet V1 and MobileNet V2 models on NVIDIA Jetson Nano microcomputer. J Phys Conf Ser. 012008. https://doi.org/10.1088/1742-6596/2291/1/012008 IOP Publishing
Faghih MM, Moghaddam ME (2011) Neural gray edge: Improving gray edge algorithm using neural network. 2011 18th IEEE International Conference on Image Processing, pp 1705–1708. https://doi.org/10.1109/ICIP.2011.6115786
Gijsenij A, Gevers T, Jvd Weijer (2011) Computational color Constancy: survey and experiments. IEEE Trans Image Process 20:2475–2489. https://doi.org/10.1109/TIP.2011.2118224
Green P, Habib T (2019) Chromatic adaptation in colour management. Computational Color Imaging: 7th International Workshop, CCIW 2019, Chiba, Japan Proceedings. Springer-Verlag, Chiba, pp 134–144
Guo Q, Wang Y, Yang S, Xiang Z (2022) A method of blasted rock image segmentation based on improved watershed algorithm. Sci Rep 12:7143. https://doi.org/10.1038/s41598-022-11351-0
Guo Y, Li Z, Lin W, Zhou J, Feng S, Zhang L, Liu F (2023) Automatic lithology identification method based on efficient deep convolutional network. Earth Sci Inf.https://doi.org/10.1007/s12145-023-00962-4
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 770–778. https://doi.org/10.1109/CVPR.2016.90
Hernandez-Juarez D, Parisot S, Busam B, Leonardis A, Slabaugh G, McDonagh S (2020) A multi-hypothesis approach to color constancy. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp 2270–2280
Hossain SMM, Deb K, Dhar PK, Koshiba T (2021) Plant leaf disease recognition using depth-wise separable convolution-based models. Symmetry 13:511. https://doi.org/10.3390/sym13030511
Hubel DH, Wiesel TN (1962) Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J Physiol 160:106. https://doi.org/10.1113/jphysiol.1962.sp006837
Huo F, Li A, Zhao X, Ren W, Dong H, Yang J (2021) Novel lithology identification method for drilling cuttings under PDC bit condition. J Pet Sci Eng 205:108898. https://doi.org/10.1016/j.petrol.2021.108898
Kaya Y, Gürsoy E (2023) A MobileNet-based CNN model with a novel fine-tuning mechanism for COVID-19 infection detection. Soft Computing 27:5521–5535. https://doi.org/10.1007/s00500-022-07798-y
Krizhevsky A, Sutskever I, Hinton GE (2017) Imagenet classification with deep convolutional neural networks. Commun ACM 60:84–90. https://doi.org/10.1145/3065386
Li Z (2014) Research status and development trends for seismic migration technology. Oil Geophys Prospect 49:1–21
Li B, Wu F, Lim S-N, Belongie S, Weinberger KQ (2021) On feature normalization and data augmentation. In: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society. pp 12378-12387. https://doi.org/10.1109/CVPR46437.2021.01220
Liang Z, Nie Z, An A, Gong J, Wang X (2019) A particle shape extraction and evaluation method using a deep convolutional neural network and digital image processing. Powder Technol 353:156–170. https://doi.org/10.1016/j.powtec.2019.05.025
Lin M, Chen Q, Yan S (2014) Network in network. 2nd International Conference on Learning Representations. ICLR 2014, Banff, pp 14–16
Liu Y, Guo C, Li F, Lv L, Gao D (2019) Multi-color space features analysis from rock shin-section image for rock-type classification. J Phys Conf Ser 1237:032037. https://doi.org/10.1088/1742-6596/1237/3/032037
Liu T, Zhou J, Liang L, Bai Z, Zhao Y (2021) Effect of drill bit structure on sample collecting of lunar soil drilling. Adv Space Res 68:134–152. https://doi.org/10.1016/j.asr.2021.02.045
Liu Y, Liu Y, Yu BXB, Zhong S, Hu Z (2023) Noise-robust oversampling for imbalanced data classification. Pattern Recog 133:109008. https://doi.org/10.1016/j.patcog.2022.109008
Mitchum RM, Jr., Vail PR, Sangree JB, Payton CE (1977) Stratigraphic interpretation of seismic reflection patterns in depositional sequences. In: Payton CE (ed) Seismic Stratigraphy: Applications to Hydrocarbon Exploration, vol 26. The American Association of Petroleum Geologist, Tulsa, pp 117–133
Oloruntobi O, Butt S (2020) Application of specific energy for lithology identification. J Pet Sci Eng 184:106402. https://doi.org/10.1016/j.petrol.2019.106402
Peiran Z, Guolin Y, Tao L (2021) Boreability of strata by shield construction and case analysis of its application in machine-geotechnical state recognition. J Hunan Univ 48:99–110. https://doi.org/10.16339/j.cnki.hdxbzkb.2021.07.012
Perez CA, Saravia JA, Navarro CF, Schulz DA, Aravena CM, Galdames FJ (2015) Rock lithological classification using multi-scale gabor features from sub-images, and voting with rock contour information. Int J Miner Process 144:56–64. https://doi.org/10.1016/j.minpro.2015.09.015
Perez C, Navarro C, Vera P, Schulz D, Castillo L, Saravia J (2012) Rock grindability estimation based on the quaternion color extraction model. XXVI International Mineral Processing Congress (IMPC 2012) September 24–28, pp 4190–4198
Priscilla CV, Prabha DP (2021) A two-phase feature selection technique using mutual information and XGB-RFE for credit card fraud detection. Int J Adv Technol Eng Explor 8:1656–1668. https://doi.org/10.19101/IJATEE.2021.874615
Rebuffi S-A, Gowal S, Calian DA, Stimberg F, Wiles O, Mann TA (2021) Data augmentation can improve robustness. Adv Neural Inform Process Syst 34:29935–29948
Sabah M, Talebkeikhah M, Wood DA, Khosravanian R, Anemangely M, Younesi A (2019) A machine learning approach to predict drilling rate using petrophysical and mud logging data. Earth Sci Inf 12:319–339. https://doi.org/10.1007/s12145-019-00381-4
Sandler M, Howard A, Zhu M, Zhmoginov A, Chen L-C (2018) Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4510–4520. https://doi.org/10.1109/CVPR.2018.00474
Shu L, McIsaac K, Osinski GR, Francis R (2017) Unsupervised feature learning for autonomous rock image classification. Comput Geosci 106:10–17. https://doi.org/10.1016/j.cageo.2017.05.010
Shukla RK, Tiwari AK (2023) Masked face recognition using mobilenet V2 with transfer learning. Computer Syst Sci Eng 45(1):293–309. https://doi.org/10.32604/csse.2023.027986
Si L, Xiong X, Wang Z, Tan C (2020) A deep convolutional neural network model for intelligent discrimination between coal and rocks in coal mining face. Math Probl Eng 2020:1–12. https://doi.org/10.1155/2020/2616510
Song MH, Won CD, Chae CH, Paek NI (2021) Spectral analysis based on wavelet transform maxima: identification of multi-order stratigraphic boundaries and cycles. Math Geosci 53:969–997. https://doi.org/10.1007/s11004-020-09879-w
Su C, Xu S-j, Zhu K-y, Zhang X-c (2020) Rock classification in petrographic thin section images based on concatenated convolutional neural networks. Earth Sci Inf 13:1477–1484. https://doi.org/10.1007/s12145-020-00505-1
Sun L, Li Z, Li K, Liu H, Liu G, Lv W (2023) Cross-well lithology identification based on wavelet transform and adversarial learning. Energies 16:1475. https://doi.org/10.3390/en16031475
Tian Y, Guo C, Lv L, Li F, Gao C, Liu Y (2019) Multi-color space rock shin-section image classification with SVM. 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), pp 571–574. https://doi.org/10.1109/ITAIC.2019.8785477
Tsai C-Y, Su Y-K (2022) MobileNet-JDE: a lightweight multi-object tracking model for embedded systems. Multimedia Tools Applic 81:9915–9937. https://doi.org/10.1007/s11042-022-12095-9
Wang W, Wang Z, Zhou Z, Deng H, Zhao W, Wang C, Guo Y (2021) Anomaly detection of industrial control systems based on transfer learning. Tsinghua Sci Technol 26:821–832. https://doi.org/10.26599/TST.2020.9010041
Weijer JVD, Gevers T, Gijsenij A (2007) Edge-based color Constancy. IEEE Trans Image Process 16:2207–2214. https://doi.org/10.1109/TIP.2007.901808
Xu Z, Ma W, Lin P, Shi H, Pan D, Liu T (2021) Deep learning of rock images for intelligent lithology identification. Comput Geosci 154:104799. https://doi.org/10.1016/j.cageo.2021.104799
Xu Z, Shi H, Lin P, Liu T (2021) Integrated lithology identification based on images and elemental data from rocks. J Pet Sci Eng 205:108853. https://doi.org/10.1016/j.petrol.2021.108853
Xu P, Gan C, Wang L, Cao W (2022) A multi-feature extraction-based image identification method for rock debris in the drilling process. 2022 China Automation Congress (CAC), pp 6666–6671. https://doi.org/10.1109/CAC57257.2022.10054959
Zhang Q, Gu J, Liu J (2021) Research on coal and rock type recognition based on mechanical vision. Shock Vib 2021:6617717. https://doi.org/10.1155/2021/6617717
Zhou X, Gong Q, Liu Y, Yin L (2021) Automatic segmentation of TBM muck images via a deep-learning approach to estimate the size and shape of rock chips. Autom Constr 126:103685. https://doi.org/10.1016/j.autcon.2021.103685
Zhou Y, Ren H (2012) Segmentation method for rock particles image based on improved watershed algorithm. 2012 International Conference on Computer Science and Service System, pp 347–349. https://doi.org/10.1109/CSSS.2012.94
Zhou Zhenjian CK, Huizhong Gao, Changhai Chu (2020) Datafication method of multi-source geological information based on VBA vector-graphic recognition technology. Tunnel Construction 40:371–378. https://doi.org/10.3973/j.issn.2096-4498.2020.03.009
Funding
The research was supported by Top Ten Science and Technology Research Projects Fund of Hunan Province (2021GK1150): "Digital Prototype and Digital Twin Technology Research of Rotary Drilling Rig".
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Zhengyan WU: Methodology, Data collection, Writing - Original Draft, Software. Jilin HE: Conceptualization, Writing - Review & Editing, Supervision, Resources. Chao HUANG: Writing - Original Draft, Programing, Visualization. Renshan YAO: Programming and guidance. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Declarations
The authors confirm that this work is not been published elsewhere, nor is it currently under consideration for publication elsewhere. All authors have read and approved the manuscript and have no conflicts of interest to declare.
Competing interests
The authors declare no competing interests.
Conflict of interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Additional information
Communicated by H. Babaie
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wu, Z., He, J., Huang, C. et al. A novel feature fusion-based stratum image recognition method for drilling rig. Earth Sci Inform 16, 4293–4311 (2023). https://doi.org/10.1007/s12145-023-01132-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12145-023-01132-2