Abstract
Carbonate reservoirs are known for their heterogeneity, which poses challenges in interpreting and defining geological models. The Brazilian reservoirs are formed mostly in highly faulted and fractured carbonate rocks, which can increase hydrocarbon transport and storage capacity. Strategies that permit the identification of these structures allow the optimization in the exploration of a reservoir. To fulfill this task, machine learning models have been able to provide an understanding of these environments through the use of data obtained by seismic methods. The use of convolutional neural networks (CNNs) has shown to be able to provide excellent abstractions in the field of semantic segmentation, including its use in seismic data. However, due to the highly heterogeneous formation of this type of data, the work of extracting information from these images remains challenging. From this, we investigate the potential of using Transformer models in this geological context focusing on the faults identification. As a technique to analyze this type of architecture, we use the TransUNet network, which combines the power of CNNs with the innovation brought by Transformers in a hybrid model of deep learning. To evaluate its performance, we made use of conventional CNNs to compare the results achieved. The results show that TransUNet outperforms conventional CNNs, achieving a Dice metric value of 88.34%, compared to 85.99% for U-Net, 83.41% for U-Net++, and 83.31% for SegNet, being also able to identify small structures beyond what is indicated in our target.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Albawi, S., Mohammed, T.A., Al-Zawi, S.: Understanding of a convolutional neural network. In: International Conference on Engineering and Technology, pp. 1–6. IEEE (2017)
Alsadi, H.N.: Seismic hydrocarbon exploration. In: 2D and 3D Techniques, Seismic Waves. Springer (2017)
An, Y., Guo, J., Ye, Q., Childs, C., Walsh, J., Dong, R.: Deep convolutional neural network for automatic fault recognition from 3D seismic datasets. Comput. Geosci. 153, 104776 (2021)
Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)
Bi, J., Zhu, Z., Meng, Q.: Transformer in computer vision. In: IEEE International Conference on Computer Science, Electronic Information Engineering and Intelligent Control Technology, pp. 178–188. IEEE (2021)
Chen, J., et al.: Trans-UNet: transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306 (2021)
Council, N.R.: Rock fractures and fluid flow: contemporary understanding and applications. National Academies Press (1996)
Crum, W.R., Camara, O., Hill, D.L.: Generalized overlap measures for evaluation and validation in medical image analysis. IEEE Trans. Med. Imaging 25(11), 1451–1461 (2006)
Dondurur, D.: Acquisition and Processing of Marine Seismic Data. Elsevier (2018)
Dosovitskiy, A., et al.: An image is worth 16\(\times \)16 words: Transformers for image recognition at scale (2020). arXiv preprint arXiv:2010.11929
Fu, Z.: Vision Transformer: ViT and its Derivatives. arXiv e-prints, pages arXiv-2205 (2022)
Guo, M.-H., et al.: Attention mechanisms in computer vision: a survey. Comput. Visual Media, pp. 1–38 (2022)
Han, K., et al.: A survey on vision transformer. IEEE Trans. Pattern Anal. Mach. Intell. (2022). abs/2012.12556:1–20
Huang, L., Dong, X., Clee, T.E.: A scalable deep learning platform for identifying geologic features from seismic attributes. Lead. Edge 36(3), 249–256 (2017)
Huang, M., Zhu, X., Gao, J.: Challenges in building intelligent open-domain dialog systems. ACM Trans. Inf. Syst. 38(3), 1–32 (2020)
Khan, S., et al.: Transformers in vision: a survey. ACM Comput. Surv. 54(10s), 1–41 (2022)
Khan, S., Rahmani, H., Shah, S.A.A., Bennamoun, M.: A guide to convolutional neural networks for computer vision. Synthesis Lectures Comput. Vision 8(1), 1–207 (2018)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Pepper, R.E.F., Bejarano, G.: PS advances in seismic fault interpretation automation. In: AAPG Annual Convention (2005)
Rawat, W., Wang, Z.: Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput. 29(9), 2352–2449 (2017)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 234–241. Springer (2015)
Shi, R., Ngan, K.N., Li, S.: Jaccard index compensation for object segmentation evaluation. In: IEEE International Conference on Image Processing, pp. 4457–4461. IEEE (2014)
Vaswani, A., Shazeer, N., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, 30 (2017)
Wei, X.-L., et al.: Seismic fault detection using convolutional neural networks with focal loss. Comput. Geosci. 158, 104968 (2022)
Wu, X., Liang, L., Shi, Y., Fomel, S.: FaultSeg3D: Using synthetic data sets to train an end-to-end convolutional neural network for 3D seismic fault segmentation. Geophysics 84(3), IM35-IM45 (2019a)
Wu, X., Shi, Y., Fomel, S., Liang, L., Zhang, Q., Yusifov, A.Z.: FaultNet3D: predicting fault probabilities, strikes, and dips with a single convolutional neural network. IEEE Trans. Geosci. Remote Sens. 57(11), 9138–9155 (2019)
Zhao, T., Mukhopadhyay, P.: A fault detection workflow using deep learning and image processing. In SEG International Exposition and Annual Meeting, OnePetro (2018)
Zheng, Y., Zhang, Q., Yusifov, A., Shi, Y.: Applications of supervised deep learning for seismic interpretation and inversion. Lead. Edge 38(7), 526–533 (2019)
Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., Liang, J.: U-Net++: a nested U-Net architecture for medical image segmentation. In: Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, pp. 3–11. Springer (2018)
Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., Liang, J.: U-Net++: redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging 39(6), 1856–1867 (2019)
Acknowledgments
The authors would like to thank the Brazilian National Council for Scientific and Technological Development (CNPq #304836/2022-2) and Shell Brasil Petróleo Ltda for their support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bomfim, L., Cunha, O., Kuroda, M., Vidal, A., Pedrini, H. (2023). Transformer Model for Fault Detection from Brazilian Pre-salt Seismic Data. In: Naldi, M.C., Bianchi, R.A.C. (eds) Intelligent Systems. BRACIS 2023. Lecture Notes in Computer Science(), vol 14196. Springer, Cham. https://doi.org/10.1007/978-3-031-45389-2_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-45389-2_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-45388-5
Online ISBN: 978-3-031-45389-2
eBook Packages: Computer ScienceComputer Science (R0)